-- Logs begin at Tue 2022-08-09 10:33:59 UTC, end at Tue 2022-08-09 11:43:29 UTC. -- Aug 09 11:04:39.644730 dv-cinder-852514-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 09 11:04:39.653960 dv-cinder-852514-2-smb devstack@keystone.service[80157]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 09 11:04:39.655966 dv-cinder-852514-2-smb devstack@keystone.service[80157]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 11:04:39 2022] *** Aug 09 11:04:39.655966 dv-cinder-852514-2-smb devstack@keystone.service[80157]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 11:04:39.655966 dv-cinder-852514-2-smb devstack@keystone.service[80157]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 11:04:39.655966 dv-cinder-852514-2-smb devstack@keystone.service[80157]: nodename: dv-cinder-852514-2-smb Aug 09 11:04:39.655966 dv-cinder-852514-2-smb devstack@keystone.service[80157]: machine: x86_64 Aug 09 11:04:39.655966 dv-cinder-852514-2-smb devstack@keystone.service[80157]: clock source: unix Aug 09 11:04:39.655966 dv-cinder-852514-2-smb devstack@keystone.service[80157]: pcre jit disabled Aug 09 11:04:39.655966 dv-cinder-852514-2-smb devstack@keystone.service[80157]: detected number of CPU cores: 4 Aug 09 11:04:39.655966 dv-cinder-852514-2-smb devstack@keystone.service[80157]: current working directory: / Aug 09 11:04:39.655966 dv-cinder-852514-2-smb devstack@keystone.service[80157]: detected binary path: /usr/bin/uwsgi-core Aug 09 11:04:39.656502 dv-cinder-852514-2-smb devstack@keystone.service[80157]: your processes number limit is 47680 Aug 09 11:04:39.656502 dv-cinder-852514-2-smb devstack@keystone.service[80157]: your memory page size is 4096 bytes Aug 09 11:04:39.656502 dv-cinder-852514-2-smb devstack@keystone.service[80157]: detected max file descriptor number: 2048 Aug 09 11:04:39.656502 dv-cinder-852514-2-smb devstack@keystone.service[80157]: lock engine: pthread robust mutexes Aug 09 11:04:39.656502 dv-cinder-852514-2-smb devstack@keystone.service[80157]: thunder lock: enabled Aug 09 11:04:39.656502 dv-cinder-852514-2-smb devstack@keystone.service[80157]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 09 11:04:39.656502 dv-cinder-852514-2-smb devstack@keystone.service[80157]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 11:04:39.695105 dv-cinder-852514-2-smb devstack@keystone.service[80157]: Python main interpreter initialized at 0x563d7e0f99c0 Aug 09 11:04:39.695105 dv-cinder-852514-2-smb devstack@keystone.service[80157]: python threads support enabled Aug 09 11:04:39.695105 dv-cinder-852514-2-smb devstack@keystone.service[80157]: your server socket listen backlog is limited to 100 connections Aug 09 11:04:39.695105 dv-cinder-852514-2-smb devstack@keystone.service[80157]: your mercy for graceful operations on workers is 90 seconds Aug 09 11:04:39.695444 dv-cinder-852514-2-smb devstack@keystone.service[80157]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 11:04:39.695578 dv-cinder-852514-2-smb devstack@keystone.service[80157]: *** Operational MODE: preforking *** Aug 09 11:04:39.695846 dv-cinder-852514-2-smb devstack@keystone.service[80157]: *** uWSGI is running in multiple interpreter mode *** Aug 09 11:04:39.695846 dv-cinder-852514-2-smb devstack@keystone.service[80157]: spawned uWSGI master process (pid: 80157) Aug 09 11:04:39.696007 dv-cinder-852514-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 09 11:04:39.696621 dv-cinder-852514-2-smb devstack@keystone.service[80157]: spawned uWSGI worker 1 (pid: 80168, cores: 1) Aug 09 11:04:39.696946 dv-cinder-852514-2-smb devstack@keystone.service[80157]: spawned uWSGI worker 2 (pid: 80169, cores: 1) Aug 09 11:04:39.697101 dv-cinder-852514-2-smb devstack@keystone.service[80157]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 11:04:45.077487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:04:45.077487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: from cryptography.utils import int_from_bytes Aug 09 11:04:45.078390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:04:45.078390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: from cryptography.utils import int_from_bytes Aug 09 11:04:45.129879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 11:04:45.130100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 11:04:45.130245 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] command line args: [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 11:04:45.130512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 11:04:45.131028 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ================================================================================ {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 11:04:45.131307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] admin_token = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.131552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] config_dir = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.131686 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.131898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] config_source = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.132027 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] debug = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.132256 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.133663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.133663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.133663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.133663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.133663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.133663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] log_config_append = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.134161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.134161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] log_dir = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.134161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] log_file = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.134392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.134683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.134911 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.135160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.135291 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.135500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.135779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.135970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.136201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.136427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.136660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.136888 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.137131 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.137374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.137647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.138164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.138344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] publish_errors = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.138571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.138799 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.138956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.139199 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.139429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.139662 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] standard_threads = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.139887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.140132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.140305 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.140479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] use_journal = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.140650 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] use_json = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.140822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] use_stderr = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.140995 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] use_syslog = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.141221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.141474 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.141743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.142001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.142237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.142483 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.142717 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.142962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.143194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.143439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.143682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.143930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.144161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.144403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.144637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.144881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.145125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.145358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.145613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.145888 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.146130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.146363 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.146612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.146869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.147119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.147365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.147593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.147823 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.148053 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.148284 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.148531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.148775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.149003 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.149232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.149499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.149771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.150007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.150258 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.150488 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.150720 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.150953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.151182 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.151410 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.151640 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.151868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.152100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.152346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.152574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.152807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.153035 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.153265 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.153514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.153762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.153992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.154226 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.154461 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.154695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.154930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.155167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.155397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.155645 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.155880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.156117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.156348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.156606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.156840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.157070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.157306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.157542 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.157836 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.158073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.158321 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.158567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.158802 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.159037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.159269 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.159517 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.159755 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.159990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.160234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.160418 dv-cinder-852514-2-smb devstack@keystone.service[80169]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:04:45.160418 dv-cinder-852514-2-smb devstack@keystone.service[80169]: from cryptography.utils import int_from_bytes Aug 09 11:04:45.160931 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.160931 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.161058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 11:04:45.161058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: from cryptography.utils import int_from_bytes Aug 09 11:04:45.161172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.161172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.161378 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.161600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.161857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.162098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.162335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.162576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.162813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.163049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.163285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.163514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.163744 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.163973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.164206 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.164435 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.164676 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.164914 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.165211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.165447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.165731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.165993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.166234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.166466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.external = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.166696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.166992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.167225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.167455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.password = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.167686 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] auth.token = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.167926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.168160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.168406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.168635 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.168881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.169129 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.169360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.169595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.169866 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.170121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.170369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.170606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.170851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.171083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.171336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.171586 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.171821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.172070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.172358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.172606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.172868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.173108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.173364 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.173600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.173861 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.174107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.174351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.174581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.174830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.175068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.175321 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.175561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.175819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.176059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.176306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.176541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.176788 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.177037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.177273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.177509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.177785 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.178017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.178253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.178504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.178756 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.178987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.179216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.179446 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.179689 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.179934 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.180194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.180447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.180717 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.180986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.181222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.181465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.181716 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.181953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.182182 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.182418 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.182655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.182892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.183138 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.183367 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.183615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.183863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.184095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.184341 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.184590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.184821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.185059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.185286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.185521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.185778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.186022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.186256 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.186490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.186739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.186984 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.187215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.187444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.187981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.188236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.188472 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.188708 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.188942 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.189174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.189415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.189702 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.189935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.190186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.190430 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.190675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.190907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.191136 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.191370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.191602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.191837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.192066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.192310 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.192552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.192796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.193039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.193283 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.193514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.193781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.194018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.194253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.194487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.194721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.194965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.195211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.195448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.195701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.195930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.196172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.196458 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.196693 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.196931 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.197177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.197420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.197672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.197913 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.198150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.198529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.198778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.199013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.199262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.199513 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.200067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.200067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.200232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.200452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.200687 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] role.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.200932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] role.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.201163 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.201411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.201679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.201930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.202175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.202425 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.202669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.202913 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.203158 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.203389 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.203635 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.203881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.204127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.204370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.204798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.205037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.205283 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.205531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.205800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.206050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.206305 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.206539 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.206791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.207030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.207259 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.207490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.207576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 11:04:45.207721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.207806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 11:04:45.207939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] command line args: [] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 11:04:45.208015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.208206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 11:04:45.208292 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.208385 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ================================================================================ {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 11:04:45.208464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.208675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.208752 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] admin_token = **** {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.208911 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.209000 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] config_dir = [] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.209141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.209220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.209377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.209461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] config_source = [] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.209672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.209756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] debug = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.209878 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.209982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.210120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.210209 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.210367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.210444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.210615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.210692 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.210853 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.211010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.211090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.211298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] list_limit = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.211376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.211511 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] log_config_append = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.211589 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.211734 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.211813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.211957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] log_dir = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.212042 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.212168 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] log_file = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.212246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.212470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.212550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.212729 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.212805 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.212960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.213085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.213202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.213385 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.213494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.213573 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.213765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.213846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.connection = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.214009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.214099 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.214258 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.214337 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.214493 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.214594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.214733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.214895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.214974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.215191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.215269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.215426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.215504 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.215668 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.215781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.215890 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.216090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.216168 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.216355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.216491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.216591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.216835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.217070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.217153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.217271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] publish_errors = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.217349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.217531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.217609 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.217795 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.217885 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.218028 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.218107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.218197 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 11:04:45.218374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.218673 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.218971 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] standard_threads = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.219266 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.219573 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.219781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.219988 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] use_journal = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.220195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] use_json = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.220407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] use_stderr = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.220613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] use_syslog = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.220907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 11:04:45.221227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.221531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.221929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.222254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.222613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.222978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.223468 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.223830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.224084 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.224336 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.224589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.224824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.225073 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.225310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.225558 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.225845 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.226082 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.226337 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.226590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.226837 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.227073 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.227327 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.227691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.227950 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.228199 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.228432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.228664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.228896 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.229130 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.229388 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.229668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.229905 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.230142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.230388 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.230635 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.230872 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.231120 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.231351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.231585 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.231823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.232055 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.232287 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.232520 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.232751 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.232988 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.233238 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.233469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.233730 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.233967 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.234202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.234436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.234689 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.234921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.235159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.235396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.235633 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.235870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.236107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.236339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.236587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.236822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.237060 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.237293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.237551 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.237850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.238084 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.238321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.238556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.238827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.239063 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.239312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.239555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.239791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.240029 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.240263 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.240508 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.240744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.240978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.241219 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.241455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.241711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.241946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.242179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.242414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.242674 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.242911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.243177 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.243414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.243654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.243891 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.244126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.244362 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.244595 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.244825 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.245056 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.245289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.245520 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.245788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.246034 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.246282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.246517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.246772 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.247032 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.247275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.247508 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] auth.external = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.247644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.247727 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.247878 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.248023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.248109 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.248260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.248491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] auth.password = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.248722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] auth.token = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.248960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.249195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.249443 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.249694 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.249949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.250193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.250423 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.250672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] credential.caching = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.250903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.251151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.251399 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.251637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.251883 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.252117 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.252379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.252633 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.252868 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.253121 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.253404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.253679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.253945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.254188 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.254446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.254682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] federation.caching = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.254920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.255166 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.255412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.256009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.256257 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.256493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.256747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.256903 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.256997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.257228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.257466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.257735 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.257972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity.caching = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.258221 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.258469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.258746 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.258984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.259231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.259462 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.259700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.259953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.260206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.260437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.260666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.260894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.261137 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.261383 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.261661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.261909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.262155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.262425 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.262662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.262900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.263129 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.263368 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.263607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.263844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.264087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.264326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.264575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.264807 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.265054 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.265300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.265534 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.265802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.266051 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.266281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.266518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.266749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.266987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.267226 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.267470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.267707 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.267943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.268194 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.268444 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.268677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.268906 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.269155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.269401 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.269663 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.269901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.270135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.270366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.270605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.270865 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.271098 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.271344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.271592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.271840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.272073 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.272303 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.272535 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.272767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.273001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.273231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.273475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.273748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.273996 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.274242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.274512 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.274743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.274991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.275229 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.275464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.275698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.275932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.276175 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.276423 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.276660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.276913 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.277143 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.277385 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.277645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.277875 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.278111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.278357 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.278599 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.278829 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.279065 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.279303 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] resource.caching = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.279557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.279804 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.280039 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.280291 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.280541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.280773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.281019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.281280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.281496 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.281751 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] role.caching = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.282000 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] role.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.282228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.282474 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.282720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.282965 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.283209 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.283457 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.283702 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.283949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.284204 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.284437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.284682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.284876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.284975 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.285152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.285263 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.285393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.285842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.286075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.286324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.286572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.286820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.287067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.287300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.287555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.287946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.288186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.288574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.288661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.288875 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.289126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.289383 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.289655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.289905 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.290185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.290417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.290652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] token.caching = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.290889 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.291139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.291387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.291625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.291872 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.292111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.292354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.292595 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.292844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.293080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.293318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.293572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.293822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.294072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.294301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.294541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.294836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.295097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.connection = **** {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.295340 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.295585 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.295823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.296062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.296297 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.296533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.296768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.297011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.297246 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.297481 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.297748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.297983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.298230 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.298464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.298711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.298943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.299182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.299415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 11:04:45.299587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 11:04:45.325663 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.325889 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.326065 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.336933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.356370 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.356594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.408472 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.420365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.460100 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.460379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.462560 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.462943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.527551 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.527781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.528003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.528218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.528433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.528645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.539035 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.539366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.539683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.539999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.540347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.540655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.551816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.552085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.552223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.552466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.552670 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.552904 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.553119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.556876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.557107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.557336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.557566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.557802 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.558074 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.558387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.564255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.568857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.577092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.577323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.577553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.577808 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.578038 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.578246 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.578459 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80169) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.583280 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.583563 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.583737 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.583925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.584191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.584383 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.584618 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 11:04:45.595584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.595710 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 11:04:45.596064 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.596190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.596259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 11:04:45.596335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 11:04:45.596517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.596647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.596758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.596848 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 11:04:45.597009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.597101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.597292 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.597421 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.597517 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.597828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.607604 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.607883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.608162 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.608446 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.608640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.608935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.609209 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.609492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.615499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.616397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.618519 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.618807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.619093 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.619377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.619602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.619734 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.619861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.619956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.620169 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.620295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.620418 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.620520 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.620712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.620838 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.620922 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.620997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.621238 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.621379 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.621500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.621814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.622093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.622368 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.644444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.645752 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.645994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.646240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.647259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.647551 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.651028 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.651314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.651718 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.652205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.652482 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.652766 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.658237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.658521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.661309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.661596 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.662592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.662883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.663192 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.665263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.665571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.665781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.665872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.666047 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.666172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.666332 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.666457 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.666589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.666895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.667172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.667442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.667709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.682638 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.682923 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.683389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.683677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.686835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.687623 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.690014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.690426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.690777 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.691076 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.694938 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.695447 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.698633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.698756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.701869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.701997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.702175 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.702300 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.702453 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.702619 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.702736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.702836 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.703025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.703153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.703279 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.703404 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.719225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.719351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.719516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.719642 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.719789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.719932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.720005 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.720082 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.726895 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.727155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.728603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.728824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.728947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.729029 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.731566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.731843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.731993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.732093 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.732170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.732417 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.732529 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.732706 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.732817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.732966 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.744188 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.744443 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.744595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.744714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.744813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.745025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.745150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.745277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.745366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.745589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.745744 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.745879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.745984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.746152 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.761687 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.763185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.764624 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.766143 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.767857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.769068 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.769305 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.770661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.770861 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.771156 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.771435 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.772178 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.772471 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.772757 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.778037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.779217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.779532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.780816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.782503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.782794 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.783075 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.783351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.783790 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.784085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.784365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.784638 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.791503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.791794 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.792077 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.792674 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.792969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.793247 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.799210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.799604 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.799893 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.800114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80169) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 11:04:45.800259 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.800399 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.800489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.800641 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.800731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.800947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.801073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.801210 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.801329 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.801454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.801652 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.801775 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.801953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.802099 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.802250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.802369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.802462 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.802661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.802789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.802945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.803084 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.803168 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.803479 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.803738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80169) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 11:04:45.837019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563d7e0f99c0 pid: 80169 (default app) Aug 09 11:04:45.837394 dv-cinder-852514-2-smb devstack@keystone.service[80168]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563d7e0f99c0 pid: 80168 (default app) Aug 09 11:04:45.840672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507bd24-da66-4754-ad5a-f963f744ebe1 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:45.840951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507bd24-da66-4754-ad5a-f963f744ebe1 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:45.841222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507bd24-da66-4754-ad5a-f963f744ebe1 None None] PATH_INFO: `/v3` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:45.845842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Tue Aug 9 11:04:45 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:04:53.529340 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d7e65-4f09-41bb-9d59-62c073b7df3d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:53.529967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d7e65-4f09-41bb-9d59-62c073b7df3d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:53.529967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d7e65-4f09-41bb-9d59-62c073b7df3d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:53.534263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:04:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:04:53.539766 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da215d-2bf7-42ca-aeec-86cfe56e4929 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:53.540298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da215d-2bf7-42ca-aeec-86cfe56e4929 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:53.540436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da215d-2bf7-42ca-aeec-86cfe56e4929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:53.610547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: INFO dbcounter [None req-f2da215d-2bf7-42ca-aeec-86cfe56e4929 None None] Registered counter for database keystone Aug 09 11:04:53.630765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG oslo_db.sqlalchemy.engines [None req-f2da215d-2bf7-42ca-aeec-86cfe56e4929 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:04:53.637651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writer thread running {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:04:53.818852 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG passlib.handlers.bcrypt [None req-f2da215d-2bf7-42ca-aeec-86cfe56e4929 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80169) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 11:04:53.819250 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG passlib.handlers.bcrypt [None req-f2da215d-2bf7-42ca-aeec-86cfe56e4929 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80169) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 11:04:53.875593 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-f2da215d-2bf7-42ca-aeec-86cfe56e4929 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:04:53.877233 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f2da215d-2bf7-42ca-aeec-86cfe56e4929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:04:54.023331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:04:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 11:04:54.175802 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d7e65-4f09-41bb-9d59-62c073b7df3d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:04:54.246550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: INFO dbcounter [None req-e75d7e65-4f09-41bb-9d59-62c073b7df3d None None] Registered counter for database keystone Aug 09 11:04:54.268430 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG oslo_db.sqlalchemy.engines [None req-e75d7e65-4f09-41bb-9d59-62c073b7df3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 11:04:54.276007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writer thread running {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 11:04:54.395000 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d7e65-4f09-41bb-9d59-62c073b7df3d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:04:54.399769 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cadd2ed-6c4d-4e15-87c4-2637937b421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:04:54.400405 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadd2ed-6c4d-4e15-87c4-2637937b421a admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:54.400686 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadd2ed-6c4d-4e15-87c4-2637937b421a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:54.400952 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadd2ed-6c4d-4e15-87c4-2637937b421a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:54.410464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cadd2ed-6c4d-4e15-87c4-2637937b421a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:04:54.461525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5cadd2ed-6c4d-4e15-87c4-2637937b421a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 11:04:54.461839 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cadd2ed-6c4d-4e15-87c4-2637937b421a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:04:54.472386 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Tue Aug 9 11:04:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:04:54.479542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da215d-2bf7-42ca-aeec-86cfe56e4929 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:04:54.495050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da215d-2bf7-42ca-aeec-86cfe56e4929 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:04:54.500795 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46ca39-6042-4b26-9307-58876cb03000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:04:54.501967 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46ca39-6042-4b26-9307-58876cb03000 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:54.502244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46ca39-6042-4b26-9307-58876cb03000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:54.502509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46ca39-6042-4b26-9307-58876cb03000 admin admin] PATH_INFO: `/v3/projects/152f15d50a21447fba37927c712cf876` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:54.504069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46ca39-6042-4b26-9307-58876cb03000 admin admin] RBAC: Authorizing `identity:get_project(project_id=152f15d50a21447fba37927c712cf876)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:04:54.554872 dv-cinder-852514-2-smb devstack@keystone.service[80169]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1a46ca39-6042-4b26-9307-58876cb03000 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 11:04:54.555574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46ca39-6042-4b26-9307-58876cb03000 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:04:54.560119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Tue Aug 9 11:04:54 2022] GET /identity/v3/projects/152f15d50a21447fba37927c712cf876 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:04:56.535441 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fce3ff-1005-4c6c-b9f2-3ac93315b37e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:56.535971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fce3ff-1005-4c6c-b9f2-3ac93315b37e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:56.535971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fce3ff-1005-4c6c-b9f2-3ac93315b37e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:56.540208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:04:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:04:56.547017 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf82b6-6109-4072-b101-91af220e6d6d None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:56.547818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf82b6-6109-4072-b101-91af220e6d6d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:56.547818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf82b6-6109-4072-b101-91af220e6d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:56.579399 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-e6bf82b6-6109-4072-b101-91af220e6d6d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:04:56.580949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e6bf82b6-6109-4072-b101-91af220e6d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:04:56.589715 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:04:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 11:04:56.612057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fce3ff-1005-4c6c-b9f2-3ac93315b37e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:04:56.625927 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fce3ff-1005-4c6c-b9f2-3ac93315b37e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:04:56.630921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9592c45-ffad-4849-b591-187470621903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:04:56.631529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9592c45-ffad-4849-b591-187470621903 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:56.631797 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9592c45-ffad-4849-b591-187470621903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:56.632062 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9592c45-ffad-4849-b591-187470621903 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:56.640681 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9592c45-ffad-4849-b591-187470621903 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:04:56.642499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9592c45-ffad-4849-b591-187470621903 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:04:56.651674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Tue Aug 9 11:04:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:04:56.657778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf82b6-6109-4072-b101-91af220e6d6d None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:04:56.670081 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf82b6-6109-4072-b101-91af220e6d6d None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:04:56.675853 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069946b-4920-42a6-84a7-a9784ecc1bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:04:56.676483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069946b-4920-42a6-84a7-a9784ecc1bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:56.676755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069946b-4920-42a6-84a7-a9784ecc1bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:56.677019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069946b-4920-42a6-84a7-a9784ecc1bd2 admin admin] PATH_INFO: `/v3/users/f51a1b11f75b400fabaa9dacc41da029` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:56.678522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069946b-4920-42a6-84a7-a9784ecc1bd2 admin admin] RBAC: Authorizing `identity:get_user(user_id=f51a1b11f75b400fabaa9dacc41da029)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:04:56.680410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069946b-4920-42a6-84a7-a9784ecc1bd2 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:04:56.682065 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Tue Aug 9 11:04:56 2022] GET /identity/v3/users/f51a1b11f75b400fabaa9dacc41da029 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:04:58.741325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aabff-58ac-4077-9b86-cc518e17283b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:58.741863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aabff-58ac-4077-9b86-cc518e17283b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:58.741863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aabff-58ac-4077-9b86-cc518e17283b None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:58.743356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:04:58.749364 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d88ceb-63c7-461b-a5ef-eb4c417a7983 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:58.749896 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d88ceb-63c7-461b-a5ef-eb4c417a7983 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:58.749995 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d88ceb-63c7-461b-a5ef-eb4c417a7983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:58.769178 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-39d88ceb-63c7-461b-a5ef-eb4c417a7983 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:04:58.770724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-39d88ceb-63c7-461b-a5ef-eb4c417a7983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:04:58.771072 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99208-6dfe-4c97-8f3b-477c27ca9f1d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:58.771356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99208-6dfe-4c97-8f3b-477c27ca9f1d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:58.771632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99208-6dfe-4c97-8f3b-477c27ca9f1d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:58.772947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:04:58.778014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed7cbb-24dd-42ba-b603-687f3c8dadee None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:58.778292 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed7cbb-24dd-42ba-b603-687f3c8dadee None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:58.778557 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed7cbb-24dd-42ba-b603-687f3c8dadee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:58.820649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG passlib.handlers.bcrypt [None req-f6ed7cbb-24dd-42ba-b603-687f3c8dadee None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80168) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 11:04:58.821168 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG passlib.handlers.bcrypt [None req-f6ed7cbb-24dd-42ba-b603-687f3c8dadee None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80168) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 11:04:58.851782 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:04:58.866480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f6ed7cbb-24dd-42ba-b603-687f3c8dadee None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:04:58.868128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f6ed7cbb-24dd-42ba-b603-687f3c8dadee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:04:58.874722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d88ceb-63c7-461b-a5ef-eb4c417a7983 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:04:58.900943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:04:58.972194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:04:58.983263 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d88ceb-63c7-461b-a5ef-eb4c417a7983 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:04:58.994073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed7cbb-24dd-42ba-b603-687f3c8dadee None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:04:59.044424 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972c390-a079-47b3-a266-b015e713c75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:04:59.045511 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972c390-a079-47b3-a266-b015e713c75c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:59.045846 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972c390-a079-47b3-a266-b015e713c75c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:59.046119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972c390-a079-47b3-a266-b015e713c75c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:59.059788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972c390-a079-47b3-a266-b015e713c75c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-2972c390-a079-47b3-a266-b015e713c75c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:04:59.068655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:04:59.069660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:04:59.070494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:04:59.070494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:04:59.070494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:04:59.070494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:04:59.070494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:04:59.070494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:04:59.070494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:04:59.070494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:04:59.070494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:04:59.070494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:04:59.070494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:04:59.070494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:04:59.070494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:04:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:04:59.075991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972c390-a079-47b3-a266-b015e713c75c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:04:59.120706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed7cbb-24dd-42ba-b603-687f3c8dadee None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:04:59.123419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:04:59.159042 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9b066-9c24-47e1-a00f-0c9c83e2a32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:04:59.160035 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9b066-9c24-47e1-a00f-0c9c83e2a32d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:59.160312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9b066-9c24-47e1-a00f-0c9c83e2a32d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:59.160578 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9b066-9c24-47e1-a00f-0c9c83e2a32d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:59.161908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:04:59.180107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972c390-a079-47b3-a266-b015e713c75c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:04:59.213761 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbdbc8-3354-4b34-b2b9-285daae0d9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:04:59.214364 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbdbc8-3354-4b34-b2b9-285daae0d9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:59.214635 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbdbc8-3354-4b34-b2b9-285daae0d9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:59.214900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbdbc8-3354-4b34-b2b9-285daae0d9a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:59.215564 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbdbc8-3354-4b34-b2b9-285daae0d9a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:04:59.215858 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbdbc8-3354-4b34-b2b9-285daae0d9a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:04:59.217266 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbdbc8-3354-4b34-b2b9-285daae0d9a0 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:04:59.228112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9b066-9c24-47e1-a00f-0c9c83e2a32d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:04:59.229655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9b066-9c24-47e1-a00f-0c9c83e2a32d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:04:59.229754 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:04:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:04:59.235410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbdbc8-3354-4b34-b2b9-285daae0d9a0 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:04:59.331159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:04:59.337563 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9b066-9c24-47e1-a00f-0c9c83e2a32d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:04:59.340914 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:04:59.444586 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9b066-9c24-47e1-a00f-0c9c83e2a32d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:04:59.449409 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbdbc8-3354-4b34-b2b9-285daae0d9a0 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:04:59.481515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c1df5-847d-45e0-8490-cbd10a86a3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:04:59.482429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c1df5-847d-45e0-8490-cbd10a86a3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:59.482703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c1df5-847d-45e0-8490-cbd10a86a3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:59.482970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c1df5-847d-45e0-8490-cbd10a86a3e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:59.485490 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f44bdd-55e2-472a-9c0f-07953d09bc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:04:59.486164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f44bdd-55e2-472a-9c0f-07953d09bc61 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:59.486436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f44bdd-55e2-472a-9c0f-07953d09bc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:59.486700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f44bdd-55e2-472a-9c0f-07953d09bc61 None admin] PATH_INFO: `/v3/users/f51a1b11f75b400fabaa9dacc41da029` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:59.487870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f44bdd-55e2-472a-9c0f-07953d09bc61 None admin] RBAC: Authorizing `identity:get_user(user_id=f51a1b11f75b400fabaa9dacc41da029)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:04:59.489359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f44bdd-55e2-472a-9c0f-07953d09bc61 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:04:59.490991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:04:59 2022] GET /identity/v3/users/f51a1b11f75b400fabaa9dacc41da029 => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:04:59.496595 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f44bdd-55e2-472a-9c0f-07953d09bc61 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:04:59.502352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c1df5-847d-45e0-8490-cbd10a86a3e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:04:59.503828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c1df5-847d-45e0-8490-cbd10a86a3e1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:04:59.512077 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-c52c1df5-847d-45e0-8490-cbd10a86a3e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:04:59.522532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:04:59.523473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:04:59.524307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:04:59.524307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:04:59.524307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:04:59.524307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:04:59.529705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c1df5-847d-45e0-8490-cbd10a86a3e1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:04:59.593076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:04:59.603181 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f44bdd-55e2-472a-9c0f-07953d09bc61 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:04:59.638346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c171d-dd0c-47b9-b561-52ca9a8ef728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:04:59.638995 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c171d-dd0c-47b9-b561-52ca9a8ef728 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:59.639267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c171d-dd0c-47b9-b561-52ca9a8ef728 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:59.639534 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c171d-dd0c-47b9-b561-52ca9a8ef728 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:59.640658 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c171d-dd0c-47b9-b561-52ca9a8ef728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:04:59.642150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c171d-dd0c-47b9-b561-52ca9a8ef728 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:04:59.643708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:04:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:04:59.645641 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c1df5-847d-45e0-8490-cbd10a86a3e1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:04:59.649546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c171d-dd0c-47b9-b561-52ca9a8ef728 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:04:59.681048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0299988-76a5-4d7b-a52e-53d6f09449ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:04:59.681673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0299988-76a5-4d7b-a52e-53d6f09449ff None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:59.681952 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0299988-76a5-4d7b-a52e-53d6f09449ff None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:59.682213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0299988-76a5-4d7b-a52e-53d6f09449ff None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:59.682866 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0299988-76a5-4d7b-a52e-53d6f09449ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:04:59.683163 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0299988-76a5-4d7b-a52e-53d6f09449ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:04:59.684550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0299988-76a5-4d7b-a52e-53d6f09449ff None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:04:59.703445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 10/20] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:04:59.736453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:04:59.761072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c171d-dd0c-47b9-b561-52ca9a8ef728 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:04:59.804306 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e84150-ad77-414b-9611-44cf1a2be54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:04:59.804937 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e84150-ad77-414b-9611-44cf1a2be54c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:04:59.805204 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e84150-ad77-414b-9611-44cf1a2be54c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:04:59.805653 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e84150-ad77-414b-9611-44cf1a2be54c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:04:59.806410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e84150-ad77-414b-9611-44cf1a2be54c None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.domain.id=default, user.id=f51a1b11f75b400fabaa9dacc41da029) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:04:59.806712 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e84150-ad77-414b-9611-44cf1a2be54c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:04:59.808225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e84150-ad77-414b-9611-44cf1a2be54c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:04:59.816451 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 11/21] 10.222.0.15 () {56 vars in 1322 bytes} [Tue Aug 9 11:04:59 2022] GET /identity/v3/role_assignments?user.id=f51a1b11f75b400fabaa9dacc41da029&scope.domain.id=default&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 233 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:02.216196 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedb23f-c5c4-4650-ab96-4fc8d1784c69 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:02.217801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedb23f-c5c4-4650-ab96-4fc8d1784c69 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:02.218581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedb23f-c5c4-4650-ab96-4fc8d1784c69 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:02.221324 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 11/22] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:02.230199 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f720c7-b180-459d-aa11-887109b50494 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:02.231589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f720c7-b180-459d-aa11-887109b50494 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:02.232326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f720c7-b180-459d-aa11-887109b50494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:02.273501 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-23f720c7-b180-459d-aa11-887109b50494 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:02.275980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-23f720c7-b180-459d-aa11-887109b50494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:02.430120 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 12/23] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:02.432599 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd9af2-a9b1-4ada-a0c2-8441f329238e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:02.433132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd9af2-a9b1-4ada-a0c2-8441f329238e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:02.433608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd9af2-a9b1-4ada-a0c2-8441f329238e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:02.435387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:02.441848 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a7d95-9868-486e-899f-2cb017cc146f None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:02.442322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a7d95-9868-486e-899f-2cb017cc146f None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:02.442755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a7d95-9868-486e-899f-2cb017cc146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:02.480042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-0e1a7d95-9868-486e-899f-2cb017cc146f None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:02.484972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0e1a7d95-9868-486e-899f-2cb017cc146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:02.523509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd9af2-a9b1-4ada-a0c2-8441f329238e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:02.711886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 13/25] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:02.714028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fe126-7e8b-4ffe-8142-b83bbd7e846b None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:02.714482 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fe126-7e8b-4ffe-8142-b83bbd7e846b None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:02.715160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fe126-7e8b-4ffe-8142-b83bbd7e846b None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:02.717746 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 14/26] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:02.719042 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd9af2-a9b1-4ada-a0c2-8441f329238e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:02.731950 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba00a7-c1c2-4e32-8c31-09a573d695bb None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:02.732785 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba00a7-c1c2-4e32-8c31-09a573d695bb None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:02.733469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba00a7-c1c2-4e32-8c31-09a573d695bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:02.753982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:02.759405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:02.783654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7771991-b3cf-426d-b9c6-7707f6b15119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:02.786282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-f8ba00a7-c1c2-4e32-8c31-09a573d695bb None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:02.786489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7771991-b3cf-426d-b9c6-7707f6b15119 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:02.787157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7771991-b3cf-426d-b9c6-7707f6b15119 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:02.787876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7771991-b3cf-426d-b9c6-7707f6b15119 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:02.788380 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f8ba00a7-c1c2-4e32-8c31-09a573d695bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:02.789353 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7771991-b3cf-426d-b9c6-7707f6b15119 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:02.792044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7771991-b3cf-426d-b9c6-7707f6b15119 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:02.973647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 15/27] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:02.973647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba00a7-c1c2-4e32-8c31-09a573d695bb None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:03.015723 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 13/28] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Aug 9 11:05:02 2022] POST /identity/v3/roles => generated 219 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:05:03.017057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7808ce-e28c-4719-8a52-6a87085b4623 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:03.017345 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7808ce-e28c-4719-8a52-6a87085b4623 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:03.017650 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7808ce-e28c-4719-8a52-6a87085b4623 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:03.023234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 14/29] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:03.024338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7808ce-e28c-4719-8a52-6a87085b4623 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:03.180861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba00a7-c1c2-4e32-8c31-09a573d695bb None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:03.210949 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7808ce-e28c-4719-8a52-6a87085b4623 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:03.225117 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee5e51-369c-4ff1-b593-d3e518e70f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:03.225810 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee5e51-369c-4ff1-b593-d3e518e70f3f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:03.226086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee5e51-369c-4ff1-b593-d3e518e70f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:03.226356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee5e51-369c-4ff1-b593-d3e518e70f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:03.228809 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:03.240772 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee5e51-369c-4ff1-b593-d3e518e70f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:03.242430 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee5e51-369c-4ff1-b593-d3e518e70f3f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:03.259523 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce742e-a09a-4cd3-a6d0-3db041c132f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:03.260199 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce742e-a09a-4cd3-a6d0-3db041c132f4 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:03.260422 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce742e-a09a-4cd3-a6d0-3db041c132f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:03.260696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce742e-a09a-4cd3-a6d0-3db041c132f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-6bee5e51-369c-4ff1-b593-d3e518e70f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:05:03.260893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:03.261738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:05:03.262550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:05:03.262550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:05:03.262550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:03.262704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce742e-a09a-4cd3-a6d0-3db041c132f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:03.265646 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce742e-a09a-4cd3-a6d0-3db041c132f4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:03.265933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 16/30] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:03.265933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f35df-022a-42a4-8b2e-835ec7172541 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:03.265933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f35df-022a-42a4-8b2e-835ec7172541 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:03.265933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f35df-022a-42a4-8b2e-835ec7172541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:03.285680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 15/31] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Aug 9 11:05:03 2022] POST /identity/v3/roles => generated 225 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:05:03.286637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce742e-a09a-4cd3-a6d0-3db041c132f4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:03.289899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-b97f35df-022a-42a4-8b2e-835ec7172541 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:03.291174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b97f35df-022a-42a4-8b2e-835ec7172541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:03.332505 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:03.404132 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 17/32] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:03.431922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce742e-a09a-4cd3-a6d0-3db041c132f4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:03.438943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f35df-022a-42a4-8b2e-835ec7172541 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:03.511016 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e4fe7-002c-4efe-9f78-96a7ecde459e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:03.511673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e4fe7-002c-4efe-9f78-96a7ecde459e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:03.511955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e4fe7-002c-4efe-9f78-96a7ecde459e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:03.512227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e4fe7-002c-4efe-9f78-96a7ecde459e None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:03.513381 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e4fe7-002c-4efe-9f78-96a7ecde459e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:03.513381 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e4fe7-002c-4efe-9f78-96a7ecde459e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:03.514607 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e4fe7-002c-4efe-9f78-96a7ecde459e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:03.540152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 16/33] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:03.542761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e4fe7-002c-4efe-9f78-96a7ecde459e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:03.607437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f35df-022a-42a4-8b2e-835ec7172541 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:03.626702 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:03.653348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5400919-7f74-4723-8248-6870c8c15856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:03.654377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5400919-7f74-4723-8248-6870c8c15856 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:03.654940 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5400919-7f74-4723-8248-6870c8c15856 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:03.655445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5400919-7f74-4723-8248-6870c8c15856 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:03.661596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:03.667852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e4fe7-002c-4efe-9f78-96a7ecde459e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:03.673357 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5400919-7f74-4723-8248-6870c8c15856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-a5400919-7f74-4723-8248-6870c8c15856 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:03.678899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:03.679773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:03.680683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:03.680683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:03.680683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:03.680683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:03.680683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:03.680683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:03.680683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:03.680683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:03.680683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:03.680683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:03.680683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:03.680683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:03.688351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 18/34] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:05:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:05:03.689947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5400919-7f74-4723-8248-6870c8c15856 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:03.706608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0dfb5-d598-456e-8000-99c3fcaa12e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:03.707235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0dfb5-d598-456e-8000-99c3fcaa12e6 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:03.707524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0dfb5-d598-456e-8000-99c3fcaa12e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:03.707790 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0dfb5-d598-456e-8000-99c3fcaa12e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:03.708745 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0dfb5-d598-456e-8000-99c3fcaa12e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:03.712728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0dfb5-d598-456e-8000-99c3fcaa12e6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:03.757655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 17/35] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Aug 9 11:05:03 2022] POST /identity/v3/projects => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:05:03.834753 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5400919-7f74-4723-8248-6870c8c15856 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:03.873841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd254b12-e8e3-40a3-9774-57b2e8114379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:03.874464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd254b12-e8e3-40a3-9774-57b2e8114379 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:03.874787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd254b12-e8e3-40a3-9774-57b2e8114379 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:03.875055 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd254b12-e8e3-40a3-9774-57b2e8114379 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:03.875771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd254b12-e8e3-40a3-9774-57b2e8114379 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:03.876073 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd254b12-e8e3-40a3-9774-57b2e8114379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:03.877499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd254b12-e8e3-40a3-9774-57b2e8114379 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:03.887660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 19/36] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:03.894857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0dfb5-d598-456e-8000-99c3fcaa12e6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:04.015409 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e54e1-767e-418b-a5c8-f47fb50f2302 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:04.015866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e54e1-767e-418b-a5c8-f47fb50f2302 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:04.016311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e54e1-767e-418b-a5c8-f47fb50f2302 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:04.018296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 20/37] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:05:04.026056 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa23ce9-fc4b-462b-96b3-d5be29ad41e6 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:04.026464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa23ce9-fc4b-462b-96b3-d5be29ad41e6 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:04.026825 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa23ce9-fc4b-462b-96b3-d5be29ad41e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:04.034906 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0dfb5-d598-456e-8000-99c3fcaa12e6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:04.052196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-eaa23ce9-fc4b-462b-96b3-d5be29ad41e6 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:04.053755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-eaa23ce9-fc4b-462b-96b3-d5be29ad41e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:04.076452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8e594-1301-423b-8a60-0e6a626e0c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:04.077121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8e594-1301-423b-8a60-0e6a626e0c37 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:04.077410 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8e594-1301-423b-8a60-0e6a626e0c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:04.077680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8e594-1301-423b-8a60-0e6a626e0c37 None admin] PATH_INFO: `/v3/users/f51a1b11f75b400fabaa9dacc41da029` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:04.079087 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8e594-1301-423b-8a60-0e6a626e0c37 None admin] RBAC: Authorizing `identity:get_user(user_id=f51a1b11f75b400fabaa9dacc41da029)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:04.080590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8e594-1301-423b-8a60-0e6a626e0c37 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:04.082254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 18/38] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:03 2022] GET /identity/v3/users/f51a1b11f75b400fabaa9dacc41da029 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:04.087505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:04.088266 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8e594-1301-423b-8a60-0e6a626e0c37 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:04.108385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:04.135801 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 21/39] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:04.158283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa23ce9-fc4b-462b-96b3-d5be29ad41e6 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:04.209589 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8e594-1301-423b-8a60-0e6a626e0c37 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:04.245382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5cf6c-da0c-4256-9db0-ce3bae18e43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:04.246078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5cf6c-da0c-4256-9db0-ce3bae18e43a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:04.246360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5cf6c-da0c-4256-9db0-ce3bae18e43a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:04.246631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5cf6c-da0c-4256-9db0-ce3bae18e43a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:04.247777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5cf6c-da0c-4256-9db0-ce3bae18e43a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:04.249248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5cf6c-da0c-4256-9db0-ce3bae18e43a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:04.250915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 19/40] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:05:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:04.257087 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5cf6c-da0c-4256-9db0-ce3bae18e43a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:04.269525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa23ce9-fc4b-462b-96b3-d5be29ad41e6 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:04.305926 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9106cb-e87e-464e-8dc8-980f01f3b7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:04.306544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9106cb-e87e-464e-8dc8-980f01f3b7f6 None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:04.306817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9106cb-e87e-464e-8dc8-980f01f3b7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:04.307083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9106cb-e87e-464e-8dc8-980f01f3b7f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:04.307747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9106cb-e87e-464e-8dc8-980f01f3b7f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:04.309144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9106cb-e87e-464e-8dc8-980f01f3b7f6 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:04.344937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:04.363110 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5cf6c-da0c-4256-9db0-ce3bae18e43a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:04.397249 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7a0ef-296f-442d-a74b-13d420021d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:04.397954 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7a0ef-296f-442d-a74b-13d420021d7a None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:04.398229 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7a0ef-296f-442d-a74b-13d420021d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:04.398505 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7a0ef-296f-442d-a74b-13d420021d7a None admin] PATH_INFO: `/v3/domains/default/users/f51a1b11f75b400fabaa9dacc41da029/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:04.400537 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7a0ef-296f-442d-a74b-13d420021d7a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f51a1b11f75b400fabaa9dacc41da029, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:04.402028 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7a0ef-296f-442d-a74b-13d420021d7a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:04.417977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 20/41] 10.222.0.15 () {58 vars in 1361 bytes} [Tue Aug 9 11:05:04 2022] PUT /identity/v3/domains/default/users/f51a1b11f75b400fabaa9dacc41da029/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:05:04.418947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99eb4ff-cccf-4ae3-a285-307062825acd None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:04.419236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99eb4ff-cccf-4ae3-a285-307062825acd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:04.419506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99eb4ff-cccf-4ae3-a285-307062825acd None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:04.420974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 21/42] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:04.426648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8858fa-61af-40e1-9955-7ac6abf113f0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:04.426975 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8858fa-61af-40e1-9955-7ac6abf113f0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:04.427201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8858fa-61af-40e1-9955-7ac6abf113f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:04.429173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 22/43] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Aug 9 11:05:04 2022] POST /identity/v3/roles => generated 223 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:05:04.449533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ca8858fa-61af-40e1-9955-7ac6abf113f0 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:04.451333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ca8858fa-61af-40e1-9955-7ac6abf113f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:04.662502 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 22/44] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:04.685591 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9106cb-e87e-464e-8dc8-980f01f3b7f6 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:04.715830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:04.790366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9106cb-e87e-464e-8dc8-980f01f3b7f6 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:04.828757 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca695e1a-e900-4bc4-bb6a-643e94adaa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:04.829402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca695e1a-e900-4bc4-bb6a-643e94adaa2c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:04.829725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca695e1a-e900-4bc4-bb6a-643e94adaa2c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:04.830001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca695e1a-e900-4bc4-bb6a-643e94adaa2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:04.831339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca695e1a-e900-4bc4-bb6a-643e94adaa2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:04.833025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca695e1a-e900-4bc4-bb6a-643e94adaa2c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:04.834824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 23/45] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:05:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:04.842105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8858fa-61af-40e1-9955-7ac6abf113f0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:04.923557 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:04.951342 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8858fa-61af-40e1-9955-7ac6abf113f0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:04.983881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895c7ac-c454-44a0-ab72-fddecbafdd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:04.984494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895c7ac-c454-44a0-ab72-fddecbafdd8a None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:04.984773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895c7ac-c454-44a0-ab72-fddecbafdd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:04.985073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895c7ac-c454-44a0-ab72-fddecbafdd8a None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:04.985741 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895c7ac-c454-44a0-ab72-fddecbafdd8a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:04.987200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895c7ac-c454-44a0-ab72-fddecbafdd8a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:05.015759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 23/46] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Aug 9 11:05:04 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:05:06.427740 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4767622-22cc-4e97-86a1-5943bca09f45 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:06.428300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4767622-22cc-4e97-86a1-5943bca09f45 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:06.428300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4767622-22cc-4e97-86a1-5943bca09f45 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:06.429747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 24/47] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:06.435337 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e008b-3be2-4df7-9b36-970da888bd58 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:06.435779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e008b-3be2-4df7-9b36-970da888bd58 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:06.435958 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e008b-3be2-4df7-9b36-970da888bd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:06.455894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e33e008b-3be2-4df7-9b36-970da888bd58 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:06.457133 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e33e008b-3be2-4df7-9b36-970da888bd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:06.532216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:06.555419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4767622-22cc-4e97-86a1-5943bca09f45 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:06.649329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:06.656828 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4767622-22cc-4e97-86a1-5943bca09f45 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:06.691816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e5bd0-b620-43df-830e-951df595207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:06.692377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e5bd0-b620-43df-830e-951df595207d None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:06.692651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e5bd0-b620-43df-830e-951df595207d None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:06.692919 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e5bd0-b620-43df-830e-951df595207d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:06.703309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e5bd0-b620-43df-830e-951df595207d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-498e5bd0-b620-43df-830e-951df595207d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:06.708072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:06.709136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:06.710205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:06.710205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:06.710205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:06.710205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:06.710205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:06.710205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:06.710205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:06.710205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:06.710205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:06.710205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:06.710205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:06.710205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:06.710205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 25/49] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:05:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:06.717096 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e008b-3be2-4df7-9b36-970da888bd58 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:06.772992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:06.816563 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e008b-3be2-4df7-9b36-970da888bd58 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:06.848930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627de15e-9cf1-46ea-b906-e4bea37c3a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:06.849529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627de15e-9cf1-46ea-b906-e4bea37c3a99 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:06.849831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627de15e-9cf1-46ea-b906-e4bea37c3a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:06.850100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627de15e-9cf1-46ea-b906-e4bea37c3a99 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:06.850754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627de15e-9cf1-46ea-b906-e4bea37c3a99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:06.851048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627de15e-9cf1-46ea-b906-e4bea37c3a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:06.852507 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627de15e-9cf1-46ea-b906-e4bea37c3a99 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:06.864400 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 25/50] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:06.870338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e5bd0-b620-43df-830e-951df595207d None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:06.975671 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e5bd0-b620-43df-830e-951df595207d None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:07.001803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae334ac-e36c-438d-9483-df1fc8859758 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:07.002089 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae334ac-e36c-438d-9483-df1fc8859758 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:07.002337 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae334ac-e36c-438d-9483-df1fc8859758 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:07.003697 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 26/51] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:05:07.009090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb87ca-69eb-42d0-a987-8802ebc3331e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:07.009372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb87ca-69eb-42d0-a987-8802ebc3331e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:07.009682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb87ca-69eb-42d0-a987-8802ebc3331e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:07.013295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c763cc-15a1-4582-8f30-7acfe0d30b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:07.013972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c763cc-15a1-4582-8f30-7acfe0d30b85 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:07.014225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c763cc-15a1-4582-8f30-7acfe0d30b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:07.014511 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c763cc-15a1-4582-8f30-7acfe0d30b85 None admin] PATH_INFO: `/v3/users/f51a1b11f75b400fabaa9dacc41da029` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:07.015743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c763cc-15a1-4582-8f30-7acfe0d30b85 None admin] RBAC: Authorizing `identity:get_user(user_id=f51a1b11f75b400fabaa9dacc41da029)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:07.017192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c763cc-15a1-4582-8f30-7acfe0d30b85 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:07.018925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 26/52] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:06 2022] GET /identity/v3/users/f51a1b11f75b400fabaa9dacc41da029 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:07.024122 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c763cc-15a1-4582-8f30-7acfe0d30b85 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:07.027623 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cebb87ca-69eb-42d0-a987-8802ebc3331e None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:07.028827 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cebb87ca-69eb-42d0-a987-8802ebc3331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:07.048758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:07.095157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 27/53] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:07.118004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb87ca-69eb-42d0-a987-8802ebc3331e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:07.123741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c763cc-15a1-4582-8f30-7acfe0d30b85 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:07.160886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa96dce-fb1a-423b-b341-d203b21c7983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:07.162003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa96dce-fb1a-423b-b341-d203b21c7983 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:07.162336 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa96dce-fb1a-423b-b341-d203b21c7983 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:07.162853 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa96dce-fb1a-423b-b341-d203b21c7983 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:07.164590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa96dce-fb1a-423b-b341-d203b21c7983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:07.166352 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa96dce-fb1a-423b-b341-d203b21c7983 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:07.168186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 27/54] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:05:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:07.170224 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:07.175091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa96dce-fb1a-423b-b341-d203b21c7983 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:07.221194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb87ca-69eb-42d0-a987-8802ebc3331e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:07.255051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54077b58-5cab-402a-9b96-e1c3d5d5ca3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:07.255934 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54077b58-5cab-402a-9b96-e1c3d5d5ca3b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:07.256234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54077b58-5cab-402a-9b96-e1c3d5d5ca3b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:07.256506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54077b58-5cab-402a-9b96-e1c3d5d5ca3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:07.257651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54077b58-5cab-402a-9b96-e1c3d5d5ca3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:07.259127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54077b58-5cab-402a-9b96-e1c3d5d5ca3b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:07.260683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 28/55] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:05:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:07.265018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:07.266341 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54077b58-5cab-402a-9b96-e1c3d5d5ca3b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:07.274297 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa96dce-fb1a-423b-b341-d203b21c7983 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:07.307000 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f735a-c31b-45e0-a626-61af5ec52016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:07.307601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f735a-c31b-45e0-a626-61af5ec52016 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:07.307887 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f735a-c31b-45e0-a626-61af5ec52016 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:07.308137 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f735a-c31b-45e0-a626-61af5ec52016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:07.308852 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f735a-c31b-45e0-a626-61af5ec52016 None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.domain.id=default, user.id=f51a1b11f75b400fabaa9dacc41da029) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:07.309151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f735a-c31b-45e0-a626-61af5ec52016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:07.310627 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f735a-c31b-45e0-a626-61af5ec52016 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:07.316335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 28/56] 10.222.0.15 () {56 vars in 1322 bytes} [Tue Aug 9 11:05:07 2022] GET /identity/v3/role_assignments?user.id=f51a1b11f75b400fabaa9dacc41da029&scope.domain.id=default&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:07.372035 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54077b58-5cab-402a-9b96-e1c3d5d5ca3b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:07.391170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:07.410574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf8a76-8795-4518-bac2-35872c5b4d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:07.411206 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf8a76-8795-4518-bac2-35872c5b4d4f None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:07.411487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf8a76-8795-4518-bac2-35872c5b4d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:07.411757 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf8a76-8795-4518-bac2-35872c5b4d4f None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:07.412412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf8a76-8795-4518-bac2-35872c5b4d4f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:07.413908 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf8a76-8795-4518-bac2-35872c5b4d4f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:07.443781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 29/57] 10.222.0.15 () {60 vars in 1140 bytes} [Tue Aug 9 11:05:07 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:05:09.453206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722007e7-7173-4b94-8274-53287c52ad45 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:09.454103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722007e7-7173-4b94-8274-53287c52ad45 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:09.454103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722007e7-7173-4b94-8274-53287c52ad45 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:09.456220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 29/58] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:09.461903 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d37b4-fc9c-40f2-9b78-658fb31a36ab None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:09.462309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d37b4-fc9c-40f2-9b78-658fb31a36ab None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:09.462419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d37b4-fc9c-40f2-9b78-658fb31a36ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:09.481030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-854d37b4-fc9c-40f2-9b78-658fb31a36ab None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:09.482255 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-854d37b4-fc9c-40f2-9b78-658fb31a36ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:09.553979 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 30/59] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:09.578525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722007e7-7173-4b94-8274-53287c52ad45 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:09.691234 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722007e7-7173-4b94-8274-53287c52ad45 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:09.735918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b7e56-b3c4-4104-aa6e-00c93db5b37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:09.736471 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b7e56-b3c4-4104-aa6e-00c93db5b37c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:09.736745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b7e56-b3c4-4104-aa6e-00c93db5b37c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:09.737015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b7e56-b3c4-4104-aa6e-00c93db5b37c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:09.738177 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b7e56-b3c4-4104-aa6e-00c93db5b37c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:09.739656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b7e56-b3c4-4104-aa6e-00c93db5b37c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:09.741230 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 30/60] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:05:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:09.747158 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d37b4-fc9c-40f2-9b78-658fb31a36ab None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:09.844897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:09.848912 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d37b4-fc9c-40f2-9b78-658fb31a36ab None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:09.886234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4463bf-bc0f-4df5-80c8-8aa6721bee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:09.887121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4463bf-bc0f-4df5-80c8-8aa6721bee47 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:09.887479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4463bf-bc0f-4df5-80c8-8aa6721bee47 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:09.887847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4463bf-bc0f-4df5-80c8-8aa6721bee47 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:09.888802 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4463bf-bc0f-4df5-80c8-8aa6721bee47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:09.891103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4463bf-bc0f-4df5-80c8-8aa6721bee47 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:09.922818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 31/61] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:05:09 2022] POST /identity/v3/users => generated 275 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:05:13.095419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9151d0-7530-4d8f-9bf0-8364186d2ef7 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:13.096843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9151d0-7530-4d8f-9bf0-8364186d2ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:13.097540 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9151d0-7530-4d8f-9bf0-8364186d2ef7 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:13.099899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 31/62] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:13.106726 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a069f9-675c-49a0-826e-beb7a31234f1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:13.108217 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a069f9-675c-49a0-826e-beb7a31234f1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:13.108979 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a069f9-675c-49a0-826e-beb7a31234f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:13.135961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e2a069f9-675c-49a0-826e-beb7a31234f1 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:13.137562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e2a069f9-675c-49a0-826e-beb7a31234f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:13.231343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 32/63] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:13.267467 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9151d0-7530-4d8f-9bf0-8364186d2ef7 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:13.300258 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:13.328157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72562a97-474f-481b-9f6b-92e06dd3a016 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:13.328493 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72562a97-474f-481b-9f6b-92e06dd3a016 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:13.328711 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72562a97-474f-481b-9f6b-92e06dd3a016 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:13.330281 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 33/64] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:05:13.335440 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371dd58-c89f-4096-b81f-eb3909c35682 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:13.335726 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371dd58-c89f-4096-b81f-eb3909c35682 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:13.336003 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371dd58-c89f-4096-b81f-eb3909c35682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:13.361810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4371dd58-c89f-4096-b81f-eb3909c35682 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:13.362937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4371dd58-c89f-4096-b81f-eb3909c35682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:13.426483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9151d0-7530-4d8f-9bf0-8364186d2ef7 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:13.460423 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 34/65] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:13.461823 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384972cd-0a76-440f-875a-1105dc9ea9cb None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:13.462171 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384972cd-0a76-440f-875a-1105dc9ea9cb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:13.462544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384972cd-0a76-440f-875a-1105dc9ea9cb None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:13.463980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 35/66] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:13.468780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684022-60d0-4269-a825-d43d87045db2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:13.469063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684022-60d0-4269-a825-d43d87045db2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:13.469336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e684022-60d0-4269-a825-d43d87045db2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:13.470613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8be80-a825-4677-9510-f9693ade97df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:13.475127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 36/67] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:13.475127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd768f-4e48-4b20-9532-2650135fa2ee None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:13.475127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd768f-4e48-4b20-9532-2650135fa2ee None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:13.475127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd768f-4e48-4b20-9532-2650135fa2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:13.486483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8be80-a825-4677-9510-f9693ade97df None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:13.486836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8be80-a825-4677-9510-f9693ade97df None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:13.487124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8be80-a825-4677-9510-f9693ade97df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:13.492125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-dccd768f-4e48-4b20-9532-2650135fa2ee None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:13.493317 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dccd768f-4e48-4b20-9532-2650135fa2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:13.499127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8be80-a825-4677-9510-f9693ade97df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:13.503652 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-48f8be80-a825-4677-9510-f9693ade97df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:13.503935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:13.504900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:13.511300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:13.511300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:13.511300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:13.511300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:13.511300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:13.511300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:13.511300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:13.511300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:13.511300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:13.511300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:13.511300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:13.511300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:13.511300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 32/68] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:05:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:13.511300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9b9d3-4fce-4649-846e-976d8b9900a5 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:13.512144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9b9d3-4fce-4649-846e-976d8b9900a5 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:13.512144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9b9d3-4fce-4649-846e-976d8b9900a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:13.527370 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-6ed9b9d3-4fce-4649-846e-976d8b9900a5 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:13.528931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6ed9b9d3-4fce-4649-846e-976d8b9900a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:13.574902 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 37/69] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:13.576139 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd768f-4e48-4b20-9532-2650135fa2ee None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:13.614895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 33/70] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:13.616147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9b9d3-4fce-4649-846e-976d8b9900a5 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:13.635299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:13.701137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd768f-4e48-4b20-9532-2650135fa2ee None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:13.724455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9b9d3-4fce-4649-846e-976d8b9900a5 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:13.742003 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e411152-7b87-49cb-88dc-3b78a3a7761d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:13.742780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411152-7b87-49cb-88dc-3b78a3a7761d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:13.743091 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411152-7b87-49cb-88dc-3b78a3a7761d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:13.743397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411152-7b87-49cb-88dc-3b78a3a7761d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:13.756951 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e411152-7b87-49cb-88dc-3b78a3a7761d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:13.762205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7372798-9961-47db-9c04-2d06019e2371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:13.762979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7372798-9961-47db-9c04-2d06019e2371 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:13.763394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7372798-9961-47db-9c04-2d06019e2371 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:13.763827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7372798-9961-47db-9c04-2d06019e2371 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-7e411152-7b87-49cb-88dc-3b78a3a7761d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:13.764574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:13.765559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:13.766579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:13.766579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:13.766579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:13.766579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:13.766579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:13.766579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:13.766579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:13.766579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:13.766579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:13.766579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:13.766579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:13.766579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:13.766579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 38/71] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:05:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:13.767344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e411152-7b87-49cb-88dc-3b78a3a7761d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:13.772361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7372798-9961-47db-9c04-2d06019e2371 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:13.772361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7372798-9961-47db-9c04-2d06019e2371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:13.772361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7372798-9961-47db-9c04-2d06019e2371 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:13.773253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:13.784381 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 34/72] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:13.790542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7372798-9961-47db-9c04-2d06019e2371 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:13.875432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:13.881377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e411152-7b87-49cb-88dc-3b78a3a7761d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:13.899570 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7372798-9961-47db-9c04-2d06019e2371 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:13.916525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34534ae-5d3a-4098-8449-3385a2338e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:13.917153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34534ae-5d3a-4098-8449-3385a2338e4f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:13.917424 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34534ae-5d3a-4098-8449-3385a2338e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:13.917724 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34534ae-5d3a-4098-8449-3385a2338e4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:13.928471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34534ae-5d3a-4098-8449-3385a2338e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:13.932030 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40834fa-46b3-44bd-9e22-f1cf7d55fc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:13.932659 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40834fa-46b3-44bd-9e22-f1cf7d55fc71 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:13.932936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40834fa-46b3-44bd-9e22-f1cf7d55fc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:13.933205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40834fa-46b3-44bd-9e22-f1cf7d55fc71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-b34534ae-5d3a-4098-8449-3385a2338e4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:13.933561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:13.934660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:13.935632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:13.935632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:13.935632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:13.935632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:13.935632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:13.935632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:13.935632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:13.935632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:13.935632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:13.935632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:13.935632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:13.935632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:13.935632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 39/73] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:13.935632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34534ae-5d3a-4098-8449-3385a2338e4f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:13.946317 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40834fa-46b3-44bd-9e22-f1cf7d55fc71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-b40834fa-46b3-44bd-9e22-f1cf7d55fc71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:13.951498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:13.952944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:13.955048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:13.955048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:13.955048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:13.955048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:13.955048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:13.955048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:13.955048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:13.955048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:13.955048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:13.955048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:13.955048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:13.955048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:13.955048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 35/74] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:13.955048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40834fa-46b3-44bd-9e22-f1cf7d55fc71 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:14.000594 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:14.039906 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34534ae-5d3a-4098-8449-3385a2338e4f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:14.053370 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40834fa-46b3-44bd-9e22-f1cf7d55fc71 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:14.075821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20c6ad-0f6c-4275-9552-390e9315c184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:14.076461 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20c6ad-0f6c-4275-9552-390e9315c184 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:14.076706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20c6ad-0f6c-4275-9552-390e9315c184 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:14.077006 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20c6ad-0f6c-4275-9552-390e9315c184 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:14.077655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20c6ad-0f6c-4275-9552-390e9315c184 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:14.077959 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20c6ad-0f6c-4275-9552-390e9315c184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:14.079337 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20c6ad-0f6c-4275-9552-390e9315c184 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:14.087181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 40/75] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:05:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:14.087290 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bf847-6da1-412a-ad1f-8fdf0ccf60ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:14.087925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bf847-6da1-412a-ad1f-8fdf0ccf60ef None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:14.088205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bf847-6da1-412a-ad1f-8fdf0ccf60ef None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:14.088352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bd394-75eb-4582-9d52-5b0918631486 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:14.088495 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bf847-6da1-412a-ad1f-8fdf0ccf60ef None admin] PATH_INFO: `/v3/users/f51a1b11f75b400fabaa9dacc41da029` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:14.088643 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bd394-75eb-4582-9d52-5b0918631486 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:14.089221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bd394-75eb-4582-9d52-5b0918631486 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:14.089643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bf847-6da1-412a-ad1f-8fdf0ccf60ef None admin] RBAC: Authorizing `identity:get_user(user_id=f51a1b11f75b400fabaa9dacc41da029)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:14.090592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 41/76] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:14.091128 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bf847-6da1-412a-ad1f-8fdf0ccf60ef None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:14.092690 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 36/77] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:13 2022] GET /identity/v3/users/f51a1b11f75b400fabaa9dacc41da029 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:14.092690 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bf847-6da1-412a-ad1f-8fdf0ccf60ef None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:14.097936 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bd394-75eb-4582-9d52-5b0918631486 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:14.101052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:14.196099 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bf847-6da1-412a-ad1f-8fdf0ccf60ef None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:14.197514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bd394-75eb-4582-9d52-5b0918631486 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:14.225920 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:14.230209 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b5bd8-9e7a-426c-8ce7-b2c652b00621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:14.230819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b5bd8-9e7a-426c-8ce7-b2c652b00621 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:14.231111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b5bd8-9e7a-426c-8ce7-b2c652b00621 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:14.231379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b5bd8-9e7a-426c-8ce7-b2c652b00621 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:14.232037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b5bd8-9e7a-426c-8ce7-b2c652b00621 None admin] RBAC: Adding query filter params (name=member) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:14.232337 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b5bd8-9e7a-426c-8ce7-b2c652b00621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:14.233759 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b5bd8-9e7a-426c-8ce7-b2c652b00621 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:14.235299 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2a0b4-1468-4591-8a75-0d4847b371c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:14.235908 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2a0b4-1468-4591-8a75-0d4847b371c9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:14.236185 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2a0b4-1468-4591-8a75-0d4847b371c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:14.236456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2a0b4-1468-4591-8a75-0d4847b371c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:14.237114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2a0b4-1468-4591-8a75-0d4847b371c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:14.237413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2a0b4-1468-4591-8a75-0d4847b371c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:14.238821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2a0b4-1468-4591-8a75-0d4847b371c9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:14.242318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 37/78] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:14.247108 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b5bd8-9e7a-426c-8ce7-b2c652b00621 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:14.249303 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 42/79] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:14.250593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19011e02-aa11-42b7-a81e-ef3ca01d2f11 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:14.250857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19011e02-aa11-42b7-a81e-ef3ca01d2f11 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:14.251128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19011e02-aa11-42b7-a81e-ef3ca01d2f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:14.269140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-19011e02-aa11-42b7-a81e-ef3ca01d2f11 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:14.270386 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-19011e02-aa11-42b7-a81e-ef3ca01d2f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:14.310478 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:14.336041 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 43/80] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:14.336890 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19011e02-aa11-42b7-a81e-ef3ca01d2f11 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:14.348818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b5bd8-9e7a-426c-8ce7-b2c652b00621 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:14.386568 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a42b8-be2c-4641-b341-09c7b5d39e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:14.387233 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a42b8-be2c-4641-b341-09c7b5d39e05 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:14.387533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a42b8-be2c-4641-b341-09c7b5d39e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:14.387786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a42b8-be2c-4641-b341-09c7b5d39e05 None admin] PATH_INFO: `/v3/users/736a7588742742e5ab57503902970713` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:14.402042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a42b8-be2c-4641-b341-09c7b5d39e05 None admin] RBAC: Authorizing `identity:get_user(user_id=736a7588742742e5ab57503902970713)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:14.403493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a42b8-be2c-4641-b341-09c7b5d39e05 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:14.405130 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 38/81] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:14 2022] GET /identity/v3/users/736a7588742742e5ab57503902970713 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:14.405916 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a42b8-be2c-4641-b341-09c7b5d39e05 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:14.442558 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19011e02-aa11-42b7-a81e-ef3ca01d2f11 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:14.460306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:14.483850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c6a71-caf9-4c59-92be-99a419b98524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:14.484785 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c6a71-caf9-4c59-92be-99a419b98524 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:14.485065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c6a71-caf9-4c59-92be-99a419b98524 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:14.485350 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c6a71-caf9-4c59-92be-99a419b98524 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:14.515698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a42b8-be2c-4641-b341-09c7b5d39e05 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:14.541220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:14.552894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916dcc8-373a-4426-b0ab-d123c34db9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:14.553530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916dcc8-373a-4426-b0ab-d123c34db9bf None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:14.553832 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916dcc8-373a-4426-b0ab-d123c34db9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:14.554106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916dcc8-373a-4426-b0ab-d123c34db9bf None admin] PATH_INFO: `/v3/users/736a7588742742e5ab57503902970713` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:14.556312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916dcc8-373a-4426-b0ab-d123c34db9bf None admin] RBAC: Authorizing `identity:get_user(user_id=736a7588742742e5ab57503902970713)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:14.556614 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c6a71-caf9-4c59-92be-99a419b98524 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:14.557823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916dcc8-373a-4426-b0ab-d123c34db9bf None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:14.558137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c6a71-caf9-4c59-92be-99a419b98524 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:14.559394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 39/82] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:14 2022] GET /identity/v3/users/736a7588742742e5ab57503902970713 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:14.560155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916dcc8-373a-4426-b0ab-d123c34db9bf None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:14.658251 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 44/83] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:14.659098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c6a71-caf9-4c59-92be-99a419b98524 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:14.661225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916dcc8-373a-4426-b0ab-d123c34db9bf None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:14.679821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:14.694371 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d659b-6ab8-45f9-a17f-9f091b09c7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:14.695278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d659b-6ab8-45f9-a17f-9f091b09c7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:14.695553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d659b-6ab8-45f9-a17f-9f091b09c7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:14.695815 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d659b-6ab8-45f9-a17f-9f091b09c7a1 None admin] PATH_INFO: `/v3/users/736a7588742742e5ab57503902970713` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:14.696989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d659b-6ab8-45f9-a17f-9f091b09c7a1 None admin] RBAC: Authorizing `identity:get_user(user_id=736a7588742742e5ab57503902970713)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:14.698467 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d659b-6ab8-45f9-a17f-9f091b09c7a1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:14.700060 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 40/84] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:14 2022] GET /identity/v3/users/736a7588742742e5ab57503902970713 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:14.700812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d659b-6ab8-45f9-a17f-9f091b09c7a1 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:14.757577 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:14.774259 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c6a71-caf9-4c59-92be-99a419b98524 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:14.802190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d659b-6ab8-45f9-a17f-9f091b09c7a1 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:14.809647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976bf5a-a8eb-4b01-91b8-1843248d3a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:14.810770 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976bf5a-a8eb-4b01-91b8-1843248d3a8b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:14.811240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976bf5a-a8eb-4b01-91b8-1843248d3a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:14.811739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976bf5a-a8eb-4b01-91b8-1843248d3a8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:14.813940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976bf5a-a8eb-4b01-91b8-1843248d3a8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:14.816302 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976bf5a-a8eb-4b01-91b8-1843248d3a8b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:14.818232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 45/85] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:05:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:14.819052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976bf5a-a8eb-4b01-91b8-1843248d3a8b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:14.837108 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a39858-b61b-4930-a35f-43d8731afca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:14.837778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a39858-b61b-4930-a35f-43d8731afca9 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:14.838052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a39858-b61b-4930-a35f-43d8731afca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:14.838341 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a39858-b61b-4930-a35f-43d8731afca9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:14.905987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a39858-b61b-4930-a35f-43d8731afca9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:14.906835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:14.907484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a39858-b61b-4930-a35f-43d8731afca9 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:14.922901 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976bf5a-a8eb-4b01-91b8-1843248d3a8b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:14.958613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49155be0-22fd-4a98-9ce5-de1b846bd0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:14.959225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155be0-22fd-4a98-9ce5-de1b846bd0ba None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:14.959502 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155be0-22fd-4a98-9ce5-de1b846bd0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:14.959762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155be0-22fd-4a98-9ce5-de1b846bd0ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:14.965905 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:15.008419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 41/86] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:15.009182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a39858-b61b-4930-a35f-43d8731afca9 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:15.027870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49155be0-22fd-4a98-9ce5-de1b846bd0ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:15.029357 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49155be0-22fd-4a98-9ce5-de1b846bd0ba None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:15.107445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a39858-b61b-4930-a35f-43d8731afca9 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:15.112397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:15.128792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 46/87] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:15.129923 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49155be0-22fd-4a98-9ce5-de1b846bd0ba None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:15.145827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfbeb5-6cc2-4054-902c-b13f5331319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:15.146459 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfbeb5-6cc2-4054-902c-b13f5331319c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:15.146731 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfbeb5-6cc2-4054-902c-b13f5331319c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:15.147001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfbeb5-6cc2-4054-902c-b13f5331319c None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:15.148139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfbeb5-6cc2-4054-902c-b13f5331319c None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:15.149605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfbeb5-6cc2-4054-902c-b13f5331319c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:15.156064 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 42/88] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:15 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:15.156064 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfbeb5-6cc2-4054-902c-b13f5331319c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:15.179240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:15.229104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49155be0-22fd-4a98-9ce5-de1b846bd0ba None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:15.251165 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfbeb5-6cc2-4054-902c-b13f5331319c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:15.262871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c3b8a-5acc-4727-a90b-d7202628a3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:15.263422 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c3b8a-5acc-4727-a90b-d7202628a3db None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:15.263695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c3b8a-5acc-4727-a90b-d7202628a3db None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:15.263956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c3b8a-5acc-4727-a90b-d7202628a3db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:15.283837 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0d307-1217-404d-9543-0698fafdb7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:15.284818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0d307-1217-404d-9543-0698fafdb7ed None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:15.285207 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0d307-1217-404d-9543-0698fafdb7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:15.285548 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0d307-1217-404d-9543-0698fafdb7ed None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:15.286648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0d307-1217-404d-9543-0698fafdb7ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:15.289144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0d307-1217-404d-9543-0698fafdb7ed None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:15.317712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:15.321658 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 43/89] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:05:15 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:05:15.331386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0d307-1217-404d-9543-0698fafdb7ed None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:15.333019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c3b8a-5acc-4727-a90b-d7202628a3db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:15.334597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c3b8a-5acc-4727-a90b-d7202628a3db None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:15.436671 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:15.461939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0d307-1217-404d-9543-0698fafdb7ed None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:15.474978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 47/90] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:15.475946 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c3b8a-5acc-4727-a90b-d7202628a3db None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:15.513095 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90db910-3d9f-45d4-a37f-ffba29f2c945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:15.514041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90db910-3d9f-45d4-a37f-ffba29f2c945 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:15.514317 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90db910-3d9f-45d4-a37f-ffba29f2c945 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:15.514568 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90db910-3d9f-45d4-a37f-ffba29f2c945 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:15.515738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90db910-3d9f-45d4-a37f-ffba29f2c945 None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:15.517242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90db910-3d9f-45d4-a37f-ffba29f2c945 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:15.519173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 44/91] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:15 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:15.524728 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90db910-3d9f-45d4-a37f-ffba29f2c945 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:15.593414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:15.613887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c3b8a-5acc-4727-a90b-d7202628a3db None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:15.651820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de5bf1-e4b7-41c7-bdd0-d3baf003fb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:15.652406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de5bf1-e4b7-41c7-bdd0-d3baf003fb1d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:15.652686 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de5bf1-e4b7-41c7-bdd0-d3baf003fb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:15.652960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de5bf1-e4b7-41c7-bdd0-d3baf003fb1d None admin] PATH_INFO: `/v3/projects/b6195679f0884c7d91538622023e8baa` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:15.654113 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de5bf1-e4b7-41c7-bdd0-d3baf003fb1d None admin] RBAC: Authorizing `identity:get_project(project_id=b6195679f0884c7d91538622023e8baa)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:15.655586 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de5bf1-e4b7-41c7-bdd0-d3baf003fb1d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:15.657450 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 48/92] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:15 2022] GET /identity/v3/projects/b6195679f0884c7d91538622023e8baa => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:15.658531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90db910-3d9f-45d4-a37f-ffba29f2c945 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:15.659002 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de5bf1-e4b7-41c7-bdd0-d3baf003fb1d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:15.706830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7482caf-d0d6-4674-9d23-161a0840adbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:15.708003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7482caf-d0d6-4674-9d23-161a0840adbf None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:15.708278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7482caf-d0d6-4674-9d23-161a0840adbf None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:15.708541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7482caf-d0d6-4674-9d23-161a0840adbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:15.709680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7482caf-d0d6-4674-9d23-161a0840adbf None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b, user.id=f51a1b11f75b400fabaa9dacc41da029) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:15.710042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7482caf-d0d6-4674-9d23-161a0840adbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:15.711538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7482caf-d0d6-4674-9d23-161a0840adbf None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:15.720863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 45/93] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:15 2022] GET /identity/v3/role_assignments?user.id=f51a1b11f75b400fabaa9dacc41da029&scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:15.721945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7482caf-d0d6-4674-9d23-161a0840adbf None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:15.760989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:15.814408 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de5bf1-e4b7-41c7-bdd0-d3baf003fb1d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:15.885575 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e26230-5155-4a5a-bfe2-6bbf9edfcf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:15.886534 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e26230-5155-4a5a-bfe2-6bbf9edfcf64 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:15.886962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e26230-5155-4a5a-bfe2-6bbf9edfcf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:15.887375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e26230-5155-4a5a-bfe2-6bbf9edfcf64 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:15.888786 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e26230-5155-4a5a-bfe2-6bbf9edfcf64 None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:15.890663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e26230-5155-4a5a-bfe2-6bbf9edfcf64 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:15.892913 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 49/94] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:15 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:15.894075 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e26230-5155-4a5a-bfe2-6bbf9edfcf64 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:15.931479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:15.989729 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7482caf-d0d6-4674-9d23-161a0840adbf None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:16.062719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c1eb9-e996-4eae-9399-b808ca26a957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:16.062966 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e26230-5155-4a5a-bfe2-6bbf9edfcf64 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:16.063753 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c1eb9-e996-4eae-9399-b808ca26a957 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:16.064167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c1eb9-e996-4eae-9399-b808ca26a957 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:16.064623 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c1eb9-e996-4eae-9399-b808ca26a957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:16.065495 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c1eb9-e996-4eae-9399-b808ca26a957 None admin] RBAC: Adding query filter params (role.id=90f6c18c707742de8521c29b89d64215, scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b, user.id=736a7588742742e5ab57503902970713) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:16.065975 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c1eb9-e996-4eae-9399-b808ca26a957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:16.067600 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c1eb9-e996-4eae-9399-b808ca26a957 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:16.083558 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 46/95] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:15 2022] GET /identity/v3/role_assignments?user.id=736a7588742742e5ab57503902970713&scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b&role.id=90f6c18c707742de8521c29b89d64215 => generated 259 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:16.083558 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c1eb9-e996-4eae-9399-b808ca26a957 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:16.113942 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9207682-1fe5-4579-8e25-aff78b33c674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:16.115979 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9207682-1fe5-4579-8e25-aff78b33c674 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:16.118040 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9207682-1fe5-4579-8e25-aff78b33c674 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:16.118660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9207682-1fe5-4579-8e25-aff78b33c674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:16.120551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9207682-1fe5-4579-8e25-aff78b33c674 None admin] RBAC: Adding query filter params (role.id=186990d6368647b5b0712c4fedf4afd9, scope.project.id=b6195679f0884c7d91538622023e8baa, user.id=736a7588742742e5ab57503902970713) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:16.121657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9207682-1fe5-4579-8e25-aff78b33c674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:16.123831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9207682-1fe5-4579-8e25-aff78b33c674 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:16.141796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 50/96] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:15 2022] GET /identity/v3/role_assignments?user.id=736a7588742742e5ab57503902970713&scope.project.id=b6195679f0884c7d91538622023e8baa&role.id=186990d6368647b5b0712c4fedf4afd9 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:16.216552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:16.238789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c1eb9-e996-4eae-9399-b808ca26a957 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:16.283034 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536a670-ecb3-4b34-862f-e18215c98beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:16.283680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536a670-ecb3-4b34-862f-e18215c98beb None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:16.283960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536a670-ecb3-4b34-862f-e18215c98beb None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:16.284227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536a670-ecb3-4b34-862f-e18215c98beb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:16.284997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536a670-ecb3-4b34-862f-e18215c98beb None admin] RBAC: Adding query filter params (role.id=186990d6368647b5b0712c4fedf4afd9, scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b, user.id=736a7588742742e5ab57503902970713) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:16.285370 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536a670-ecb3-4b34-862f-e18215c98beb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:16.289220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536a670-ecb3-4b34-862f-e18215c98beb None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:16.301940 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 47/97] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:16 2022] GET /identity/v3/role_assignments?user.id=736a7588742742e5ab57503902970713&scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b&role.id=186990d6368647b5b0712c4fedf4afd9 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:18.111147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288741a-2607-4ffe-814b-2493b90f8e14 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:18.112181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288741a-2607-4ffe-814b-2493b90f8e14 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:18.112658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288741a-2607-4ffe-814b-2493b90f8e14 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:18.114234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 51/98] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:18.131725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb13194-a280-42e9-9e2d-a70bc1a6ae14 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:18.132213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb13194-a280-42e9-9e2d-a70bc1a6ae14 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:18.132314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb13194-a280-42e9-9e2d-a70bc1a6ae14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:18.159564 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-2eb13194-a280-42e9-9e2d-a70bc1a6ae14 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:18.160774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2eb13194-a280-42e9-9e2d-a70bc1a6ae14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:18.246897 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 48/99] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:18.288009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288741a-2607-4ffe-814b-2493b90f8e14 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:18.408720 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:18.430868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288741a-2607-4ffe-814b-2493b90f8e14 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:18.454339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56a78a-0fd3-4642-8491-fd8be977edc6 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:18.454759 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56a78a-0fd3-4642-8491-fd8be977edc6 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:18.455126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56a78a-0fd3-4642-8491-fd8be977edc6 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:18.456836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 49/100] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:18.462769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2667665-78e3-42a9-9186-515d6cc33f88 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:18.463185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2667665-78e3-42a9-9186-515d6cc33f88 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:18.463547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2667665-78e3-42a9-9186-515d6cc33f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:18.486395 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68184b-912a-4c97-b5a8-86a5f17aeb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:18.487153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68184b-912a-4c97-b5a8-86a5f17aeb5b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:18.487433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68184b-912a-4c97-b5a8-86a5f17aeb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:18.487702 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68184b-912a-4c97-b5a8-86a5f17aeb5b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:18.491383 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-f2667665-78e3-42a9-9186-515d6cc33f88 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:18.492868 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f2667665-78e3-42a9-9186-515d6cc33f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:18.513592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68184b-912a-4c97-b5a8-86a5f17aeb5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-1b68184b-912a-4c97-b5a8-86a5f17aeb5b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:18.518412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:18.519316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:18.520177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:18.520177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:18.520177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:18.520177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:18.520177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:18.520177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:18.520177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:18.520177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:18.520177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:18.520177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:18.520177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:18.520177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:18.520177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 52/101] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:18.528021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68184b-912a-4c97-b5a8-86a5f17aeb5b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:18.577245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 50/102] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:18.601055 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2667665-78e3-42a9-9186-515d6cc33f88 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:18.604562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:18.708856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2667665-78e3-42a9-9186-515d6cc33f88 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:18.751244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be3b5c-eb81-4872-a4fc-19a681281eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:18.751880 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be3b5c-eb81-4872-a4fc-19a681281eea None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:18.752148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be3b5c-eb81-4872-a4fc-19a681281eea None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:18.752411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be3b5c-eb81-4872-a4fc-19a681281eea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:18.754055 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be3b5c-eb81-4872-a4fc-19a681281eea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:18.755827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be3b5c-eb81-4872-a4fc-19a681281eea None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:18.759450 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 51/103] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:05:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:18.760712 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edcc5d-24ce-41f2-a71c-00d186405de1 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:18.760991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edcc5d-24ce-41f2-a71c-00d186405de1 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:18.761261 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edcc5d-24ce-41f2-a71c-00d186405de1 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:18.762691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 52/104] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:18.771373 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ec95b-ae2d-404e-9105-9b8e8d5ac5f2 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:18.771651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ec95b-ae2d-404e-9105-9b8e8d5ac5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:18.771923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ec95b-ae2d-404e-9105-9b8e8d5ac5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:18.781923 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68184b-912a-4c97-b5a8-86a5f17aeb5b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:18.814869 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-5f6ec95b-ae2d-404e-9105-9b8e8d5ac5f2 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:18.817004 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5f6ec95b-ae2d-404e-9105-9b8e8d5ac5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:18.831208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a750654-0d25-47de-bba6-be07711c3dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:18.831832 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a750654-0d25-47de-bba6-be07711c3dbd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:18.832107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a750654-0d25-47de-bba6-be07711c3dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:18.832430 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a750654-0d25-47de-bba6-be07711c3dbd None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:18.833096 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a750654-0d25-47de-bba6-be07711c3dbd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:18.833437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a750654-0d25-47de-bba6-be07711c3dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:18.834937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a750654-0d25-47de-bba6-be07711c3dbd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:18.856600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 53/105] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:18.857264 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a750654-0d25-47de-bba6-be07711c3dbd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:18.880474 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:18.906259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 53/106] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:18.907233 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ec95b-ae2d-404e-9105-9b8e8d5ac5f2 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:18.909870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:19.015792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a750654-0d25-47de-bba6-be07711c3dbd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:19.060648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8eb6d-5d89-4168-afbd-acc62509beff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:19.061276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8eb6d-5d89-4168-afbd-acc62509beff None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:19.061562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8eb6d-5d89-4168-afbd-acc62509beff None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:19.061852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8eb6d-5d89-4168-afbd-acc62509beff None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:19.062503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8eb6d-5d89-4168-afbd-acc62509beff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:19.063980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8eb6d-5d89-4168-afbd-acc62509beff None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:19.072863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ec95b-ae2d-404e-9105-9b8e8d5ac5f2 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:19.095319 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 54/107] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Aug 9 11:05:18 2022] POST /identity/v3/projects => generated 302 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:05:19.096078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8eb6d-5d89-4168-afbd-acc62509beff None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:19.129671 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb0beb-16c0-46df-884b-7eeaeb837c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:19.131190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb0beb-16c0-46df-884b-7eeaeb837c68 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:19.131675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb0beb-16c0-46df-884b-7eeaeb837c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:19.132136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb0beb-16c0-46df-884b-7eeaeb837c68 None admin] PATH_INFO: `/v3/users/1eaf966e68f54e07a846285270ee121a` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:19.162588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb0beb-16c0-46df-884b-7eeaeb837c68 None admin] RBAC: Authorizing `identity:get_user(user_id=1eaf966e68f54e07a846285270ee121a)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:19.164541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb0beb-16c0-46df-884b-7eeaeb837c68 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:19.167216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 54/108] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:18 2022] GET /identity/v3/users/1eaf966e68f54e07a846285270ee121a => generated 289 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:19.168705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7b06b-52ec-4ad2-944f-9d2e44200520 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:19.169262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7b06b-52ec-4ad2-944f-9d2e44200520 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:19.169733 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7b06b-52ec-4ad2-944f-9d2e44200520 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:19.177647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 55/109] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:19.178331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:19.180549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7b06b-52ec-4ad2-944f-9d2e44200520 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:19.248511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8eb6d-5d89-4168-afbd-acc62509beff None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:19.281100 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:19.284660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e71d92-d5a6-4cdb-81b0-7727a0631a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:19.285433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e71d92-d5a6-4cdb-81b0-7727a0631a00 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:19.285740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e71d92-d5a6-4cdb-81b0-7727a0631a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:19.286013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e71d92-d5a6-4cdb-81b0-7727a0631a00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:19.299919 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e71d92-d5a6-4cdb-81b0-7727a0631a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-71e71d92-d5a6-4cdb-81b0-7727a0631a00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:19.304926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:19.305892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:19.306703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:19.306703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:19.306703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:19.306703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:19.306703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:19.306703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:19.306703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:19.306703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:19.306703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:19.306703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:19.306703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:19.306703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:19.311294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 55/110] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:05:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:19.312189 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12427b13-7389-48b0-b8a8-454032186e07 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:19.312476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12427b13-7389-48b0-b8a8-454032186e07 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:19.312751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12427b13-7389-48b0-b8a8-454032186e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:19.333522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-12427b13-7389-48b0-b8a8-454032186e07 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:19.334792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-12427b13-7389-48b0-b8a8-454032186e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:19.343886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7b06b-52ec-4ad2-944f-9d2e44200520 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:19.381035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d46aa4-f503-4a57-91af-03ebcc17020a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:19.382081 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d46aa4-f503-4a57-91af-03ebcc17020a None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:19.382577 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d46aa4-f503-4a57-91af-03ebcc17020a None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:19.383109 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d46aa4-f503-4a57-91af-03ebcc17020a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:19.405493 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 56/111] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:19.409854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12427b13-7389-48b0-b8a8-454032186e07 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:19.474777 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d46aa4-f503-4a57-91af-03ebcc17020a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:19.476316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d46aa4-f503-4a57-91af-03ebcc17020a None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:19.485558 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:19.531055 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12427b13-7389-48b0-b8a8-454032186e07 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:19.542354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:19.574500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe621d-e081-4351-bfae-a9771c73a1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:19.575526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe621d-e081-4351-bfae-a9771c73a1de None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:19.576026 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe621d-e081-4351-bfae-a9771c73a1de None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:19.576492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe621d-e081-4351-bfae-a9771c73a1de None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:19.577495 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe621d-e081-4351-bfae-a9771c73a1de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:19.578157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe621d-e081-4351-bfae-a9771c73a1de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:19.579809 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe621d-e081-4351-bfae-a9771c73a1de None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:19.588420 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 56/112] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:19.589404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d46aa4-f503-4a57-91af-03ebcc17020a None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:19.595032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 57/113] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:19.597455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe621d-e081-4351-bfae-a9771c73a1de None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:19.708252 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d46aa4-f503-4a57-91af-03ebcc17020a None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:19.745237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe621d-e081-4351-bfae-a9771c73a1de None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:19.749015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37048ea-2a90-43fd-a211-bd59799b7f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:19.749727 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37048ea-2a90-43fd-a211-bd59799b7f05 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:19.749995 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37048ea-2a90-43fd-a211-bd59799b7f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:19.750263 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37048ea-2a90-43fd-a211-bd59799b7f05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:19.761901 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:19.762622 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37048ea-2a90-43fd-a211-bd59799b7f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-f37048ea-2a90-43fd-a211-bd59799b7f05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:19.768092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:19.769023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:19.770389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:19.770389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:19.770389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:19.770389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:19.770389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:19.770389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:19.770389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:19.770389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:19.770389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:19.770389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:19.770389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:19.770389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:19.770389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 57/114] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:19.770389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37048ea-2a90-43fd-a211-bd59799b7f05 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:19.793275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c003766-eec3-4dbb-8d2a-e0d198160b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:19.793887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c003766-eec3-4dbb-8d2a-e0d198160b17 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:19.794169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c003766-eec3-4dbb-8d2a-e0d198160b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:19.794443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c003766-eec3-4dbb-8d2a-e0d198160b17 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:19.795629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c003766-eec3-4dbb-8d2a-e0d198160b17 None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:19.797106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c003766-eec3-4dbb-8d2a-e0d198160b17 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:19.799047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 58/115] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:19 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:19.801336 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:19.803189 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3faf8-7c90-4f12-9a2c-26b296870ad5 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:19.804536 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3faf8-7c90-4f12-9a2c-26b296870ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:19.804821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3faf8-7c90-4f12-9a2c-26b296870ad5 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:19.806852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 59/116] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:19.812364 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428a7f4-c919-4cec-874b-4fd033914244 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:19.812737 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428a7f4-c919-4cec-874b-4fd033914244 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:19.812932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428a7f4-c919-4cec-874b-4fd033914244 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:19.817685 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 60/117] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:19.817685 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428a7f4-c919-4cec-874b-4fd033914244 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:19.893535 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37048ea-2a90-43fd-a211-bd59799b7f05 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:19.927522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0a3f3-6892-4ed9-8b57-84f4b06f6a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:19.928154 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0a3f3-6892-4ed9-8b57-84f4b06f6a04 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:19.928424 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0a3f3-6892-4ed9-8b57-84f4b06f6a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:19.928695 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0a3f3-6892-4ed9-8b57-84f4b06f6a04 None admin] PATH_INFO: `/v3/users/f51a1b11f75b400fabaa9dacc41da029` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:19.930774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0a3f3-6892-4ed9-8b57-84f4b06f6a04 None admin] RBAC: Authorizing `identity:get_user(user_id=f51a1b11f75b400fabaa9dacc41da029)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:19.931378 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0a3f3-6892-4ed9-8b57-84f4b06f6a04 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:19.932372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428a7f4-c919-4cec-874b-4fd033914244 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:19.933153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 58/118] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:19 2022] GET /identity/v3/users/f51a1b11f75b400fabaa9dacc41da029 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:19.933768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0a3f3-6892-4ed9-8b57-84f4b06f6a04 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:19.971147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dc418-93d3-4ec9-8460-4cd13ccc2b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:19.971772 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dc418-93d3-4ec9-8460-4cd13ccc2b29 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:19.972048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dc418-93d3-4ec9-8460-4cd13ccc2b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:19.972318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dc418-93d3-4ec9-8460-4cd13ccc2b29 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:19.972985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dc418-93d3-4ec9-8460-4cd13ccc2b29 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:19.973285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dc418-93d3-4ec9-8460-4cd13ccc2b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:19.974764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dc418-93d3-4ec9-8460-4cd13ccc2b29 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:19.984656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 61/119] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:19.989460 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a6a11-2c70-4165-a935-3a8274085a81 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:19.989460 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a6a11-2c70-4165-a935-3a8274085a81 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:19.989460 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a6a11-2c70-4165-a935-3a8274085a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:20.005858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-539a6a11-2c70-4165-a935-3a8274085a81 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:20.007114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-539a6a11-2c70-4165-a935-3a8274085a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:20.036514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:20.047449 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:20.050245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0a3f3-6892-4ed9-8b57-84f4b06f6a04 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:20.082974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 62/120] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:20.084263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d7744-6b6a-492b-baf4-ee4bcecbdf38 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:20.084545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d7744-6b6a-492b-baf4-ee4bcecbdf38 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:20.084818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d7744-6b6a-492b-baf4-ee4bcecbdf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:20.096983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736492ba-a6ac-4e77-bd76-38ec2c97f170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:20.098159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736492ba-a6ac-4e77-bd76-38ec2c97f170 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:20.098639 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736492ba-a6ac-4e77-bd76-38ec2c97f170 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:20.099145 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736492ba-a6ac-4e77-bd76-38ec2c97f170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:20.100125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736492ba-a6ac-4e77-bd76-38ec2c97f170 None admin] RBAC: Adding query filter params (role.id=cfa1c4251ba64c96bf0ddbeb03d57d77, scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b, user.id=1eaf966e68f54e07a846285270ee121a) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:20.100650 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736492ba-a6ac-4e77-bd76-38ec2c97f170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:20.102710 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736492ba-a6ac-4e77-bd76-38ec2c97f170 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:20.103476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fe6d7744-6b6a-492b-baf4-ee4bcecbdf38 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:20.104678 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fe6d7744-6b6a-492b-baf4-ee4bcecbdf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:20.109967 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 59/121] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:19 2022] GET /identity/v3/role_assignments?user.id=1eaf966e68f54e07a846285270ee121a&scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b&role.id=cfa1c4251ba64c96bf0ddbeb03d57d77 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:20.111050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736492ba-a6ac-4e77-bd76-38ec2c97f170 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:20.212630 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 63/122] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:20.213520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d7744-6b6a-492b-baf4-ee4bcecbdf38 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:20.237399 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736492ba-a6ac-4e77-bd76-38ec2c97f170 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:20.277971 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a090aad-74af-431f-9ff7-e66e5e2810b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:20.279028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a090aad-74af-431f-9ff7-e66e5e2810b8 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:20.279544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a090aad-74af-431f-9ff7-e66e5e2810b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:20.280070 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a090aad-74af-431f-9ff7-e66e5e2810b8 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:20.281609 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a090aad-74af-431f-9ff7-e66e5e2810b8 None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:20.283392 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a090aad-74af-431f-9ff7-e66e5e2810b8 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:20.285744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 60/123] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:20 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:20.286840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a090aad-74af-431f-9ff7-e66e5e2810b8 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:20.316007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:20.350995 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d7744-6b6a-492b-baf4-ee4bcecbdf38 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:20.353805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:20.399129 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c1ec2-568e-43dd-b704-d2713029b27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:20.399488 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a090aad-74af-431f-9ff7-e66e5e2810b8 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:20.400464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c1ec2-568e-43dd-b704-d2713029b27a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:20.401213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c1ec2-568e-43dd-b704-d2713029b27a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:20.402599 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c1ec2-568e-43dd-b704-d2713029b27a None admin] PATH_INFO: `/v3/users/736a7588742742e5ab57503902970713` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:20.404109 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c1ec2-568e-43dd-b704-d2713029b27a None admin] RBAC: Authorizing `identity:get_user(user_id=736a7588742742e5ab57503902970713)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:20.405886 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c1ec2-568e-43dd-b704-d2713029b27a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:20.408593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 64/124] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:20 2022] GET /identity/v3/users/736a7588742742e5ab57503902970713 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:20.410126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c1ec2-568e-43dd-b704-d2713029b27a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:20.442702 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bd405-c7a7-42f1-8a37-f0163f1b38d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:20.443351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bd405-c7a7-42f1-8a37-f0163f1b38d9 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:20.443623 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bd405-c7a7-42f1-8a37-f0163f1b38d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:20.443892 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bd405-c7a7-42f1-8a37-f0163f1b38d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:20.458911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3bd405-c7a7-42f1-8a37-f0163f1b38d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-ba3bd405-c7a7-42f1-8a37-f0163f1b38d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:20.464863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:20.465755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:20.466538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:20.466538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:20.466538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:20.466538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:20.466538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:20.466538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:20.466538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:20.466538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:20.466538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:20.466538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:20.466538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:20.466538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:20.466538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 61/125] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:05:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:20.467173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bd405-c7a7-42f1-8a37-f0163f1b38d9 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:20.539315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c1ec2-568e-43dd-b704-d2713029b27a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:20.567243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:20.575802 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba24de0-c091-426d-9603-fcb1c985d1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:20.576698 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba24de0-c091-426d-9603-fcb1c985d1fc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:20.577117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba24de0-c091-426d-9603-fcb1c985d1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:20.577572 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba24de0-c091-426d-9603-fcb1c985d1fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:20.584474 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3bd405-c7a7-42f1-8a37-f0163f1b38d9 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:20.589947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba24de0-c091-426d-9603-fcb1c985d1fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-3ba24de0-c091-426d-9603-fcb1c985d1fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:20.594955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:20.596052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:20.597021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:20.597021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:20.597021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:20.597021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:20.597021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:20.597021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:20.597021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:20.597021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:20.597021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:20.597021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:20.597021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:20.597021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:20.599037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 65/126] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:20.600039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba24de0-c091-426d-9603-fcb1c985d1fc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:20.625655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdb4dd-0393-41a8-aeb9-d2a2d6e0ef9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:20.626491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdb4dd-0393-41a8-aeb9-d2a2d6e0ef9c None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:20.626952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdb4dd-0393-41a8-aeb9-d2a2d6e0ef9c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:20.627320 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdb4dd-0393-41a8-aeb9-d2a2d6e0ef9c None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b/users/f51a1b11f75b400fabaa9dacc41da029/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:20.629459 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdb4dd-0393-41a8-aeb9-d2a2d6e0ef9c None admin] RBAC: Authorizing `identity:create_grant(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b, user_id=f51a1b11f75b400fabaa9dacc41da029, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:20.631613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdb4dd-0393-41a8-aeb9-d2a2d6e0ef9c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:20.633935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:20.647901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 62/127] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:05:20 2022] PUT /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b/users/f51a1b11f75b400fabaa9dacc41da029/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:05:20.648924 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdb4dd-0393-41a8-aeb9-d2a2d6e0ef9c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:20.767544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdb4dd-0393-41a8-aeb9-d2a2d6e0ef9c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:20.805787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cb329-f5f5-4abf-a3c0-448305d8f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:20.806664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cb329-f5f5-4abf-a3c0-448305d8f1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:20.807007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cb329-f5f5-4abf-a3c0-448305d8f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:20.807342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044cb329-f5f5-4abf-a3c0-448305d8f1a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:20.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cb329-f5f5-4abf-a3c0-448305d8f1a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:20.808460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cb329-f5f5-4abf-a3c0-448305d8f1a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:20.808787 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba24de0-c091-426d-9603-fcb1c985d1fc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:20.810177 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044cb329-f5f5-4abf-a3c0-448305d8f1a3 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:20.819366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 63/128] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:05:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:20.820325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cb329-f5f5-4abf-a3c0-448305d8f1a3 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:20.823389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:20.857533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d44c4-b083-4f46-b8ad-77621aa4d4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:20.859615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d44c4-b083-4f46-b8ad-77621aa4d4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:20.859615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d44c4-b083-4f46-b8ad-77621aa4d4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:20.859867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d44c4-b083-4f46-b8ad-77621aa4d4a4 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:20.861782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d44c4-b083-4f46-b8ad-77621aa4d4a4 None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:20.863330 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d44c4-b083-4f46-b8ad-77621aa4d4a4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:20.865843 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 66/129] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:20 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:20.870734 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d44c4-b083-4f46-b8ad-77621aa4d4a4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:20.934069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044cb329-f5f5-4abf-a3c0-448305d8f1a3 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:20.970687 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0ae5c-9af8-4670-a064-3a425222f59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:20.971679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0ae5c-9af8-4670-a064-3a425222f59e None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:20.972103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0ae5c-9af8-4670-a064-3a425222f59e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:20.972512 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0ae5c-9af8-4670-a064-3a425222f59e None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:20.973312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0ae5c-9af8-4670-a064-3a425222f59e None admin] RBAC: Adding query filter params (name=member) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:20.973789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0ae5c-9af8-4670-a064-3a425222f59e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:20.975392 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0ae5c-9af8-4670-a064-3a425222f59e None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:20.984521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 64/130] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:20.985746 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0ae5c-9af8-4670-a064-3a425222f59e None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:20.999208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:21.012142 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d44c4-b083-4f46-b8ad-77621aa4d4a4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:21.050806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:21.086846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683218a-8243-40e1-ae1a-c8a377aa5757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:21.087739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683218a-8243-40e1-ae1a-c8a377aa5757 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:21.087852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683218a-8243-40e1-ae1a-c8a377aa5757 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:21.088062 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683218a-8243-40e1-ae1a-c8a377aa5757 None admin] PATH_INFO: `/v3/users/736a7588742742e5ab57503902970713` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:21.090370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683218a-8243-40e1-ae1a-c8a377aa5757 None admin] RBAC: Authorizing `identity:get_user(user_id=736a7588742742e5ab57503902970713)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:21.091834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683218a-8243-40e1-ae1a-c8a377aa5757 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:21.093679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 67/131] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:20 2022] GET /identity/v3/users/736a7588742742e5ab57503902970713 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:21.094256 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683218a-8243-40e1-ae1a-c8a377aa5757 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:21.094978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0ae5c-9af8-4670-a064-3a425222f59e None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:21.130709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4efe5e-493b-4683-b220-d248561f26aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:21.131671 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4efe5e-493b-4683-b220-d248561f26aa None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:21.132139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4efe5e-493b-4683-b220-d248561f26aa None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:21.132546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4efe5e-493b-4683-b220-d248561f26aa None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b/users/736a7588742742e5ab57503902970713/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:21.134650 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4efe5e-493b-4683-b220-d248561f26aa None admin] RBAC: Authorizing `identity:create_grant(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b, user_id=736a7588742742e5ab57503902970713, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:21.136339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4efe5e-493b-4683-b220-d248561f26aa None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:21.158901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 65/132] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:05:20 2022] PUT /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b/users/736a7588742742e5ab57503902970713/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:05:21.160024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4efe5e-493b-4683-b220-d248561f26aa None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:21.336432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683218a-8243-40e1-ae1a-c8a377aa5757 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:21.444798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4efe5e-493b-4683-b220-d248561f26aa None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:21.449419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d417f-5674-4ca1-9a87-8e7de0145baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:21.451671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d417f-5674-4ca1-9a87-8e7de0145baf None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:21.452058 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d417f-5674-4ca1-9a87-8e7de0145baf None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:21.454285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d417f-5674-4ca1-9a87-8e7de0145baf None admin] PATH_INFO: `/v3/users/736a7588742742e5ab57503902970713` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:21.460816 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d417f-5674-4ca1-9a87-8e7de0145baf None admin] RBAC: Authorizing `identity:get_user(user_id=736a7588742742e5ab57503902970713)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:21.462549 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d417f-5674-4ca1-9a87-8e7de0145baf None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:21.464471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 68/133] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:21 2022] GET /identity/v3/users/736a7588742742e5ab57503902970713 => generated 275 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:21.470568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d417f-5674-4ca1-9a87-8e7de0145baf None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:21.521271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:21.543470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:21.566463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b50fa-66ed-448e-8a03-4a31d96ae755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:21.567022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b50fa-66ed-448e-8a03-4a31d96ae755 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:21.567297 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b50fa-66ed-448e-8a03-4a31d96ae755 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:21.567570 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b50fa-66ed-448e-8a03-4a31d96ae755 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:21.574403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b50fa-66ed-448e-8a03-4a31d96ae755 None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:21.575902 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b50fa-66ed-448e-8a03-4a31d96ae755 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:21.577628 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 66/134] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:21 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:21.586638 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b50fa-66ed-448e-8a03-4a31d96ae755 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:21.757993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d417f-5674-4ca1-9a87-8e7de0145baf None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:21.815749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b50fa-66ed-448e-8a03-4a31d96ae755 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:21.846129 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafa0f8-5fea-42d4-b5ea-41add6907019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:21.846779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafa0f8-5fea-42d4-b5ea-41add6907019 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:21.847055 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafa0f8-5fea-42d4-b5ea-41add6907019 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:21.847326 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafa0f8-5fea-42d4-b5ea-41add6907019 None admin] PATH_INFO: `/v3/projects/b6195679f0884c7d91538622023e8baa` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:21.851992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafa0f8-5fea-42d4-b5ea-41add6907019 None admin] RBAC: Authorizing `identity:get_project(project_id=b6195679f0884c7d91538622023e8baa)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:21.856609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafa0f8-5fea-42d4-b5ea-41add6907019 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:21.868397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 69/135] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:21 2022] GET /identity/v3/projects/b6195679f0884c7d91538622023e8baa => generated 312 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:21.869915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d70b0-f217-4ee9-aa09-e9bd82af25ce None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:21.870199 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d70b0-f217-4ee9-aa09-e9bd82af25ce None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:21.870475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d70b0-f217-4ee9-aa09-e9bd82af25ce None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:21.871801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 70/136] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:21.872470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d70b0-f217-4ee9-aa09-e9bd82af25ce None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:21.934299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cecd1-ef45-42e9-b812-6ac4f954727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:21.934983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cecd1-ef45-42e9-b812-6ac4f954727f None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:21.935261 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cecd1-ef45-42e9-b812-6ac4f954727f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:21.935531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cecd1-ef45-42e9-b812-6ac4f954727f None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b/users/736a7588742742e5ab57503902970713/roles/90f6c18c707742de8521c29b89d64215` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:21.939212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cecd1-ef45-42e9-b812-6ac4f954727f None admin] RBAC: Authorizing `identity:create_grant(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b, user_id=736a7588742742e5ab57503902970713, role_id=90f6c18c707742de8521c29b89d64215)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:21.940698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cecd1-ef45-42e9-b812-6ac4f954727f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:21.972889 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 67/137] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:05:21 2022] PUT /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b/users/736a7588742742e5ab57503902970713/roles/90f6c18c707742de8521c29b89d64215 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:05:21.974238 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad794a-0b7a-49fa-a921-3479c668366d None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:21.974525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad794a-0b7a-49fa-a921-3479c668366d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:21.974801 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad794a-0b7a-49fa-a921-3479c668366d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:22.018380 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-88ad794a-0b7a-49fa-a921-3479c668366d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:22.019581 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-88ad794a-0b7a-49fa-a921-3479c668366d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:22.095287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d70b0-f217-4ee9-aa09-e9bd82af25ce None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:22.097398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:22.166227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:22.182863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ffd76-abab-4182-b032-1aaf5b114a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:22.183578 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ffd76-abab-4182-b032-1aaf5b114a4c None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:22.183859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ffd76-abab-4182-b032-1aaf5b114a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:22.184136 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ffd76-abab-4182-b032-1aaf5b114a4c None admin] PATH_INFO: `/v3/projects/b6195679f0884c7d91538622023e8baa/users/736a7588742742e5ab57503902970713/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:22.187465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ffd76-abab-4182-b032-1aaf5b114a4c None admin] RBAC: Authorizing `identity:create_grant(project_id=b6195679f0884c7d91538622023e8baa, user_id=736a7588742742e5ab57503902970713, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:22.193684 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ffd76-abab-4182-b032-1aaf5b114a4c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:22.228336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 71/138] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:05:21 2022] PUT /identity/v3/projects/b6195679f0884c7d91538622023e8baa/users/736a7588742742e5ab57503902970713/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:05:22.233539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 68/139] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:22.267090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ffd76-abab-4182-b032-1aaf5b114a4c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:22.410069 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ffd76-abab-4182-b032-1aaf5b114a4c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:22.457058 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62f729-33b7-4845-9ac0-3614df33dbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:22.457760 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62f729-33b7-4845-9ac0-3614df33dbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:22.458042 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62f729-33b7-4845-9ac0-3614df33dbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:22.458318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62f729-33b7-4845-9ac0-3614df33dbf3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:22.462745 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62f729-33b7-4845-9ac0-3614df33dbf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:22.464268 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62f729-33b7-4845-9ac0-3614df33dbf3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:22.466055 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 72/140] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:05:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:22.471953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad794a-0b7a-49fa-a921-3479c668366d None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:22.611325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad794a-0b7a-49fa-a921-3479c668366d None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:22.658704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba2858-7e07-4b8d-b6b2-fa257937fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:22.659323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba2858-7e07-4b8d-b6b2-fa257937fc72 None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:22.659598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba2858-7e07-4b8d-b6b2-fa257937fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:22.659903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba2858-7e07-4b8d-b6b2-fa257937fc72 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:22.660571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba2858-7e07-4b8d-b6b2-fa257937fc72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:22.662023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba2858-7e07-4b8d-b6b2-fa257937fc72 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:22.692083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f40721-8eb8-4ffa-a394-ec1e4f74d127 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:22.692385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f40721-8eb8-4ffa-a394-ec1e4f74d127 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:22.692636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f40721-8eb8-4ffa-a394-ec1e4f74d127 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:22.694076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 73/141] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:22.702383 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 69/142] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:05:22 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:05:22.715301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41a66f-68af-44bc-9558-1e77aca7063d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:22.715608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41a66f-68af-44bc-9558-1e77aca7063d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:22.715896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41a66f-68af-44bc-9558-1e77aca7063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:22.737825 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-dc41a66f-68af-44bc-9558-1e77aca7063d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:22.739032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dc41a66f-68af-44bc-9558-1e77aca7063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:22.765936 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:22.814007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 74/143] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:22.836461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba2858-7e07-4b8d-b6b2-fa257937fc72 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:22.894387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:22.980405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba2858-7e07-4b8d-b6b2-fa257937fc72 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:23.017671 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76990f4-aecc-44c7-a575-a74423bd0801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:23.018307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76990f4-aecc-44c7-a575-a74423bd0801 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:23.018578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76990f4-aecc-44c7-a575-a74423bd0801 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:23.018842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76990f4-aecc-44c7-a575-a74423bd0801 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:23.034264 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76990f4-aecc-44c7-a575-a74423bd0801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-e76990f4-aecc-44c7-a575-a74423bd0801 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:23.039601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:23.040604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:23.042407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:23.042407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:23.042407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:23.042407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:23.042407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:23.042407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:23.042407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:23.042407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:23.042407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:23.042407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:23.042407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:23.042407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:23.042407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 70/144] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:23.046778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41a66f-68af-44bc-9558-1e77aca7063d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:23.166177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41a66f-68af-44bc-9558-1e77aca7063d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:23.203097 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c77be-1443-4a7d-bc4b-88ccc950cf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:23.203716 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c77be-1443-4a7d-bc4b-88ccc950cf26 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:23.203993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c77be-1443-4a7d-bc4b-88ccc950cf26 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:23.204261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c77be-1443-4a7d-bc4b-88ccc950cf26 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:23.204922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c77be-1443-4a7d-bc4b-88ccc950cf26 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:23.205221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c77be-1443-4a7d-bc4b-88ccc950cf26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:23.206629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c77be-1443-4a7d-bc4b-88ccc950cf26 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:23.215411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 75/145] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:23.221321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76990f4-aecc-44c7-a575-a74423bd0801 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:23.354441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:23.359830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76990f4-aecc-44c7-a575-a74423bd0801 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:23.389644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062645fe-ea38-476c-a2ff-b0d3aeb43474 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:23.389644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062645fe-ea38-476c-a2ff-b0d3aeb43474 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:23.389644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062645fe-ea38-476c-a2ff-b0d3aeb43474 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:23.390350 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 76/146] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:05:23.397690 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76a4fe-53a8-4c3b-ab7b-ec0f60d5b4fb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:23.398095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76a4fe-53a8-4c3b-ab7b-ec0f60d5b4fb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:23.398461 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76a4fe-53a8-4c3b-ab7b-ec0f60d5b4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:23.401136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13857067-1ad4-4412-abdd-f0dc073d9bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:23.401853 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13857067-1ad4-4412-abdd-f0dc073d9bfd None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:23.402187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13857067-1ad4-4412-abdd-f0dc073d9bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:23.402500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13857067-1ad4-4412-abdd-f0dc073d9bfd None admin] PATH_INFO: `/v3/users/1eaf966e68f54e07a846285270ee121a` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:23.404129 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13857067-1ad4-4412-abdd-f0dc073d9bfd None admin] RBAC: Authorizing `identity:get_user(user_id=1eaf966e68f54e07a846285270ee121a)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:23.405597 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13857067-1ad4-4412-abdd-f0dc073d9bfd None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:23.408301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 71/147] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:23 2022] GET /identity/v3/users/1eaf966e68f54e07a846285270ee121a => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:23.414162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13857067-1ad4-4412-abdd-f0dc073d9bfd None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:23.419132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8e76a4fe-53a8-4c3b-ab7b-ec0f60d5b4fb None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:23.421370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8e76a4fe-53a8-4c3b-ab7b-ec0f60d5b4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:23.466302 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:23.526613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 77/148] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:23.552970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76a4fe-53a8-4c3b-ab7b-ec0f60d5b4fb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:23.561583 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13857067-1ad4-4412-abdd-f0dc073d9bfd None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:23.632711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdc422-1810-42ad-97bf-d580822acfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:23.634783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdc422-1810-42ad-97bf-d580822acfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:23.634986 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdc422-1810-42ad-97bf-d580822acfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:23.635243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdc422-1810-42ad-97bf-d580822acfa0 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:23.636498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdc422-1810-42ad-97bf-d580822acfa0 None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:23.638233 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdc422-1810-42ad-97bf-d580822acfa0 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:23.640530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 72/149] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:23 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:23.650763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdc422-1810-42ad-97bf-d580822acfa0 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:23.679901 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76a4fe-53a8-4c3b-ab7b-ec0f60d5b4fb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:23.698282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:23.747644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9a6f8-720e-4e6c-81da-4202ecb24513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:23.748426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9a6f8-720e-4e6c-81da-4202ecb24513 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:23.748703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9a6f8-720e-4e6c-81da-4202ecb24513 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:23.748968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9a6f8-720e-4e6c-81da-4202ecb24513 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:23.772171 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9a6f8-720e-4e6c-81da-4202ecb24513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-72b9a6f8-720e-4e6c-81da-4202ecb24513 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:23.777098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:23.778033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:23.778811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:23.778811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:23.778811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:23.778811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:23.778811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:23.778811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:23.778811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:23.778811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:23.778811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:23.778811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:23.778811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:23.778811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:23.778811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 78/150] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:05:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:23.799471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9a6f8-720e-4e6c-81da-4202ecb24513 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:23.823164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:23.845749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdc422-1810-42ad-97bf-d580822acfa0 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:23.925673 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de217-4c3a-49f7-a3dc-e2bc67fa1e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:23.926702 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de217-4c3a-49f7-a3dc-e2bc67fa1e34 None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:23.927170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de217-4c3a-49f7-a3dc-e2bc67fa1e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:23.927668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de217-4c3a-49f7-a3dc-e2bc67fa1e34 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b/users/1eaf966e68f54e07a846285270ee121a/roles/cfa1c4251ba64c96bf0ddbeb03d57d77` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:23.931857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5de217-4c3a-49f7-a3dc-e2bc67fa1e34 None admin] RBAC: Authorizing `identity:create_grant(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b, user_id=1eaf966e68f54e07a846285270ee121a, role_id=cfa1c4251ba64c96bf0ddbeb03d57d77)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:23.933359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5de217-4c3a-49f7-a3dc-e2bc67fa1e34 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:23.959311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 73/151] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:05:23 2022] PUT /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b/users/1eaf966e68f54e07a846285270ee121a/roles/cfa1c4251ba64c96bf0ddbeb03d57d77 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:05:23.983663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9a6f8-720e-4e6c-81da-4202ecb24513 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:24.027604 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23413e19-f789-4914-94cc-24408fa19741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:24.028242 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23413e19-f789-4914-94cc-24408fa19741 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:24.028519 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23413e19-f789-4914-94cc-24408fa19741 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:24.028840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23413e19-f789-4914-94cc-24408fa19741 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:24.029692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23413e19-f789-4914-94cc-24408fa19741 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:24.030023 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23413e19-f789-4914-94cc-24408fa19741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:24.031641 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23413e19-f789-4914-94cc-24408fa19741 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:24.042805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 79/152] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:24.049234 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de217-4c3a-49f7-a3dc-e2bc67fa1e34 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:24.175670 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:24.184390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de217-4c3a-49f7-a3dc-e2bc67fa1e34 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:24.226235 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1b9e8-2aa5-48b2-982b-092a49477bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:24.226937 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1b9e8-2aa5-48b2-982b-092a49477bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:24.227241 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1b9e8-2aa5-48b2-982b-092a49477bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:24.227540 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1b9e8-2aa5-48b2-982b-092a49477bb0 None admin] PATH_INFO: `/v3/users/f51a1b11f75b400fabaa9dacc41da029` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:24.228918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1b9e8-2aa5-48b2-982b-092a49477bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=f51a1b11f75b400fabaa9dacc41da029)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:24.230619 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1b9e8-2aa5-48b2-982b-092a49477bb0 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:24.232981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 74/153] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:24 2022] GET /identity/v3/users/f51a1b11f75b400fabaa9dacc41da029 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:24.239293 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23413e19-f789-4914-94cc-24408fa19741 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:24.331970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:24.362170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23413e19-f789-4914-94cc-24408fa19741 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:24.404690 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cc41a-b280-4a9f-92ac-6c8cf15a6647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:24.405522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cc41a-b280-4a9f-92ac-6c8cf15a6647 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:24.406728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cc41a-b280-4a9f-92ac-6c8cf15a6647 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:24.407147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cc41a-b280-4a9f-92ac-6c8cf15a6647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:24.466834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7ac19-085c-4927-a7e3-cc157d05ce0d None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:24.467033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7ac19-085c-4927-a7e3-cc157d05ce0d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:24.467330 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7ac19-085c-4927-a7e3-cc157d05ce0d None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:24.469133 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 75/154] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:24.476981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694c7d7-fe33-4b87-970b-d45cee6a6e89 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:24.477356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694c7d7-fe33-4b87-970b-d45cee6a6e89 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:24.477581 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694c7d7-fe33-4b87-970b-d45cee6a6e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:24.507312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-a694c7d7-fe33-4b87-970b-d45cee6a6e89 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:24.508934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a694c7d7-fe33-4b87-970b-d45cee6a6e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:24.530410 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cc41a-b280-4a9f-92ac-6c8cf15a6647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:24.532913 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cc41a-b280-4a9f-92ac-6c8cf15a6647 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:24.627693 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 76/155] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:24.678813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:24.691994 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694c7d7-fe33-4b87-970b-d45cee6a6e89 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:24.711005 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 80/156] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:05:24.718825 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cc41a-b280-4a9f-92ac-6c8cf15a6647 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:24.886668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:24.905048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694c7d7-fe33-4b87-970b-d45cee6a6e89 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:24.936029 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cc41a-b280-4a9f-92ac-6c8cf15a6647 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:24.955261 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f23ab-3a94-4a94-9759-0a23dbb51709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:24.956402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f23ab-3a94-4a94-9759-0a23dbb51709 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:24.956889 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f23ab-3a94-4a94-9759-0a23dbb51709 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:24.957509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f23ab-3a94-4a94-9759-0a23dbb51709 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:24.980915 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f23ab-3a94-4a94-9759-0a23dbb51709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-563f23ab-3a94-4a94-9759-0a23dbb51709 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:24.986668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:24.987900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:24.988823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:24.988823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:24.988823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:24.988823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:24.988823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:24.988823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:24.988823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:24.988823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:24.988823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:24.988823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:24.988823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:24.988823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:24.991573 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 77/157] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:05:24.998355 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f23ab-3a94-4a94-9759-0a23dbb51709 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:25.013655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0025c7-49aa-4653-a468-b8332560b6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:25.013655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0025c7-49aa-4653-a468-b8332560b6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:25.013655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0025c7-49aa-4653-a468-b8332560b6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:25.013655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0025c7-49aa-4653-a468-b8332560b6f7 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:25.014056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0025c7-49aa-4653-a468-b8332560b6f7 None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:25.015004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0025c7-49aa-4653-a468-b8332560b6f7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:25.016821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 81/158] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:24 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:25.024133 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0025c7-49aa-4653-a468-b8332560b6f7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:25.106335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:25.194001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0025c7-49aa-4653-a468-b8332560b6f7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:25.208776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f23ab-3a94-4a94-9759-0a23dbb51709 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:25.237800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ffb2f-44ca-45e6-9b3f-3ecc716917c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:25.238440 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ffb2f-44ca-45e6-9b3f-3ecc716917c7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:25.238742 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ffb2f-44ca-45e6-9b3f-3ecc716917c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:25.239040 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ffb2f-44ca-45e6-9b3f-3ecc716917c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:25.239821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ffb2f-44ca-45e6-9b3f-3ecc716917c7 None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b, user.id=f51a1b11f75b400fabaa9dacc41da029) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:25.240157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ffb2f-44ca-45e6-9b3f-3ecc716917c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:25.242057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ffb2f-44ca-45e6-9b3f-3ecc716917c7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:25.249451 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 82/159] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:25 2022] GET /identity/v3/role_assignments?user.id=f51a1b11f75b400fabaa9dacc41da029&scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:25.287705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab7754-7b23-43a9-8faf-cfe6291fe510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:25.288768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab7754-7b23-43a9-8faf-cfe6291fe510 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:25.289270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab7754-7b23-43a9-8faf-cfe6291fe510 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:25.289777 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab7754-7b23-43a9-8faf-cfe6291fe510 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:25.290934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab7754-7b23-43a9-8faf-cfe6291fe510 None admin] RBAC: Adding query filter params (name=member) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:25.291481 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab7754-7b23-43a9-8faf-cfe6291fe510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:25.293269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab7754-7b23-43a9-8faf-cfe6291fe510 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:25.309241 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 78/160] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:25.315923 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ffb2f-44ca-45e6-9b3f-3ecc716917c7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:25.455061 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ffb2f-44ca-45e6-9b3f-3ecc716917c7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:25.463210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:25.493201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff5937-9583-488f-ac38-73970df17e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:25.493877 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff5937-9583-488f-ac38-73970df17e5d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:25.494158 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff5937-9583-488f-ac38-73970df17e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:25.494433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff5937-9583-488f-ac38-73970df17e5d None admin] PATH_INFO: `/v3/users/736a7588742742e5ab57503902970713` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:25.495743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff5937-9583-488f-ac38-73970df17e5d None admin] RBAC: Authorizing `identity:get_user(user_id=736a7588742742e5ab57503902970713)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:25.497270 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff5937-9583-488f-ac38-73970df17e5d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:25.499191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 83/161] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:25 2022] GET /identity/v3/users/736a7588742742e5ab57503902970713 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:25.505666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab7754-7b23-43a9-8faf-cfe6291fe510 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:25.524097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:25.615636 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab7754-7b23-43a9-8faf-cfe6291fe510 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:25.651515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35479c-87d2-4b09-a5bd-54280cc7acca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:25.652141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35479c-87d2-4b09-a5bd-54280cc7acca None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:25.652524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35479c-87d2-4b09-a5bd-54280cc7acca None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:25.652844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35479c-87d2-4b09-a5bd-54280cc7acca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:25.723337 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35479c-87d2-4b09-a5bd-54280cc7acca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:25.724827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35479c-87d2-4b09-a5bd-54280cc7acca None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:25.740448 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:25.827564 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 79/162] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:25.833485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff5937-9583-488f-ac38-73970df17e5d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:25.935947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff5937-9583-488f-ac38-73970df17e5d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:25.969736 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d01a2-9ca8-4467-aedb-13e1bdb0d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:25.970789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d01a2-9ca8-4467-aedb-13e1bdb0d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:25.971067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d01a2-9ca8-4467-aedb-13e1bdb0d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:25.971342 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d01a2-9ca8-4467-aedb-13e1bdb0d1d7 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:25.972495 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d01a2-9ca8-4467-aedb-13e1bdb0d1d7 None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:25.973976 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d01a2-9ca8-4467-aedb-13e1bdb0d1d7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:25.975930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 84/163] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:25 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:25.983110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35479c-87d2-4b09-a5bd-54280cc7acca None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:26.084186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35479c-87d2-4b09-a5bd-54280cc7acca None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:26.098757 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:26.119106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e43bd-e215-40d3-bdd5-0f8abfbe1c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:26.119717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e43bd-e215-40d3-bdd5-0f8abfbe1c95 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:26.119989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e43bd-e215-40d3-bdd5-0f8abfbe1c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:26.120255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e43bd-e215-40d3-bdd5-0f8abfbe1c95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:26.120982 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e43bd-e215-40d3-bdd5-0f8abfbe1c95 None admin] RBAC: Adding query filter params (role.id=186990d6368647b5b0712c4fedf4afd9, scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b, user.id=736a7588742742e5ab57503902970713) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:26.121286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e43bd-e215-40d3-bdd5-0f8abfbe1c95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:26.122772 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e43bd-e215-40d3-bdd5-0f8abfbe1c95 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:26.128944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 80/164] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:25 2022] GET /identity/v3/role_assignments?user.id=736a7588742742e5ab57503902970713&scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b&role.id=186990d6368647b5b0712c4fedf4afd9 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:26.230564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b47106-208c-4302-83ba-f06857ca3784 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:26.230897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b47106-208c-4302-83ba-f06857ca3784 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:26.231118 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b47106-208c-4302-83ba-f06857ca3784 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:26.232801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 85/165] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:26.238863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248427d-90bd-40cf-970a-21792498b8e6 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:26.239194 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248427d-90bd-40cf-970a-21792498b8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:26.239407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248427d-90bd-40cf-970a-21792498b8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:26.262763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-2248427d-90bd-40cf-970a-21792498b8e6 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:26.264063 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2248427d-90bd-40cf-970a-21792498b8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:26.351612 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 81/166] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:26.393763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b47106-208c-4302-83ba-f06857ca3784 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:26.446651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:26.527145 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b47106-208c-4302-83ba-f06857ca3784 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:26.564662 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7b2e7-3b62-46d6-9a4b-d51bd79a8288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:26.565340 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7b2e7-3b62-46d6-9a4b-d51bd79a8288 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:26.565646 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7b2e7-3b62-46d6-9a4b-d51bd79a8288 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:26.565953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7b2e7-3b62-46d6-9a4b-d51bd79a8288 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:26.578689 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7b2e7-3b62-46d6-9a4b-d51bd79a8288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-ffe7b2e7-3b62-46d6-9a4b-d51bd79a8288 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:26.584532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:26.585591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:26.586743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:26.586743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:26.586743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:26.586743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:26.586743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:26.586743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:26.586743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:26.586743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:26.586743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:26.586743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:26.586743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:26.586743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:26.586743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 86/167] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:05:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:26.595330 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248427d-90bd-40cf-970a-21792498b8e6 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:26.728012 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248427d-90bd-40cf-970a-21792498b8e6 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:26.740205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:26.770410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4adeb7-e59d-460c-9622-f7dbd3c8f2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:26.771255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4adeb7-e59d-460c-9622-f7dbd3c8f2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:26.771611 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4adeb7-e59d-460c-9622-f7dbd3c8f2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:26.771975 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4adeb7-e59d-460c-9622-f7dbd3c8f2f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:26.773027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4adeb7-e59d-460c-9622-f7dbd3c8f2f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:26.773501 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4adeb7-e59d-460c-9622-f7dbd3c8f2f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:26.775584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4adeb7-e59d-460c-9622-f7dbd3c8f2f9 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:26.791061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 82/168] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:05:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:26.797821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7b2e7-3b62-46d6-9a4b-d51bd79a8288 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:26.952720 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7b2e7-3b62-46d6-9a4b-d51bd79a8288 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:26.955795 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:27.011608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e322e-0477-4900-8a80-d6398dda9995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:27.012583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e322e-0477-4900-8a80-d6398dda9995 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:27.013049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e322e-0477-4900-8a80-d6398dda9995 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:27.013536 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e322e-0477-4900-8a80-d6398dda9995 None admin] PATH_INFO: `/v3/users/736a7588742742e5ab57503902970713` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:27.015073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e322e-0477-4900-8a80-d6398dda9995 None admin] RBAC: Authorizing `identity:get_user(user_id=736a7588742742e5ab57503902970713)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:27.016862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e322e-0477-4900-8a80-d6398dda9995 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:27.018947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 87/169] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:26 2022] GET /identity/v3/users/736a7588742742e5ab57503902970713 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:27.025325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4adeb7-e59d-460c-9622-f7dbd3c8f2f9 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:27.160796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4adeb7-e59d-460c-9622-f7dbd3c8f2f9 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:27.203021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd272369-133e-4dfa-9c3f-f46ef3e0e665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:27.203715 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd272369-133e-4dfa-9c3f-f46ef3e0e665 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:27.203980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd272369-133e-4dfa-9c3f-f46ef3e0e665 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:27.204250 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd272369-133e-4dfa-9c3f-f46ef3e0e665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:27.272187 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075065b-7c26-4c78-9c5e-9985e898f520 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:27.272778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075065b-7c26-4c78-9c5e-9985e898f520 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:27.273283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:27.273869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075065b-7c26-4c78-9c5e-9985e898f520 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:27.282026 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 88/170] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:27.283976 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba060a-2f5e-4e1c-9850-35bc42dfa2c3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:27.284508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba060a-2f5e-4e1c-9850-35bc42dfa2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:27.285003 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba060a-2f5e-4e1c-9850-35bc42dfa2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:27.322769 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-26ba060a-2f5e-4e1c-9850-35bc42dfa2c3 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:27.324374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-26ba060a-2f5e-4e1c-9850-35bc42dfa2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:27.341381 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd272369-133e-4dfa-9c3f-f46ef3e0e665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:27.345478 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd272369-133e-4dfa-9c3f-f46ef3e0e665 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:27.463992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 89/171] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:27.499187 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba060a-2f5e-4e1c-9850-35bc42dfa2c3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:27.549653 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 83/172] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:27.556958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd272369-133e-4dfa-9c3f-f46ef3e0e665 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:27.709981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:27.713814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:27.720885 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba060a-2f5e-4e1c-9850-35bc42dfa2c3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:27.783871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd272369-133e-4dfa-9c3f-f46ef3e0e665 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:27.788026 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec9ea0-90a6-4a63-b087-03d9059b32ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:27.788670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9ea0-90a6-4a63-b087-03d9059b32ca None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:27.788943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9ea0-90a6-4a63-b087-03d9059b32ca None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:27.789325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9ea0-90a6-4a63-b087-03d9059b32ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:27.814697 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec9ea0-90a6-4a63-b087-03d9059b32ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-e6ec9ea0-90a6-4a63-b087-03d9059b32ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:27.819862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:27.820775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:27.821773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:27.821773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:27.821773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:27.821773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:27.821773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:27.821773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:27.821773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:27.821773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:27.821773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:27.821773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:27.821773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:27.821773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:27.821773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 90/173] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:27.825061 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615933c0-a367-4a18-b6bb-4ddc3c335def None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:27.825532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615933c0-a367-4a18-b6bb-4ddc3c335def None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:27.826100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615933c0-a367-4a18-b6bb-4ddc3c335def None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:27.827861 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 91/174] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:27.833828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0e805-f826-4318-915b-874255bc4098 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:27.834443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0e805-f826-4318-915b-874255bc4098 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:27.834903 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0e805-f826-4318-915b-874255bc4098 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:27.837057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 92/175] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:27.838394 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0e805-f826-4318-915b-874255bc4098 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:27.854118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89c91c-9c92-4e93-9b5f-b8a6f01418ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:27.855256 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89c91c-9c92-4e93-9b5f-b8a6f01418ff None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:27.855832 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89c91c-9c92-4e93-9b5f-b8a6f01418ff None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:27.856273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89c91c-9c92-4e93-9b5f-b8a6f01418ff None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:27.858052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89c91c-9c92-4e93-9b5f-b8a6f01418ff None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:27.859894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89c91c-9c92-4e93-9b5f-b8a6f01418ff None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:27.862894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 84/176] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:27 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:27.870185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cf3f5-11b6-45ae-8137-311a5f92339d None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:27.870553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cf3f5-11b6-45ae-8137-311a5f92339d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:27.870769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cf3f5-11b6-45ae-8137-311a5f92339d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:27.892715 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-c83cf3f5-11b6-45ae-8137-311a5f92339d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:27.893962 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c83cf3f5-11b6-45ae-8137-311a5f92339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:27.972262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 85/177] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:27.977720 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0e805-f826-4318-915b-874255bc4098 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:27.979520 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c271b1d-7e52-459d-bf44-15685bcdca1b None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:27.979804 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c271b1d-7e52-459d-bf44-15685bcdca1b None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:27.980196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c271b1d-7e52-459d-bf44-15685bcdca1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:28.024279 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-8c271b1d-7e52-459d-bf44-15685bcdca1b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:28.025769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8c271b1d-7e52-459d-bf44-15685bcdca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:28.026174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa65fa-9658-407c-b943-d3cdc1b6289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:28.027154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa65fa-9658-407c-b943-d3cdc1b6289f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:28.027643 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa65fa-9658-407c-b943-d3cdc1b6289f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:28.028535 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa65fa-9658-407c-b943-d3cdc1b6289f None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:28.030500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa65fa-9658-407c-b943-d3cdc1b6289f None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:28.031076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa65fa-9658-407c-b943-d3cdc1b6289f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:28.033132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa65fa-9658-407c-b943-d3cdc1b6289f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:28.047366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 93/178] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:28.049179 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa65fa-9658-407c-b943-d3cdc1b6289f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:28.085693 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:28.100043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:28.105979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 86/179] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:28.107176 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c271b1d-7e52-459d-bf44-15685bcdca1b None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:28.194991 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa65fa-9658-407c-b943-d3cdc1b6289f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:28.213748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c271b1d-7e52-459d-bf44-15685bcdca1b None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:28.231380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c02372-7282-406a-9f3a-72c7c10f198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:28.232063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c02372-7282-406a-9f3a-72c7c10f198f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:28.232339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c02372-7282-406a-9f3a-72c7c10f198f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:28.232609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c02372-7282-406a-9f3a-72c7c10f198f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:28.233336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c02372-7282-406a-9f3a-72c7c10f198f None admin] RBAC: Adding query filter params (role.id=90f6c18c707742de8521c29b89d64215, scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b, user.id=736a7588742742e5ab57503902970713) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:28.233657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c02372-7282-406a-9f3a-72c7c10f198f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:28.235093 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c02372-7282-406a-9f3a-72c7c10f198f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:28.241127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 94/180] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:28 2022] GET /identity/v3/role_assignments?user.id=736a7588742742e5ab57503902970713&scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b&role.id=90f6c18c707742de8521c29b89d64215 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:28.241955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c02372-7282-406a-9f3a-72c7c10f198f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:28.258015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d51e5e-2da3-4b98-a949-bdf85ecec0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:28.258677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d51e5e-2da3-4b98-a949-bdf85ecec0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:28.258947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d51e5e-2da3-4b98-a949-bdf85ecec0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:28.259276 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d51e5e-2da3-4b98-a949-bdf85ecec0a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:28.272116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d51e5e-2da3-4b98-a949-bdf85ecec0a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-a1d51e5e-2da3-4b98-a949-bdf85ecec0a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:28.277211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:28.278262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:28.279102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:28.279102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:28.279102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:28.279102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:28.279102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:28.279102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:28.279102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:28.279102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:28.279102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:28.279102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:28.279102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:28.279102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:28.279102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 87/181] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:05:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:28.279794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d51e5e-2da3-4b98-a949-bdf85ecec0a4 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:28.356275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:28.363374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:28.382418 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c02372-7282-406a-9f3a-72c7c10f198f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:28.409077 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d51e5e-2da3-4b98-a949-bdf85ecec0a4 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:28.424347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9ec58-5cd2-43d1-aaa9-ea3b5421e935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:28.425304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9ec58-5cd2-43d1-aaa9-ea3b5421e935 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:28.425801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9ec58-5cd2-43d1-aaa9-ea3b5421e935 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:28.426240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9ec58-5cd2-43d1-aaa9-ea3b5421e935 None admin] PATH_INFO: `/v3/users/736a7588742742e5ab57503902970713` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:28.427752 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9ec58-5cd2-43d1-aaa9-ea3b5421e935 None admin] RBAC: Authorizing `identity:get_user(user_id=736a7588742742e5ab57503902970713)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:28.429216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9ec58-5cd2-43d1-aaa9-ea3b5421e935 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:28.430917 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 95/182] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:28 2022] GET /identity/v3/users/736a7588742742e5ab57503902970713 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:28.432151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75816e-61b2-4665-94c7-9000c166421b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:28.432420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75816e-61b2-4665-94c7-9000c166421b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:28.432697 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75816e-61b2-4665-94c7-9000c166421b None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:28.434095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 96/183] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:28.435390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467f881-7e48-414f-bf06-ec2464657b9a None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:28.435390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467f881-7e48-414f-bf06-ec2464657b9a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:28.435551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467f881-7e48-414f-bf06-ec2464657b9a None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:28.441049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 97/184] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:28.441987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467f881-7e48-414f-bf06-ec2464657b9a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:28.459294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e8b5-44aa-49bc-85e9-6e4b75ed7b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:28.459925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e8b5-44aa-49bc-85e9-6e4b75ed7b38 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:28.460192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e8b5-44aa-49bc-85e9-6e4b75ed7b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:28.460458 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e8b5-44aa-49bc-85e9-6e4b75ed7b38 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:28.473934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1e8b5-44aa-49bc-85e9-6e4b75ed7b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-87b1e8b5-44aa-49bc-85e9-6e4b75ed7b38 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:28.478856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:28.479894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:28.480930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:28.480930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:28.480930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:28.480930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:28.480930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:28.480930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:28.480930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:28.480930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:28.480930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:28.480930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:28.480930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:28.480930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:28.480930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 88/185] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:28.480930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e8b5-44aa-49bc-85e9-6e4b75ed7b38 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:28.564000 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467f881-7e48-414f-bf06-ec2464657b9a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:28.592611 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e8b5-44aa-49bc-85e9-6e4b75ed7b38 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:28.600369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388e23e-31b6-4914-8a7e-c7dc62bd1b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:28.601194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388e23e-31b6-4914-8a7e-c7dc62bd1b9d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:28.601384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388e23e-31b6-4914-8a7e-c7dc62bd1b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:28.601657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388e23e-31b6-4914-8a7e-c7dc62bd1b9d None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:28.602600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388e23e-31b6-4914-8a7e-c7dc62bd1b9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:28.602888 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388e23e-31b6-4914-8a7e-c7dc62bd1b9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:28.604266 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388e23e-31b6-4914-8a7e-c7dc62bd1b9d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:28.611082 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:28.615143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 98/186] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:28.616345 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fad5d9-d622-4cbd-af26-d6594aa2bcaf None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:28.616620 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fad5d9-d622-4cbd-af26-d6594aa2bcaf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:28.616883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fad5d9-d622-4cbd-af26-d6594aa2bcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:28.632055 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c931b87-1faf-4f36-94be-8f4a49bca5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:28.632854 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931b87-1faf-4f36-94be-8f4a49bca5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:28.632967 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931b87-1faf-4f36-94be-8f4a49bca5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:28.633217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931b87-1faf-4f36-94be-8f4a49bca5d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:28.636428 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-49fad5d9-d622-4cbd-af26-d6594aa2bcaf None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:28.637809 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-49fad5d9-d622-4cbd-af26-d6594aa2bcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:28.650461 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:28.711306 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c931b87-1faf-4f36-94be-8f4a49bca5d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:28.713173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c931b87-1faf-4f36-94be-8f4a49bca5d1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:28.713305 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 99/187] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:28.714801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f712765-3580-480d-a83e-5c5890ac7716 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:28.715174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f712765-3580-480d-a83e-5c5890ac7716 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:28.715589 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f712765-3580-480d-a83e-5c5890ac7716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:28.737136 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8f712765-3580-480d-a83e-5c5890ac7716 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:28.738680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8f712765-3580-480d-a83e-5c5890ac7716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:28.812531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 100/188] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:28.820443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f712765-3580-480d-a83e-5c5890ac7716 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:28.820541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 89/189] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:28.821087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c931b87-1faf-4f36-94be-8f4a49bca5d1 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:28.843912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:28.920831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:28.933141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c931b87-1faf-4f36-94be-8f4a49bca5d1 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:28.944629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f712765-3580-480d-a83e-5c5890ac7716 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:28.966786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e849-9c2a-44be-8e71-caa92d2a2c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:28.967405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e849-9c2a-44be-8e71-caa92d2a2c4f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:28.967672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e849-9c2a-44be-8e71-caa92d2a2c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:28.967921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e849-9c2a-44be-8e71-caa92d2a2c4f None admin] PATH_INFO: `/v3/users/5482c6498cf441ea887036c68889816f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:28.977921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fe48a-69c1-4431-8947-03ecdf70ce24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:28.978522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fe48a-69c1-4431-8947-03ecdf70ce24 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:28.978792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fe48a-69c1-4431-8947-03ecdf70ce24 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:28.979053 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fe48a-69c1-4431-8947-03ecdf70ce24 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:28.979705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fe48a-69c1-4431-8947-03ecdf70ce24 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:28.980003 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fe48a-69c1-4431-8947-03ecdf70ce24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:28.981375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fe48a-69c1-4431-8947-03ecdf70ce24 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:28.981530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4e849-9c2a-44be-8e71-caa92d2a2c4f None admin] RBAC: Authorizing `identity:get_user(user_id=5482c6498cf441ea887036c68889816f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:28.983040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4e849-9c2a-44be-8e71-caa92d2a2c4f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:28.984696 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 90/190] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:28 2022] GET /identity/v3/users/5482c6498cf441ea887036c68889816f => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:28.985475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e849-9c2a-44be-8e71-caa92d2a2c4f None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:28.994840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 101/191] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:28.995684 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fe48a-69c1-4431-8947-03ecdf70ce24 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:29.068547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:29.092867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e849-9c2a-44be-8e71-caa92d2a2c4f None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:29.102153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fe48a-69c1-4431-8947-03ecdf70ce24 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:29.125790 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5549807-6bd5-41fe-aace-cf8a6f47967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:29.126411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5549807-6bd5-41fe-aace-cf8a6f47967f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:29.126684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5549807-6bd5-41fe-aace-cf8a6f47967f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:29.126955 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5549807-6bd5-41fe-aace-cf8a6f47967f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:29.128067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5549807-6bd5-41fe-aace-cf8a6f47967f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:29.129553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5549807-6bd5-41fe-aace-cf8a6f47967f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:29.131515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 91/192] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:05:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:29.133424 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5549807-6bd5-41fe-aace-cf8a6f47967f None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:29.134491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93433b1-de4c-4cd9-8af1-5de569e0d975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:29.135120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93433b1-de4c-4cd9-8af1-5de569e0d975 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:29.135392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93433b1-de4c-4cd9-8af1-5de569e0d975 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:29.135710 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93433b1-de4c-4cd9-8af1-5de569e0d975 None admin] PATH_INFO: `/v3/projects/b6195679f0884c7d91538622023e8baa` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:29.137067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93433b1-de4c-4cd9-8af1-5de569e0d975 None admin] RBAC: Authorizing `identity:get_project(project_id=b6195679f0884c7d91538622023e8baa)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:29.138515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93433b1-de4c-4cd9-8af1-5de569e0d975 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:29.140130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 102/193] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:28 2022] GET /identity/v3/projects/b6195679f0884c7d91538622023e8baa => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:29.142437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93433b1-de4c-4cd9-8af1-5de569e0d975 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:29.152047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:29.231680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5549807-6bd5-41fe-aace-cf8a6f47967f None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:29.243866 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93433b1-de4c-4cd9-8af1-5de569e0d975 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:29.266611 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e20ec-abf1-44c5-874e-e0749d09aa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:29.267236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e20ec-abf1-44c5-874e-e0749d09aa5a None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:29.267511 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e20ec-abf1-44c5-874e-e0749d09aa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:29.267764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e20ec-abf1-44c5-874e-e0749d09aa5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:29.277274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a08b32-13e6-405c-90f7-b920841d05c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:29.277904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a08b32-13e6-405c-90f7-b920841d05c5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:29.278013 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e20ec-abf1-44c5-874e-e0749d09aa5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:29.278180 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a08b32-13e6-405c-90f7-b920841d05c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:29.278444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a08b32-13e6-405c-90f7-b920841d05c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-525e20ec-abf1-44c5-874e-e0749d09aa5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:29.282567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:29.283473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:29.289756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:29.289756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:29.289756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:29.289756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:29.289756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:29.289756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:29.289756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:29.289756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:29.289756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:29.289756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:29.289756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:29.289756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:29.289756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 92/194] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:05:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:29.289756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e20ec-abf1-44c5-874e-e0749d09aa5a None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:29.290736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:29.356964 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a08b32-13e6-405c-90f7-b920841d05c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:29.358480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a08b32-13e6-405c-90f7-b920841d05c5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:29.366855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:29.392220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e20ec-abf1-44c5-874e-e0749d09aa5a None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:29.427912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721c475-3151-49f7-939c-5406dad018e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:29.428540 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721c475-3151-49f7-939c-5406dad018e7 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:29.428811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721c475-3151-49f7-939c-5406dad018e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:29.429080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721c475-3151-49f7-939c-5406dad018e7 None admin] PATH_INFO: `/v3/users/1eaf966e68f54e07a846285270ee121a` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:29.430236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721c475-3151-49f7-939c-5406dad018e7 None admin] RBAC: Authorizing `identity:get_user(user_id=1eaf966e68f54e07a846285270ee121a)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:29.431754 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721c475-3151-49f7-939c-5406dad018e7 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:29.433346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 93/195] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:29 2022] GET /identity/v3/users/1eaf966e68f54e07a846285270ee121a => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:29.434110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721c475-3151-49f7-939c-5406dad018e7 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:29.464545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 103/196] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:29.465371 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a08b32-13e6-405c-90f7-b920841d05c5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:29.503361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:29.532579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721c475-3151-49f7-939c-5406dad018e7 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:29.564531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a08b32-13e6-405c-90f7-b920841d05c5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:29.566509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c7c03-ef72-4a99-94f6-50dff604482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:29.567120 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7c03-ef72-4a99-94f6-50dff604482d None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:29.567393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7c03-ef72-4a99-94f6-50dff604482d None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:29.567656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7c03-ef72-4a99-94f6-50dff604482d None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:29.568295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c7c03-ef72-4a99-94f6-50dff604482d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:29.569778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c7c03-ef72-4a99-94f6-50dff604482d None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:29.571904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:29.591427 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 94/197] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:05:29 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:05:29.598682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c7c03-ef72-4a99-94f6-50dff604482d None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:29.600406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcb7e7-8b73-4e31-9277-aca587ec5833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:29.601033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcb7e7-8b73-4e31-9277-aca587ec5833 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:29.601308 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcb7e7-8b73-4e31-9277-aca587ec5833 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:29.601573 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcb7e7-8b73-4e31-9277-aca587ec5833 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:29.602545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcb7e7-8b73-4e31-9277-aca587ec5833 None admin] RBAC: Adding query filter params (role.id=186990d6368647b5b0712c4fedf4afd9, scope.project.id=b6195679f0884c7d91538622023e8baa, user.id=736a7588742742e5ab57503902970713) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:29.602677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcb7e7-8b73-4e31-9277-aca587ec5833 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:29.604580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebcb7e7-8b73-4e31-9277-aca587ec5833 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:29.610859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 104/198] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:29 2022] GET /identity/v3/role_assignments?user.id=736a7588742742e5ab57503902970713&scope.project.id=b6195679f0884c7d91538622023e8baa&role.id=186990d6368647b5b0712c4fedf4afd9 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:29.611722 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcb7e7-8b73-4e31-9277-aca587ec5833 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:29.725942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c7c03-ef72-4a99-94f6-50dff604482d None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:29.762126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:29.769189 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3d8ca-b9eb-44d8-a0aa-a798519c3a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:29.770542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3d8ca-b9eb-44d8-a0aa-a798519c3a39 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:29.771096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3d8ca-b9eb-44d8-a0aa-a798519c3a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:29.771373 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3d8ca-b9eb-44d8-a0aa-a798519c3a39 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:29.772065 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3d8ca-b9eb-44d8-a0aa-a798519c3a39 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:29.772365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3d8ca-b9eb-44d8-a0aa-a798519c3a39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:29.773855 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3d8ca-b9eb-44d8-a0aa-a798519c3a39 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:29.781318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcb7e7-8b73-4e31-9277-aca587ec5833 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:29.782691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 95/199] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:05:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:29.783631 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3d8ca-b9eb-44d8-a0aa-a798519c3a39 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:29.827963 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a08526-06ef-4d80-9543-0ca316c0bcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:29.828580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a08526-06ef-4d80-9543-0ca316c0bcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:29.829016 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a08526-06ef-4d80-9543-0ca316c0bcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:29.829294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a08526-06ef-4d80-9543-0ca316c0bcd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:29.883577 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:29.922156 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a08526-06ef-4d80-9543-0ca316c0bcd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:29.923733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a08526-06ef-4d80-9543-0ca316c0bcd3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:29.926206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3d8ca-b9eb-44d8-a0aa-a798519c3a39 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:29.966441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a349d96-7017-4e8c-9773-abdc5c78d511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:29.967066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a349d96-7017-4e8c-9773-abdc5c78d511 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:29.967869 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a349d96-7017-4e8c-9773-abdc5c78d511 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:29.967869 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a349d96-7017-4e8c-9773-abdc5c78d511 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:29.968707 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a349d96-7017-4e8c-9773-abdc5c78d511 None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:29.970440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a349d96-7017-4e8c-9773-abdc5c78d511 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:29.972223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 96/200] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:29 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:29.972857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a349d96-7017-4e8c-9773-abdc5c78d511 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:30.044893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:30.057716 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 105/201] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:30.060015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a08526-06ef-4d80-9543-0ca316c0bcd3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:30.092773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a349d96-7017-4e8c-9773-abdc5c78d511 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:30.128526 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8caa21-4959-4597-8e00-5015eaf72953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:30.129270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8caa21-4959-4597-8e00-5015eaf72953 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:30.129542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8caa21-4959-4597-8e00-5015eaf72953 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:30.130202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8caa21-4959-4597-8e00-5015eaf72953 None admin] PATH_INFO: `/v3/users/5482c6498cf441ea887036c68889816f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:30.131411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8caa21-4959-4597-8e00-5015eaf72953 None admin] RBAC: Authorizing `identity:get_user(user_id=5482c6498cf441ea887036c68889816f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:30.132975 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8caa21-4959-4597-8e00-5015eaf72953 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:30.134835 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 97/202] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:29 2022] GET /identity/v3/users/5482c6498cf441ea887036c68889816f => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:30.135730 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8caa21-4959-4597-8e00-5015eaf72953 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:30.147088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:30.181109 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a08526-06ef-4d80-9543-0ca316c0bcd3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:30.218256 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b4bd-831f-43da-a4fa-cb882c73e2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:30.218863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b4bd-831f-43da-a4fa-cb882c73e2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:30.219133 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b4bd-831f-43da-a4fa-cb882c73e2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:30.219454 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b4bd-831f-43da-a4fa-cb882c73e2c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:30.220173 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5b4bd-831f-43da-a4fa-cb882c73e2c4 None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=b1dee2813a11458fad814d5b53a5a15f, user.id=5482c6498cf441ea887036c68889816f) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:30.220518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5b4bd-831f-43da-a4fa-cb882c73e2c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:30.221993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5b4bd-831f-43da-a4fa-cb882c73e2c4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:30.229348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 106/203] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:30 2022] GET /identity/v3/role_assignments?user.id=5482c6498cf441ea887036c68889816f&scope.project.id=b1dee2813a11458fad814d5b53a5a15f&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:30.230192 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b4bd-831f-43da-a4fa-cb882c73e2c4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:30.302507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8caa21-4959-4597-8e00-5015eaf72953 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:30.354025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:30.367608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbd3a6-657a-40c9-8c56-3459a42d891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:30.368359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbd3a6-657a-40c9-8c56-3459a42d891d None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:30.368670 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbd3a6-657a-40c9-8c56-3459a42d891d None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:30.368938 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbd3a6-657a-40c9-8c56-3459a42d891d None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:30.371849 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbd3a6-657a-40c9-8c56-3459a42d891d None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:30.373353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbd3a6-657a-40c9-8c56-3459a42d891d None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:30.384818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 98/204] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:30 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:30.387074 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b4bd-831f-43da-a4fa-cb882c73e2c4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:30.398336 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbd3a6-657a-40c9-8c56-3459a42d891d None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:30.451656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a240c8e-287a-4b7a-a909-df39ed915876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:30.452286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a240c8e-287a-4b7a-a909-df39ed915876 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:30.453145 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a240c8e-287a-4b7a-a909-df39ed915876 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:30.453417 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a240c8e-287a-4b7a-a909-df39ed915876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:30.458421 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:30.529257 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbd3a6-657a-40c9-8c56-3459a42d891d None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:30.566003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b46a4f-ec5f-4552-866c-b391d71e5ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:30.566520 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b46a4f-ec5f-4552-866c-b391d71e5ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:30.566791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b46a4f-ec5f-4552-866c-b391d71e5ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:30.567057 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b46a4f-ec5f-4552-866c-b391d71e5ff9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:30.567926 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b46a4f-ec5f-4552-866c-b391d71e5ff9 None admin] RBAC: Adding query filter params (role.id=cfa1c4251ba64c96bf0ddbeb03d57d77, scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b, user.id=1eaf966e68f54e07a846285270ee121a) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:30.568351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b46a4f-ec5f-4552-866c-b391d71e5ff9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:30.573655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b46a4f-ec5f-4552-866c-b391d71e5ff9 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:30.577147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 99/205] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:30 2022] GET /identity/v3/role_assignments?user.id=1eaf966e68f54e07a846285270ee121a&scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b&role.id=cfa1c4251ba64c96bf0ddbeb03d57d77 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:30.596144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a240c8e-287a-4b7a-a909-df39ed915876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:30.598027 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a240c8e-287a-4b7a-a909-df39ed915876 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:30.734900 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 107/206] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:30.740941 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b46a4f-ec5f-4552-866c-b391d71e5ff9 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:30.820521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:30.880576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b46a4f-ec5f-4552-866c-b391d71e5ff9 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:30.929007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d3e17-4921-4f26-a4ba-890a53349420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:30.929661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d3e17-4921-4f26-a4ba-890a53349420 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:30.929935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d3e17-4921-4f26-a4ba-890a53349420 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:30.930246 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d3e17-4921-4f26-a4ba-890a53349420 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:30.931425 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d3e17-4921-4f26-a4ba-890a53349420 None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:30.932908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d3e17-4921-4f26-a4ba-890a53349420 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:30.934680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 100/207] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:30 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:30.940649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a240c8e-287a-4b7a-a909-df39ed915876 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:30.975513 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:31.053633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a240c8e-287a-4b7a-a909-df39ed915876 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:31.087845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2d76a-50a7-4dbb-a6ea-a75351087b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:31.088461 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2d76a-50a7-4dbb-a6ea-a75351087b66 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:31.088669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2d76a-50a7-4dbb-a6ea-a75351087b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:31.088897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2d76a-50a7-4dbb-a6ea-a75351087b66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:31.089626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2d76a-50a7-4dbb-a6ea-a75351087b66 None admin] RBAC: Adding query filter params (role.id=90f6c18c707742de8521c29b89d64215, scope.project.id=b1dee2813a11458fad814d5b53a5a15f, user.id=5482c6498cf441ea887036c68889816f) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:31.089943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2d76a-50a7-4dbb-a6ea-a75351087b66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:31.091376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2d76a-50a7-4dbb-a6ea-a75351087b66 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:31.097067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 108/208] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:30 2022] GET /identity/v3/role_assignments?user.id=5482c6498cf441ea887036c68889816f&scope.project.id=b1dee2813a11458fad814d5b53a5a15f&role.id=90f6c18c707742de8521c29b89d64215 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:31.796221 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d565d4d-c5af-4daa-be8d-ff49730c2c47 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:31.796608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d565d4d-c5af-4daa-be8d-ff49730c2c47 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:31.796881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d565d4d-c5af-4daa-be8d-ff49730c2c47 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:31.798841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 101/209] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:31.804824 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0957-b8bd-412a-9999-423d406d0f49 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:31.805422 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0957-b8bd-412a-9999-423d406d0f49 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:31.806039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0957-b8bd-412a-9999-423d406d0f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:31.827479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-91ea0957-b8bd-412a-9999-423d406d0f49 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:31.829015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-91ea0957-b8bd-412a-9999-423d406d0f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:31.900654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 109/210] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:31.925549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d565d4d-c5af-4daa-be8d-ff49730c2c47 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:32.018891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45a99-4dbf-4488-9edb-96e9a079969e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:32.019255 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45a99-4dbf-4488-9edb-96e9a079969e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:32.019435 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45a99-4dbf-4488-9edb-96e9a079969e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:32.020780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 110/211] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:05:32.027543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d417a-06d6-4e1f-b4d2-68a656e58eed None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:32.027543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d417a-06d6-4e1f-b4d2-68a656e58eed None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:32.027543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d417a-06d6-4e1f-b4d2-68a656e58eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:32.035947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d565d4d-c5af-4daa-be8d-ff49730c2c47 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:32.047591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-395d417a-06d6-4e1f-b4d2-68a656e58eed None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:32.048689 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-395d417a-06d6-4e1f-b4d2-68a656e58eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:32.061690 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:32.071610 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803efe0-6bb7-40b0-8984-a4055dd57518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:32.072234 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803efe0-6bb7-40b0-8984-a4055dd57518 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:32.072501 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803efe0-6bb7-40b0-8984-a4055dd57518 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:32.072758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803efe0-6bb7-40b0-8984-a4055dd57518 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:32.073589 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:32.083387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803efe0-6bb7-40b0-8984-a4055dd57518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-4803efe0-6bb7-40b0-8984-a4055dd57518 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:32.088738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:32.089647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:32.090473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:32.090473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:32.090473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:32.090473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:32.090473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:32.090473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:32.090473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:32.090473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:32.090473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:32.090473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:32.090473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:32.090473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:32.090473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 102/212] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:32.095598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803efe0-6bb7-40b0-8984-a4055dd57518 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:32.130102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 111/213] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:32.147030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d417a-06d6-4e1f-b4d2-68a656e58eed None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:32.200617 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803efe0-6bb7-40b0-8984-a4055dd57518 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:32.235202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32160c-adc3-4809-8d5e-2094fbfb00c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:32.235805 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32160c-adc3-4809-8d5e-2094fbfb00c6 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:32.236075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32160c-adc3-4809-8d5e-2094fbfb00c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:32.236342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32160c-adc3-4809-8d5e-2094fbfb00c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:32.236989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32160c-adc3-4809-8d5e-2094fbfb00c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:32.237286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32160c-adc3-4809-8d5e-2094fbfb00c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:32.238712 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32160c-adc3-4809-8d5e-2094fbfb00c6 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:32.247191 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 103/214] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:32.249996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d417a-06d6-4e1f-b4d2-68a656e58eed None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:32.253931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32160c-adc3-4809-8d5e-2094fbfb00c6 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:32.296218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839ea32-9869-4291-94ad-3075861e6b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:32.297475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ea32-9869-4291-94ad-3075861e6b2d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:32.297828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ea32-9869-4291-94ad-3075861e6b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:32.298037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839ea32-9869-4291-94ad-3075861e6b2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:32.300057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839ea32-9869-4291-94ad-3075861e6b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:32.301914 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839ea32-9869-4291-94ad-3075861e6b2d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:32.305725 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 112/215] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:05:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:32.311083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:32.312954 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839ea32-9869-4291-94ad-3075861e6b2d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:32.350039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:32.364617 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32160c-adc3-4809-8d5e-2094fbfb00c6 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:32.400918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d439b59-d162-4ed6-86a2-705236053955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:32.401789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d439b59-d162-4ed6-86a2-705236053955 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:32.402342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d439b59-d162-4ed6-86a2-705236053955 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:32.402704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d439b59-d162-4ed6-86a2-705236053955 None admin] PATH_INFO: `/v3/users/2c3838be7e3640feb4a7241b715ea46a` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:32.416831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d439b59-d162-4ed6-86a2-705236053955 None admin] RBAC: Authorizing `identity:get_user(user_id=2c3838be7e3640feb4a7241b715ea46a)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:32.418625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d439b59-d162-4ed6-86a2-705236053955 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:32.420719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 104/216] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:32 2022] GET /identity/v3/users/2c3838be7e3640feb4a7241b715ea46a => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:32.426017 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d439b59-d162-4ed6-86a2-705236053955 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:32.447747 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839ea32-9869-4291-94ad-3075861e6b2d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:32.502601 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b9f79-5246-40ed-abc8-91661feaae63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:32.503242 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b9f79-5246-40ed-abc8-91661feaae63 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:32.503512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b9f79-5246-40ed-abc8-91661feaae63 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:32.503776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b9f79-5246-40ed-abc8-91661feaae63 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:32.504518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b9f79-5246-40ed-abc8-91661feaae63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:32.506682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b9f79-5246-40ed-abc8-91661feaae63 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:32.534246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 113/217] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:05:32 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:05:32.571744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d439b59-d162-4ed6-86a2-705236053955 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:32.580464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:32.613783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d919c-6d04-4aa0-bbc3-2598488bedb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:32.614411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d919c-6d04-4aa0-bbc3-2598488bedb8 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:32.614677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d919c-6d04-4aa0-bbc3-2598488bedb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:32.614943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d919c-6d04-4aa0-bbc3-2598488bedb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:32.616969 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131058e-8f59-48d6-984b-0858c4e72ab2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:32.617244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131058e-8f59-48d6-984b-0858c4e72ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:32.617502 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131058e-8f59-48d6-984b-0858c4e72ab2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:32.619268 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 114/218] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:32.624761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d8bc7-a868-4e08-8f05-b1d09d975cd0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:32.625066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d8bc7-a868-4e08-8f05-b1d09d975cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:32.625277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d8bc7-a868-4e08-8f05-b1d09d975cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:32.649550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-886d8bc7-a868-4e08-8f05-b1d09d975cd0 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:32.651520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-886d8bc7-a868-4e08-8f05-b1d09d975cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:32.697839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d919c-6d04-4aa0-bbc3-2598488bedb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:32.699713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d919c-6d04-4aa0-bbc3-2598488bedb8 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:32.743925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 115/219] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:32.766956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d8bc7-a868-4e08-8f05-b1d09d975cd0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:32.783606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:32.835175 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 105/220] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:32.841861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d919c-6d04-4aa0-bbc3-2598488bedb8 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:32.851738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:32.910683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d8bc7-a868-4e08-8f05-b1d09d975cd0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:32.958224 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a712a-f104-4605-9228-9af081f7610b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:32.958956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a712a-f104-4605-9228-9af081f7610b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:32.959153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a712a-f104-4605-9228-9af081f7610b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:32.959405 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a712a-f104-4605-9228-9af081f7610b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:32.980436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d919c-6d04-4aa0-bbc3-2598488bedb8 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:32.988793 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a712a-f104-4605-9228-9af081f7610b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-bb8a712a-f104-4605-9228-9af081f7610b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:32.996088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:32.997088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:32.997945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:32.997945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:32.997945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:32.997945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:32.997945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:32.997945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:32.997945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:32.997945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:32.997945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:32.997945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:32.997945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:32.997945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:33.001840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 116/221] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:05:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:33.008583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a712a-f104-4605-9228-9af081f7610b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:33.037129 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432a51c-83e4-402d-864c-091569ad73aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:33.037813 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a51c-83e4-402d-864c-091569ad73aa None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:33.038066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a51c-83e4-402d-864c-091569ad73aa None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:33.038330 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a51c-83e4-402d-864c-091569ad73aa None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:33.040096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432a51c-83e4-402d-864c-091569ad73aa None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:33.042103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432a51c-83e4-402d-864c-091569ad73aa None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:33.044941 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 106/222] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:32 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:33.051432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432a51c-83e4-402d-864c-091569ad73aa None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:33.158076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:33.189525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:33.217048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432a51c-83e4-402d-864c-091569ad73aa None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:33.220662 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a712a-f104-4605-9228-9af081f7610b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:33.255101 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab51eb4-7f10-4339-aa23-8742a677eeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:33.256094 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab51eb4-7f10-4339-aa23-8742a677eeea None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:33.256592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab51eb4-7f10-4339-aa23-8742a677eeea None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:33.257063 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab51eb4-7f10-4339-aa23-8742a677eeea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:33.258013 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab51eb4-7f10-4339-aa23-8742a677eeea None admin] RBAC: Adding query filter params (role.id=186990d6368647b5b0712c4fedf4afd9, scope.project.id=b1dee2813a11458fad814d5b53a5a15f, user.id=2c3838be7e3640feb4a7241b715ea46a) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:33.258515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab51eb4-7f10-4339-aa23-8742a677eeea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:33.260333 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab51eb4-7f10-4339-aa23-8742a677eeea None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:33.273896 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 107/223] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:33 2022] GET /identity/v3/role_assignments?user.id=2c3838be7e3640feb4a7241b715ea46a&scope.project.id=b1dee2813a11458fad814d5b53a5a15f&role.id=186990d6368647b5b0712c4fedf4afd9 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:33.294593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56504120-7b16-456d-8244-bdde955d5477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:33.295241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56504120-7b16-456d-8244-bdde955d5477 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:33.295521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56504120-7b16-456d-8244-bdde955d5477 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:33.295789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56504120-7b16-456d-8244-bdde955d5477 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:33.296669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56504120-7b16-456d-8244-bdde955d5477 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:33.296858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56504120-7b16-456d-8244-bdde955d5477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:33.298296 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56504120-7b16-456d-8244-bdde955d5477 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:33.304967 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6c26f-cdae-4799-a309-3483d12386dd None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:33.305292 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6c26f-cdae-4799-a309-3483d12386dd None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:33.305498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6c26f-cdae-4799-a309-3483d12386dd None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:33.307801 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 108/224] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:05:33.313698 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 117/225] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:33.314066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29374-d030-4044-b85c-6ecefa16a0ad None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:33.314365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29374-d030-4044-b85c-6ecefa16a0ad None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:33.314664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29374-d030-4044-b85c-6ecefa16a0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:33.319011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56504120-7b16-456d-8244-bdde955d5477 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:33.335996 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-fcd29374-d030-4044-b85c-6ecefa16a0ad None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:33.337406 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fcd29374-d030-4044-b85c-6ecefa16a0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:33.468740 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 109/226] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:33.491560 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd29374-d030-4044-b85c-6ecefa16a0ad None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:33.497055 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56504120-7b16-456d-8244-bdde955d5477 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:33.549307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924abc4-2920-4914-96d6-0c79f7ca05bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:33.550233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924abc4-2920-4914-96d6-0c79f7ca05bd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:33.550680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924abc4-2920-4914-96d6-0c79f7ca05bd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:33.551087 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924abc4-2920-4914-96d6-0c79f7ca05bd None admin] PATH_INFO: `/v3/users/5482c6498cf441ea887036c68889816f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:33.552998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924abc4-2920-4914-96d6-0c79f7ca05bd None admin] RBAC: Authorizing `identity:get_user(user_id=5482c6498cf441ea887036c68889816f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:33.555348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924abc4-2920-4914-96d6-0c79f7ca05bd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:33.557674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 118/227] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:33 2022] GET /identity/v3/users/5482c6498cf441ea887036c68889816f => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:33.566753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924abc4-2920-4914-96d6-0c79f7ca05bd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:33.570106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:33.610059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:33.654387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd29374-d030-4044-b85c-6ecefa16a0ad None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:33.723026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f9a0d-b5da-4484-8ee3-343c626776b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:33.723592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f9a0d-b5da-4484-8ee3-343c626776b6 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:33.723862 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f9a0d-b5da-4484-8ee3-343c626776b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:33.724128 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f9a0d-b5da-4484-8ee3-343c626776b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:33.743544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924abc4-2920-4914-96d6-0c79f7ca05bd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:33.747626 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f9a0d-b5da-4484-8ee3-343c626776b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-9e0f9a0d-b5da-4484-8ee3-343c626776b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:33.752514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:33.753454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:33.754286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:33.754286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:33.754286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:33.754286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:33.754286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:33.754286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:33.754286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:33.754286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:33.754286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:33.754286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:33.754286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:33.754286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:33.761988 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 110/228] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:05:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:33.762929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f9a0d-b5da-4484-8ee3-343c626776b6 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:33.782146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e6389-e91e-40cc-9fcd-23eba4b8c749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:33.782780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e6389-e91e-40cc-9fcd-23eba4b8c749 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:33.783056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e6389-e91e-40cc-9fcd-23eba4b8c749 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:33.783329 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e6389-e91e-40cc-9fcd-23eba4b8c749 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:33.784588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e6389-e91e-40cc-9fcd-23eba4b8c749 None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:33.787449 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e6389-e91e-40cc-9fcd-23eba4b8c749 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:33.789114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 119/229] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:33 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:33.797185 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e6389-e91e-40cc-9fcd-23eba4b8c749 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:33.889926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:33.922266 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e6389-e91e-40cc-9fcd-23eba4b8c749 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:33.956854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b40e55-249d-45bb-aeec-14c05af94eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:33.957518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b40e55-249d-45bb-aeec-14c05af94eb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:33.957825 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b40e55-249d-45bb-aeec-14c05af94eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:33.958096 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b40e55-249d-45bb-aeec-14c05af94eb9 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f/users/5482c6498cf441ea887036c68889816f/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:33.960121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b40e55-249d-45bb-aeec-14c05af94eb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1dee2813a11458fad814d5b53a5a15f, user_id=5482c6498cf441ea887036c68889816f, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:33.961659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b40e55-249d-45bb-aeec-14c05af94eb9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:33.984344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 120/230] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:05:33 2022] PUT /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f/users/5482c6498cf441ea887036c68889816f/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:05:33.998646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f9a0d-b5da-4484-8ee3-343c626776b6 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:34.037287 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:34.049787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f555b-f09c-42ff-8202-041a8c462cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:34.050430 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f555b-f09c-42ff-8202-041a8c462cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:34.050760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f555b-f09c-42ff-8202-041a8c462cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:34.051030 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f555b-f09c-42ff-8202-041a8c462cc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:34.051715 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f555b-f09c-42ff-8202-041a8c462cc0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:34.052010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f555b-f09c-42ff-8202-041a8c462cc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:34.053553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f555b-f09c-42ff-8202-041a8c462cc0 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:34.063188 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 111/231] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:05:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:34.069114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b40e55-249d-45bb-aeec-14c05af94eb9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:34.221383 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b40e55-249d-45bb-aeec-14c05af94eb9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:34.258839 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:34.264760 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc79cf-5d0a-44b1-a34e-2177e4f7270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:34.265465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc79cf-5d0a-44b1-a34e-2177e4f7270b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:34.266824 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc79cf-5d0a-44b1-a34e-2177e4f7270b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:34.267092 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc79cf-5d0a-44b1-a34e-2177e4f7270b None admin] PATH_INFO: `/v3/users/5482c6498cf441ea887036c68889816f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:34.268260 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc79cf-5d0a-44b1-a34e-2177e4f7270b None admin] RBAC: Authorizing `identity:get_user(user_id=5482c6498cf441ea887036c68889816f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:34.269857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc79cf-5d0a-44b1-a34e-2177e4f7270b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:34.272105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 121/232] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:34 2022] GET /identity/v3/users/5482c6498cf441ea887036c68889816f => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:34.277305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f555b-f09c-42ff-8202-041a8c462cc0 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:34.381773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f555b-f09c-42ff-8202-041a8c462cc0 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:34.416187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86725e-2b05-45b9-8694-20704ccbbdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:34.416865 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86725e-2b05-45b9-8694-20704ccbbdca None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:34.417137 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86725e-2b05-45b9-8694-20704ccbbdca None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:34.417407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86725e-2b05-45b9-8694-20704ccbbdca None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:34.418551 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86725e-2b05-45b9-8694-20704ccbbdca None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:34.420014 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86725e-2b05-45b9-8694-20704ccbbdca None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:34.422024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 112/233] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:34 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:34.430885 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc79cf-5d0a-44b1-a34e-2177e4f7270b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:34.542427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc79cf-5d0a-44b1-a34e-2177e4f7270b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:34.580818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a44ad-103b-44bf-b45e-7aa7319be157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:34.581550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a44ad-103b-44bf-b45e-7aa7319be157 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:34.581847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a44ad-103b-44bf-b45e-7aa7319be157 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:34.582113 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a44ad-103b-44bf-b45e-7aa7319be157 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f/users/5482c6498cf441ea887036c68889816f/roles/90f6c18c707742de8521c29b89d64215` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:34.584434 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a44ad-103b-44bf-b45e-7aa7319be157 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1dee2813a11458fad814d5b53a5a15f, user_id=5482c6498cf441ea887036c68889816f, role_id=90f6c18c707742de8521c29b89d64215)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:34.585903 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a44ad-103b-44bf-b45e-7aa7319be157 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:34.603414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 122/234] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:05:34 2022] PUT /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f/users/5482c6498cf441ea887036c68889816f/roles/90f6c18c707742de8521c29b89d64215 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:05:35.249257 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211058da-2bc4-4cdb-b76e-7d785581da03 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:35.249840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211058da-2bc4-4cdb-b76e-7d785581da03 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:35.249840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211058da-2bc4-4cdb-b76e-7d785581da03 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:35.251595 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 113/235] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:35.259335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24f22c-727c-4d7e-ab17-c00a9c780c19 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:35.259791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24f22c-727c-4d7e-ab17-c00a9c780c19 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:35.259865 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24f22c-727c-4d7e-ab17-c00a9c780c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:35.283017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8f24f22c-727c-4d7e-ab17-c00a9c780c19 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:35.284570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8f24f22c-727c-4d7e-ab17-c00a9c780c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:35.290596 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf2503-3dfb-4b30-a7b7-e74ecec4ae31 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:35.291125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf2503-3dfb-4b30-a7b7-e74ecec4ae31 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:35.291619 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf2503-3dfb-4b30-a7b7-e74ecec4ae31 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:35.293455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 114/236] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:35.298922 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365da4a0-66ba-4e3e-9f1f-501261a56456 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:35.299422 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365da4a0-66ba-4e3e-9f1f-501261a56456 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:35.299870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365da4a0-66ba-4e3e-9f1f-501261a56456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:35.325066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-365da4a0-66ba-4e3e-9f1f-501261a56456 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:35.326651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-365da4a0-66ba-4e3e-9f1f-501261a56456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:35.363038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:35.393640 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 123/237] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:35.424709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:35.431564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24f22c-727c-4d7e-ab17-c00a9c780c19 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:35.447682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 115/238] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:35.473800 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365da4a0-66ba-4e3e-9f1f-501261a56456 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:35.631753 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365da4a0-66ba-4e3e-9f1f-501261a56456 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:35.654601 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24f22c-727c-4d7e-ab17-c00a9c780c19 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:35.671083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef4fbf-8d3f-430f-b325-569569491e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:35.672053 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef4fbf-8d3f-430f-b325-569569491e75 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:35.672467 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef4fbf-8d3f-430f-b325-569569491e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:35.672927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef4fbf-8d3f-430f-b325-569569491e75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:35.674301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef4fbf-8d3f-430f-b325-569569491e75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:35.676013 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef4fbf-8d3f-430f-b325-569569491e75 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:35.677903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 116/239] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:05:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:35.679295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af285247-86a1-46b4-b4be-e1d2105a3adc None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:35.679712 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af285247-86a1-46b4-b4be-e1d2105a3adc None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:35.680118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af285247-86a1-46b4-b4be-e1d2105a3adc None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:35.681797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 117/240] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:35.687567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bed204-c2ca-4520-a048-adcb11ff94d3 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:35.688045 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bed204-c2ca-4520-a048-adcb11ff94d3 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:35.688783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bed204-c2ca-4520-a048-adcb11ff94d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:35.697426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f7ead-0de4-476a-9506-001ee0547b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:35.698086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f7ead-0de4-476a-9506-001ee0547b69 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:35.698356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f7ead-0de4-476a-9506-001ee0547b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:35.698721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f7ead-0de4-476a-9506-001ee0547b69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:35.709262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f7ead-0de4-476a-9506-001ee0547b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:35.711533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-52bed204-c2ca-4520-a048-adcb11ff94d3 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:35.712958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-52bed204-c2ca-4520-a048-adcb11ff94d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-c16f7ead-0de4-476a-9506-001ee0547b69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:35.714392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:35.715273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:35.721086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:35.721086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:35.721086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:35.721086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:35.721086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:35.721086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:35.721086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:35.721086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:35.721086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:35.721086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:35.721086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:35.721086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:35.721086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 124/241] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:35.721086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f7ead-0de4-476a-9506-001ee0547b69 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:35.774062 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:35.783965 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:35.800762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 118/242] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:35.801635 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bed204-c2ca-4520-a048-adcb11ff94d3 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:35.854480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f7ead-0de4-476a-9506-001ee0547b69 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:35.890959 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569213a-fe65-4cb7-a96d-8b4703064e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:35.891574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569213a-fe65-4cb7-a96d-8b4703064e55 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:35.891847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569213a-fe65-4cb7-a96d-8b4703064e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:35.892112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569213a-fe65-4cb7-a96d-8b4703064e55 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:35.892741 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569213a-fe65-4cb7-a96d-8b4703064e55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:35.894313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569213a-fe65-4cb7-a96d-8b4703064e55 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:35.903337 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bed204-c2ca-4520-a048-adcb11ff94d3 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:35.926025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 125/243] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:05:35 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:05:35.927014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569213a-fe65-4cb7-a96d-8b4703064e55 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:35.945160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c1a85-6b23-413a-8f90-bb1ec79bc16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:35.945906 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c1a85-6b23-413a-8f90-bb1ec79bc16f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:35.946184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c1a85-6b23-413a-8f90-bb1ec79bc16f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:35.946557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c1a85-6b23-413a-8f90-bb1ec79bc16f None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:35.947303 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c1a85-6b23-413a-8f90-bb1ec79bc16f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:35.947648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c1a85-6b23-413a-8f90-bb1ec79bc16f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:35.949224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c1a85-6b23-413a-8f90-bb1ec79bc16f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:35.959815 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 119/244] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:35.971044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c1a85-6b23-413a-8f90-bb1ec79bc16f None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:36.051065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569213a-fe65-4cb7-a96d-8b4703064e55 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:36.053871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:36.068422 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:36.095426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b263d-3bb7-47ea-afb2-b98b3115ed9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:36.096083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b263d-3bb7-47ea-afb2-b98b3115ed9d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:36.096360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b263d-3bb7-47ea-afb2-b98b3115ed9d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:36.096621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b263d-3bb7-47ea-afb2-b98b3115ed9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:36.108774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b263d-3bb7-47ea-afb2-b98b3115ed9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-b32b263d-3bb7-47ea-afb2-b98b3115ed9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:36.114111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:36.116290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:36.118456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:36.118456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:36.118456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:36.118456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:36.118456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:36.118456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:36.118456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:36.118456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:36.118456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:36.118456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:36.118456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:36.118456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:36.118456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 126/245] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:36.123770 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b263d-3bb7-47ea-afb2-b98b3115ed9d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:36.153736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c1a85-6b23-413a-8f90-bb1ec79bc16f None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:36.191603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acf2b7-531c-4e8f-8392-0eac1a44f17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:36.192260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acf2b7-531c-4e8f-8392-0eac1a44f17e None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:36.192528 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acf2b7-531c-4e8f-8392-0eac1a44f17e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:36.192797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acf2b7-531c-4e8f-8392-0eac1a44f17e None admin] PATH_INFO: `/v3/users/a3d00cfe3ac242e8af5650013882e3fa` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:36.208226 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acf2b7-531c-4e8f-8392-0eac1a44f17e None admin] RBAC: Authorizing `identity:get_user(user_id=a3d00cfe3ac242e8af5650013882e3fa)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:36.209790 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acf2b7-531c-4e8f-8392-0eac1a44f17e None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:36.211847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 120/246] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:35 2022] GET /identity/v3/users/a3d00cfe3ac242e8af5650013882e3fa => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:36.217590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acf2b7-531c-4e8f-8392-0eac1a44f17e None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:36.238667 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b263d-3bb7-47ea-afb2-b98b3115ed9d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:36.288522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49e7c1-4343-4178-b662-38aaf05a7f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:36.289722 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49e7c1-4343-4178-b662-38aaf05a7f35 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:36.289911 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49e7c1-4343-4178-b662-38aaf05a7f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:36.290265 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49e7c1-4343-4178-b662-38aaf05a7f35 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:36.293642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49e7c1-4343-4178-b662-38aaf05a7f35 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:36.293642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49e7c1-4343-4178-b662-38aaf05a7f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:36.293642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49e7c1-4343-4178-b662-38aaf05a7f35 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:36.303323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 127/247] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:36.308971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49e7c1-4343-4178-b662-38aaf05a7f35 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:36.343586 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:36.345485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acf2b7-531c-4e8f-8392-0eac1a44f17e None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:36.375135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:36.393860 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fc682-c52e-407a-8cab-ec229d29fcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:36.394675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fc682-c52e-407a-8cab-ec229d29fcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:36.395117 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fc682-c52e-407a-8cab-ec229d29fcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:36.395492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fc682-c52e-407a-8cab-ec229d29fcd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:36.444968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49e7c1-4343-4178-b662-38aaf05a7f35 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:36.488936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fc682-c52e-407a-8cab-ec229d29fcd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:36.489948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef41dd-635d-44f5-99fa-91b1fe1a4a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:36.490863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef41dd-635d-44f5-99fa-91b1fe1a4a04 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:36.491196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fc682-c52e-407a-8cab-ec229d29fcd2 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:36.491343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef41dd-635d-44f5-99fa-91b1fe1a4a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:36.491752 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef41dd-635d-44f5-99fa-91b1fe1a4a04 None admin] PATH_INFO: `/v3/users/2c3838be7e3640feb4a7241b715ea46a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:36.493695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef41dd-635d-44f5-99fa-91b1fe1a4a04 None admin] RBAC: Authorizing `identity:get_user(user_id=2c3838be7e3640feb4a7241b715ea46a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:36.495317 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef41dd-635d-44f5-99fa-91b1fe1a4a04 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:36.498331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 128/248] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:36 2022] GET /identity/v3/users/2c3838be7e3640feb4a7241b715ea46a => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:36.503736 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef41dd-635d-44f5-99fa-91b1fe1a4a04 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:36.617665 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 121/249] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:36.617665 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa380c-9e77-467e-a17a-1f5e87411745 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:36.617665 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa380c-9e77-467e-a17a-1f5e87411745 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:36.617665 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa380c-9e77-467e-a17a-1f5e87411745 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:36.619212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 122/250] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:36.620593 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa380c-9e77-467e-a17a-1f5e87411745 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:36.624468 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:36.633587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:36.636455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef41dd-635d-44f5-99fa-91b1fe1a4a04 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:36.677239 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56885f98-1213-4691-b19e-6566deb05933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:36.678313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56885f98-1213-4691-b19e-6566deb05933 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:36.678879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56885f98-1213-4691-b19e-6566deb05933 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:36.679154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56885f98-1213-4691-b19e-6566deb05933 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:36.680562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56885f98-1213-4691-b19e-6566deb05933 None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:36.682889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56885f98-1213-4691-b19e-6566deb05933 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:36.685557 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 129/251] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:36 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:36.686793 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7c3a5-9221-467e-a297-5b6022313bb9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:36.687078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7c3a5-9221-467e-a297-5b6022313bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:36.687555 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7c3a5-9221-467e-a297-5b6022313bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:36.712664 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-13b7c3a5-9221-467e-a297-5b6022313bb9 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:36.714433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-13b7c3a5-9221-467e-a297-5b6022313bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:36.778820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa380c-9e77-467e-a17a-1f5e87411745 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:36.805399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 130/252] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:36.806342 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7c3a5-9221-467e-a297-5b6022313bb9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:36.867201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ac726-35cc-4159-8f45-cd6fa3b28a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:36.867843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ac726-35cc-4159-8f45-cd6fa3b28a76 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:36.868110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ac726-35cc-4159-8f45-cd6fa3b28a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:36.868430 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ac726-35cc-4159-8f45-cd6fa3b28a76 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:36.869569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ac726-35cc-4159-8f45-cd6fa3b28a76 None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:36.871165 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ac726-35cc-4159-8f45-cd6fa3b28a76 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:36.872839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 123/253] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:36 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:36.873595 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ac726-35cc-4159-8f45-cd6fa3b28a76 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:36.949885 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:36.963642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7c3a5-9221-467e-a297-5b6022313bb9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:37.030505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:37.038665 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5da09-0ba1-4c0a-97e1-8a7b915058c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:37.039578 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5da09-0ba1-4c0a-97e1-8a7b915058c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:37.040718 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5da09-0ba1-4c0a-97e1-8a7b915058c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:37.041189 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5da09-0ba1-4c0a-97e1-8a7b915058c0 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f/users/2c3838be7e3640feb4a7241b715ea46a/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:37.045961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5da09-0ba1-4c0a-97e1-8a7b915058c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1dee2813a11458fad814d5b53a5a15f, user_id=2c3838be7e3640feb4a7241b715ea46a, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:37.047724 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5da09-0ba1-4c0a-97e1-8a7b915058c0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:37.068749 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 131/254] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:05:36 2022] PUT /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f/users/2c3838be7e3640feb4a7241b715ea46a/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:05:37.073530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5da09-0ba1-4c0a-97e1-8a7b915058c0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:37.079560 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ac726-35cc-4159-8f45-cd6fa3b28a76 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:37.159942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59366be0-b702-4af3-a6ad-0e6e5cea4612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:37.161698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59366be0-b702-4af3-a6ad-0e6e5cea4612 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:37.163567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59366be0-b702-4af3-a6ad-0e6e5cea4612 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:37.164085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59366be0-b702-4af3-a6ad-0e6e5cea4612 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:37.185360 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59366be0-b702-4af3-a6ad-0e6e5cea4612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-59366be0-b702-4af3-a6ad-0e6e5cea4612 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:37.190654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:37.191640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:37.192445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:37.192445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:37.192445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:37.192445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:37.192445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:37.192445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:37.192445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:37.192445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:37.192445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:37.192445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:37.192445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:37.192445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:37.192445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 124/255] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:05:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:37.195382 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74847ec6-e13e-4176-87ed-8dd857744117 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:37.195382 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74847ec6-e13e-4176-87ed-8dd857744117 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:37.195382 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74847ec6-e13e-4176-87ed-8dd857744117 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:37.203340 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 125/256] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:37.204822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74847ec6-e13e-4176-87ed-8dd857744117 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:37.237981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5da09-0ba1-4c0a-97e1-8a7b915058c0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:37.285493 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe8407-7991-484d-8b1c-17719408cba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:37.286566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe8407-7991-484d-8b1c-17719408cba4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:37.287036 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe8407-7991-484d-8b1c-17719408cba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:37.287562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe8407-7991-484d-8b1c-17719408cba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:37.288581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe8407-7991-484d-8b1c-17719408cba4 None admin] RBAC: Adding query filter params (role.id=cfa1c4251ba64c96bf0ddbeb03d57d77, scope.project.id=b1dee2813a11458fad814d5b53a5a15f, user.id=a3d00cfe3ac242e8af5650013882e3fa) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:37.290639 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe8407-7991-484d-8b1c-17719408cba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:37.292517 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe8407-7991-484d-8b1c-17719408cba4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:37.300192 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 132/257] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:37 2022] GET /identity/v3/role_assignments?user.id=a3d00cfe3ac242e8af5650013882e3fa&scope.project.id=b1dee2813a11458fad814d5b53a5a15f&role.id=cfa1c4251ba64c96bf0ddbeb03d57d77 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:37.301971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004eb83c-6659-4520-afe5-0951f7ad9ac7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:37.302449 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004eb83c-6659-4520-afe5-0951f7ad9ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:37.303039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004eb83c-6659-4520-afe5-0951f7ad9ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:37.329222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-004eb83c-6659-4520-afe5-0951f7ad9ac7 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:37.330800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-004eb83c-6659-4520-afe5-0951f7ad9ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:37.344421 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:37.381531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74847ec6-e13e-4176-87ed-8dd857744117 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:37.452111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 133/258] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:37.454028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052185f-51ed-49d7-bc86-6109bf84322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:37.454650 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052185f-51ed-49d7-bc86-6109bf84322c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:37.454921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052185f-51ed-49d7-bc86-6109bf84322c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:37.455187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052185f-51ed-49d7-bc86-6109bf84322c None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:37.455863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052185f-51ed-49d7-bc86-6109bf84322c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:37.456157 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052185f-51ed-49d7-bc86-6109bf84322c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:37.457607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052185f-51ed-49d7-bc86-6109bf84322c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:37.459437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:37.468800 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 126/259] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:37.474858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004eb83c-6659-4520-afe5-0951f7ad9ac7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:37.499333 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052185f-51ed-49d7-bc86-6109bf84322c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:37.631438 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004eb83c-6659-4520-afe5-0951f7ad9ac7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:37.644270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052185f-51ed-49d7-bc86-6109bf84322c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:37.689353 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44e6ba-9d54-4aeb-8c3b-2240a66736f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:37.690461 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44e6ba-9d54-4aeb-8c3b-2240a66736f8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:37.690989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44e6ba-9d54-4aeb-8c3b-2240a66736f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:37.691454 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44e6ba-9d54-4aeb-8c3b-2240a66736f8 None admin] PATH_INFO: `/v3/users/5482c6498cf441ea887036c68889816f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:37.692886 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44e6ba-9d54-4aeb-8c3b-2240a66736f8 None admin] RBAC: Authorizing `identity:get_user(user_id=5482c6498cf441ea887036c68889816f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:37.694649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44e6ba-9d54-4aeb-8c3b-2240a66736f8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:37.696987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 134/260] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:37 2022] GET /identity/v3/users/5482c6498cf441ea887036c68889816f => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:37.704143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44e6ba-9d54-4aeb-8c3b-2240a66736f8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:37.727806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca93043-bf69-4c28-a832-b2875c554024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:37.728465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca93043-bf69-4c28-a832-b2875c554024 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:37.728738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca93043-bf69-4c28-a832-b2875c554024 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:37.729003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca93043-bf69-4c28-a832-b2875c554024 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:37.734409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:37.762934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca93043-bf69-4c28-a832-b2875c554024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-dca93043-bf69-4c28-a832-b2875c554024 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:37.768763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:37.769778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:37.770578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:37.770578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:37.770578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:37.770578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:37.770578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:37.770578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:37.770578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:37.770578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:37.770578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:37.770578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:37.770578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:37.770578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:37.780079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 127/261] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:05:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:37.786160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca93043-bf69-4c28-a832-b2875c554024 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:37.890245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:37.906257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44e6ba-9d54-4aeb-8c3b-2240a66736f8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:37.951783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca93043-bf69-4c28-a832-b2875c554024 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:37.991361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8c351-93b9-4607-824a-3f1643069ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:37.992365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8c351-93b9-4607-824a-3f1643069ade None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:37.992830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8c351-93b9-4607-824a-3f1643069ade None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:37.993332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8c351-93b9-4607-824a-3f1643069ade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:38.000186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064cb8c-ee28-4172-bba1-52ff0a555cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:38.000186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064cb8c-ee28-4172-bba1-52ff0a555cea None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:38.000186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064cb8c-ee28-4172-bba1-52ff0a555cea None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:38.000186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064cb8c-ee28-4172-bba1-52ff0a555cea None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:38.000542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064cb8c-ee28-4172-bba1-52ff0a555cea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:38.000769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064cb8c-ee28-4172-bba1-52ff0a555cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:38.002972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064cb8c-ee28-4172-bba1-52ff0a555cea None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:38.023768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 128/262] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:05:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:38.023768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064cb8c-ee28-4172-bba1-52ff0a555cea None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:38.137779 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064cb8c-ee28-4172-bba1-52ff0a555cea None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:38.159232 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:38.177907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8c351-93b9-4607-824a-3f1643069ade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:38.178407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb23af7-1b7a-4653-ba0c-e4979c87abfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:38.179308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb23af7-1b7a-4653-ba0c-e4979c87abfc None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:38.179443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8c351-93b9-4607-824a-3f1643069ade None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:38.179718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb23af7-1b7a-4653-ba0c-e4979c87abfc None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:38.180059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb23af7-1b7a-4653-ba0c-e4979c87abfc None admin] PATH_INFO: `/v3/users/5482c6498cf441ea887036c68889816f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:38.183467 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb23af7-1b7a-4653-ba0c-e4979c87abfc None admin] RBAC: Authorizing `identity:get_user(user_id=5482c6498cf441ea887036c68889816f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:38.184957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb23af7-1b7a-4653-ba0c-e4979c87abfc None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:38.187970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 129/263] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:38 2022] GET /identity/v3/users/5482c6498cf441ea887036c68889816f => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:38.192850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb23af7-1b7a-4653-ba0c-e4979c87abfc None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:38.218817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:38.314864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb23af7-1b7a-4653-ba0c-e4979c87abfc None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:38.362805 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f5353-d4e7-4620-a3c1-729ba73c3b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:38.363664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f5353-d4e7-4620-a3c1-729ba73c3b96 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:38.363984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f5353-d4e7-4620-a3c1-729ba73c3b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:38.364260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f5353-d4e7-4620-a3c1-729ba73c3b96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:38.428496 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 135/264] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:05:38.435095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8c351-93b9-4607-824a-3f1643069ade None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:38.437659 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:38.462147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f5353-d4e7-4620-a3c1-729ba73c3b96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:38.464752 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f5353-d4e7-4620-a3c1-729ba73c3b96 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:38.665886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 130/265] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:05:38.671768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f5353-d4e7-4620-a3c1-729ba73c3b96 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:38.705393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8c351-93b9-4607-824a-3f1643069ade None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:38.736353 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:38.802357 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fac899-bcb5-4b0c-9226-e0be1c867a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:38.803069 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fac899-bcb5-4b0c-9226-e0be1c867a2b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:38.803341 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fac899-bcb5-4b0c-9226-e0be1c867a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:38.804913 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fac899-bcb5-4b0c-9226-e0be1c867a2b None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:38.810374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fac899-bcb5-4b0c-9226-e0be1c867a2b None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:38.811820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fac899-bcb5-4b0c-9226-e0be1c867a2b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:38.813494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 136/266] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:38 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:38.822764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fac899-bcb5-4b0c-9226-e0be1c867a2b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:38.837268 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:38.870257 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f5353-d4e7-4620-a3c1-729ba73c3b96 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:38.946013 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cbc92-ce44-4139-945f-ca1294d344aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:38.946626 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cbc92-ce44-4139-945f-ca1294d344aa None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:38.946899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cbc92-ce44-4139-945f-ca1294d344aa None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:38.947166 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cbc92-ce44-4139-945f-ca1294d344aa None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:38.948438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cbc92-ce44-4139-945f-ca1294d344aa None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:38.949930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cbc92-ce44-4139-945f-ca1294d344aa None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:38.954226 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 131/267] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:38 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:38.955677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852dbb3-0614-460d-bf7f-95e56e77bdb6 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:38.955954 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852dbb3-0614-460d-bf7f-95e56e77bdb6 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:38.956221 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1852dbb3-0614-460d-bf7f-95e56e77bdb6 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:38.960988 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 132/268] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:38.961637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852dbb3-0614-460d-bf7f-95e56e77bdb6 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:39.036146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fac899-bcb5-4b0c-9226-e0be1c867a2b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:39.074675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3d257-9122-47b0-b312-d2c1b2430273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:39.075658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3d257-9122-47b0-b312-d2c1b2430273 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:39.076128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3d257-9122-47b0-b312-d2c1b2430273 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:39.076633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3d257-9122-47b0-b312-d2c1b2430273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:39.077559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3d257-9122-47b0-b312-d2c1b2430273 None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=b1dee2813a11458fad814d5b53a5a15f, user.id=5482c6498cf441ea887036c68889816f) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:39.078078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3d257-9122-47b0-b312-d2c1b2430273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:39.079826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3d257-9122-47b0-b312-d2c1b2430273 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:39.087436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 137/269] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:38 2022] GET /identity/v3/role_assignments?user.id=5482c6498cf441ea887036c68889816f&scope.project.id=b1dee2813a11458fad814d5b53a5a15f&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:39.089059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca94a98-d6e8-4d5f-9bbe-6ee8797065da None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:39.089712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca94a98-d6e8-4d5f-9bbe-6ee8797065da None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:39.090178 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca94a98-d6e8-4d5f-9bbe-6ee8797065da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:39.110268 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fca94a98-d6e8-4d5f-9bbe-6ee8797065da None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:39.112007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fca94a98-d6e8-4d5f-9bbe-6ee8797065da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:39.155779 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1852dbb3-0614-460d-bf7f-95e56e77bdb6 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:39.163737 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:39.194117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 138/270] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:39.216355 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b70b1a-6b50-4b2d-9616-68d1b0caf27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:39.217281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b70b1a-6b50-4b2d-9616-68d1b0caf27f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:39.217783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b70b1a-6b50-4b2d-9616-68d1b0caf27f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:39.218254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b70b1a-6b50-4b2d-9616-68d1b0caf27f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:39.219171 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b70b1a-6b50-4b2d-9616-68d1b0caf27f None admin] RBAC: Adding query filter params (role.id=90f6c18c707742de8521c29b89d64215, scope.project.id=b1dee2813a11458fad814d5b53a5a15f, user.id=5482c6498cf441ea887036c68889816f) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:39.219652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b70b1a-6b50-4b2d-9616-68d1b0caf27f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:39.221399 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b70b1a-6b50-4b2d-9616-68d1b0caf27f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:39.236430 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca94a98-d6e8-4d5f-9bbe-6ee8797065da None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:39.237242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 133/271] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:38 2022] GET /identity/v3/role_assignments?user.id=5482c6498cf441ea887036c68889816f&scope.project.id=b1dee2813a11458fad814d5b53a5a15f&role.id=90f6c18c707742de8521c29b89d64215 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:39.392585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca94a98-d6e8-4d5f-9bbe-6ee8797065da None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:39.434366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce4f17-0e70-4737-861f-66423fb94c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:39.435813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce4f17-0e70-4737-861f-66423fb94c44 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:39.436282 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce4f17-0e70-4737-861f-66423fb94c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:39.436724 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce4f17-0e70-4737-861f-66423fb94c44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:39.449730 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce4f17-0e70-4737-861f-66423fb94c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-11ce4f17-0e70-4737-861f-66423fb94c44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:39.454999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:39.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:39.456763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:39.456763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:39.456763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:39.456763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:39.456763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:39.456763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:39.456763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:39.456763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:39.456763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:39.456763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:39.456763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:39.456763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:39.459314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 139/272] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:39.471387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b70b1a-6b50-4b2d-9616-68d1b0caf27f None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:39.512645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:39.634015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b70b1a-6b50-4b2d-9616-68d1b0caf27f None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:39.673030 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2d29b-b531-46e5-be2c-abeb9d60e8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:39.673694 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d29b-b531-46e5-be2c-abeb9d60e8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:39.673968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d29b-b531-46e5-be2c-abeb9d60e8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:39.674233 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d29b-b531-46e5-be2c-abeb9d60e8c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:39.674920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2d29b-b531-46e5-be2c-abeb9d60e8c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:39.675218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2d29b-b531-46e5-be2c-abeb9d60e8c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:39.676614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2d29b-b531-46e5-be2c-abeb9d60e8c2 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:39.690714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 134/273] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:39.696191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce4f17-0e70-4737-861f-66423fb94c44 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:39.740311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:39.824080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce4f17-0e70-4737-861f-66423fb94c44 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:39.871053 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb52838-c27f-4296-8a82-e4a674a6bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:39.871709 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb52838-c27f-4296-8a82-e4a674a6bb3f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:39.871985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb52838-c27f-4296-8a82-e4a674a6bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:39.872255 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb52838-c27f-4296-8a82-e4a674a6bb3f None admin] PATH_INFO: `/v3/users/64fbe653bf344b0595ec17b4a900e6fe` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:39.877196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb2e88-4bd3-4fdd-b6ac-a514d1b332ec None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:39.877761 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb2e88-4bd3-4fdd-b6ac-a514d1b332ec None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:39.878048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb2e88-4bd3-4fdd-b6ac-a514d1b332ec None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:39.879549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 135/274] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:39.880861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec446cd-ecfa-44a7-88a9-596c56fd4707 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:39.881135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec446cd-ecfa-44a7-88a9-596c56fd4707 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:39.881407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec446cd-ecfa-44a7-88a9-596c56fd4707 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:39.894609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb52838-c27f-4296-8a82-e4a674a6bb3f None admin] RBAC: Authorizing `identity:get_user(user_id=64fbe653bf344b0595ec17b4a900e6fe)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:39.895056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb52838-c27f-4296-8a82-e4a674a6bb3f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:39.895338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 136/275] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:39.897738 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 140/276] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:39 2022] GET /identity/v3/users/64fbe653bf344b0595ec17b4a900e6fe => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:39.899064 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e9e06-59fb-47f0-a1a8-e7b4b747cf4d None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:39.899816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e9e06-59fb-47f0-a1a8-e7b4b747cf4d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:39.900441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e9e06-59fb-47f0-a1a8-e7b4b747cf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:39.902576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc5616-6e73-4d23-946e-e619d24a16d4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:39.902785 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc5616-6e73-4d23-946e-e619d24a16d4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:39.903032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc5616-6e73-4d23-946e-e619d24a16d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:39.922350 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-00cc5616-6e73-4d23-946e-e619d24a16d4 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:39.923606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-00cc5616-6e73-4d23-946e-e619d24a16d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:39.925584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-3e2e9e06-59fb-47f0-a1a8-e7b4b747cf4d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:39.926819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3e2e9e06-59fb-47f0-a1a8-e7b4b747cf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:40.017751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 141/277] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:40.017751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc5616-6e73-4d23-946e-e619d24a16d4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:40.032046 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 137/278] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:40.033381 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e9e06-59fb-47f0-a1a8-e7b4b747cf4d None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:40.048045 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:40.048656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:40.148248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc5616-6e73-4d23-946e-e619d24a16d4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:40.160519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e9e06-59fb-47f0-a1a8-e7b4b747cf4d None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:40.196861 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d5a7e-fb9f-471f-a30d-0daadf1a8405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:40.197888 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d5a7e-fb9f-471f-a30d-0daadf1a8405 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:40.198381 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d5a7e-fb9f-471f-a30d-0daadf1a8405 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:40.198853 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d5a7e-fb9f-471f-a30d-0daadf1a8405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:40.199234 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f37c7d-8f9b-4ca3-bc16-0e6e10f157ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:40.199870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37c7d-8f9b-4ca3-bc16-0e6e10f157ba None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:40.200140 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37c7d-8f9b-4ca3-bc16-0e6e10f157ba None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:40.200229 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d5a7e-fb9f-471f-a30d-0daadf1a8405 None admin] RBAC: Adding query filter params (role.id=186990d6368647b5b0712c4fedf4afd9, user.id=64fbe653bf344b0595ec17b4a900e6fe, scope.system=all) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:40.200401 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37c7d-8f9b-4ca3-bc16-0e6e10f157ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:40.200653 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d5a7e-fb9f-471f-a30d-0daadf1a8405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:40.203144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d5a7e-fb9f-471f-a30d-0daadf1a8405 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:40.217653 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 142/279] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Aug 9 11:05:40 2022] GET /identity/v3/role_assignments?user.id=64fbe653bf344b0595ec17b4a900e6fe&scope.system=all&role.id=186990d6368647b5b0712c4fedf4afd9 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:40.217653 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d5a7e-fb9f-471f-a30d-0daadf1a8405 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:40.222626 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f37c7d-8f9b-4ca3-bc16-0e6e10f157ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-a0f37c7d-8f9b-4ca3-bc16-0e6e10f157ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:40.227741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:40.228709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:40.229519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:40.229519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:40.229519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:40.229519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:40.229519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:40.229519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:40.229519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:40.229519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:40.229519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:40.229519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:40.229519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:40.229519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:40.229519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 138/280] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:40.242727 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f37c7d-8f9b-4ca3-bc16-0e6e10f157ba None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:40.346861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:40.349446 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:40.366639 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d5a7e-fb9f-471f-a30d-0daadf1a8405 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:40.397096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f37c7d-8f9b-4ca3-bc16-0e6e10f157ba None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:40.411415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bd196-b7b5-4dce-bcf9-51403b85af20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:40.412697 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bd196-b7b5-4dce-bcf9-51403b85af20 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:40.413334 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bd196-b7b5-4dce-bcf9-51403b85af20 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:40.414130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bd196-b7b5-4dce-bcf9-51403b85af20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:40.415717 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bd196-b7b5-4dce-bcf9-51403b85af20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:40.417378 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bd196-b7b5-4dce-bcf9-51403b85af20 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:40.419297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 143/281] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:05:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:40.424940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b68de-25d4-4440-9d43-0c956cf0eae5 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:40.425236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b68de-25d4-4440-9d43-0c956cf0eae5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:40.425544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b68de-25d4-4440-9d43-0c956cf0eae5 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:40.427048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 144/282] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:05:40.428189 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b68de-25d4-4440-9d43-0c956cf0eae5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:40.446796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1d2ec-f2e1-4acc-80bc-78a1becd629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:40.447404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1d2ec-f2e1-4acc-80bc-78a1becd629e None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:40.447670 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1d2ec-f2e1-4acc-80bc-78a1becd629e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:40.447932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1d2ec-f2e1-4acc-80bc-78a1becd629e None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:40.448587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1d2ec-f2e1-4acc-80bc-78a1becd629e None admin] RBAC: Adding query filter params (name=member) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:40.448879 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1d2ec-f2e1-4acc-80bc-78a1becd629e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:40.450336 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1d2ec-f2e1-4acc-80bc-78a1becd629e None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:40.459609 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 139/283] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:40.460969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e1492-8e9e-4a43-917e-8a4865d5583a None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:40.461243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e1492-8e9e-4a43-917e-8a4865d5583a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:40.461504 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e1492-8e9e-4a43-917e-8a4865d5583a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:40.483141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-146e1492-8e9e-4a43-917e-8a4865d5583a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:40.484342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-146e1492-8e9e-4a43-917e-8a4865d5583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:40.571945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b68de-25d4-4440-9d43-0c956cf0eae5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:40.589665 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 140/284] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:40.589665 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e1492-8e9e-4a43-917e-8a4865d5583a None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:40.623360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444aa1d9-b563-43e6-9a53-75eb8db2fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:40.624007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444aa1d9-b563-43e6-9a53-75eb8db2fde1 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:40.624277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444aa1d9-b563-43e6-9a53-75eb8db2fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:40.624543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444aa1d9-b563-43e6-9a53-75eb8db2fde1 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:40.625191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444aa1d9-b563-43e6-9a53-75eb8db2fde1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:40.626680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444aa1d9-b563-43e6-9a53-75eb8db2fde1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:40.649966 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 145/285] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:05:40 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:05:40.650802 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444aa1d9-b563-43e6-9a53-75eb8db2fde1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:40.679498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:40.680877 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:40.738412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e1492-8e9e-4a43-917e-8a4865d5583a None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:40.778336 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d068d-750e-4615-859e-af0ddcb53524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:40.778990 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d068d-750e-4615-859e-af0ddcb53524 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:40.779263 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d068d-750e-4615-859e-af0ddcb53524 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:40.779529 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d068d-750e-4615-859e-af0ddcb53524 None admin] PATH_INFO: `/v3/users/2c3838be7e3640feb4a7241b715ea46a` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:40.780850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d068d-750e-4615-859e-af0ddcb53524 None admin] RBAC: Authorizing `identity:get_user(user_id=2c3838be7e3640feb4a7241b715ea46a)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:40.782510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d068d-750e-4615-859e-af0ddcb53524 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:40.784211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 141/286] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:40 2022] GET /identity/v3/users/2c3838be7e3640feb4a7241b715ea46a => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:40.790243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d068d-750e-4615-859e-af0ddcb53524 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:40.806402 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444aa1d9-b563-43e6-9a53-75eb8db2fde1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:40.859904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2c0d0-7a64-4d73-94ef-8d53a3792f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:40.860871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2c0d0-7a64-4d73-94ef-8d53a3792f04 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:40.861141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2c0d0-7a64-4d73-94ef-8d53a3792f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:40.861413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2c0d0-7a64-4d73-94ef-8d53a3792f04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:40.874215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2c0d0-7a64-4d73-94ef-8d53a3792f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-66a2c0d0-7a64-4d73-94ef-8d53a3792f04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:40.881001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:40.881971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:40.882778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:40.882778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:40.882778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:40.882778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:40.882778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:40.882778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:40.882778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:40.882778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:40.882778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:40.882778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:40.882778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:40.882778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:40.882778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 146/287] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:40.888090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2c0d0-7a64-4d73-94ef-8d53a3792f04 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:40.929434 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d068d-750e-4615-859e-af0ddcb53524 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:40.969397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:40.977718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16307649-6138-4587-8c23-b9ae75445506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:40.978700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307649-6138-4587-8c23-b9ae75445506 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:40.979172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307649-6138-4587-8c23-b9ae75445506 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:40.979644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16307649-6138-4587-8c23-b9ae75445506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:40.986738 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:41.023655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2c0d0-7a64-4d73-94ef-8d53a3792f04 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:41.065590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16307649-6138-4587-8c23-b9ae75445506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:41.067255 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394bcf8-a074-48fb-a411-bb7b3cc82013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:41.067403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16307649-6138-4587-8c23-b9ae75445506 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:41.067885 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394bcf8-a074-48fb-a411-bb7b3cc82013 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:41.068162 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394bcf8-a074-48fb-a411-bb7b3cc82013 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:41.068443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394bcf8-a074-48fb-a411-bb7b3cc82013 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:41.069214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394bcf8-a074-48fb-a411-bb7b3cc82013 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:41.069709 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394bcf8-a074-48fb-a411-bb7b3cc82013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:41.071407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394bcf8-a074-48fb-a411-bb7b3cc82013 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:41.081300 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 147/288] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:41.087091 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394bcf8-a074-48fb-a411-bb7b3cc82013 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:41.182194 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 142/289] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:05:41.187931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16307649-6138-4587-8c23-b9ae75445506 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:41.222027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:41.304736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16307649-6138-4587-8c23-b9ae75445506 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:41.319635 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394bcf8-a074-48fb-a411-bb7b3cc82013 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:41.345576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aed2e8-f3b1-4cb0-9dc3-a52f7e56698c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:41.346558 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aed2e8-f3b1-4cb0-9dc3-a52f7e56698c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:41.347051 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aed2e8-f3b1-4cb0-9dc3-a52f7e56698c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:41.347421 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aed2e8-f3b1-4cb0-9dc3-a52f7e56698c None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:41.348729 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aed2e8-f3b1-4cb0-9dc3-a52f7e56698c None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:41.350614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aed2e8-f3b1-4cb0-9dc3-a52f7e56698c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:41.353608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 143/290] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:41 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:41.359543 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aed2e8-f3b1-4cb0-9dc3-a52f7e56698c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:41.434622 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ded7f-10d0-4fba-bf46-805fac748a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:41.435164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ded7f-10d0-4fba-bf46-805fac748a1c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:41.435437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ded7f-10d0-4fba-bf46-805fac748a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:41.435701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ded7f-10d0-4fba-bf46-805fac748a1c None admin] PATH_INFO: `/v3/users/a3d00cfe3ac242e8af5650013882e3fa` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:41.438433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ded7f-10d0-4fba-bf46-805fac748a1c None admin] RBAC: Authorizing `identity:get_user(user_id=a3d00cfe3ac242e8af5650013882e3fa)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:41.440236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ded7f-10d0-4fba-bf46-805fac748a1c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:41.442338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 148/291] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:41 2022] GET /identity/v3/users/a3d00cfe3ac242e8af5650013882e3fa => generated 297 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:41.447803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ded7f-10d0-4fba-bf46-805fac748a1c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:41.451218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:41.473166 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:41.477863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aed2e8-f3b1-4cb0-9dc3-a52f7e56698c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:41.521205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dba27c-ccf2-4801-a50a-cac98662388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:41.522646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dba27c-ccf2-4801-a50a-cac98662388b None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:41.523119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dba27c-ccf2-4801-a50a-cac98662388b None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:41.523616 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dba27c-ccf2-4801-a50a-cac98662388b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:41.524616 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dba27c-ccf2-4801-a50a-cac98662388b None admin] RBAC: Adding query filter params (role.id=186990d6368647b5b0712c4fedf4afd9, scope.project.id=b1dee2813a11458fad814d5b53a5a15f, user.id=2c3838be7e3640feb4a7241b715ea46a) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:41.525129 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dba27c-ccf2-4801-a50a-cac98662388b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:41.527041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dba27c-ccf2-4801-a50a-cac98662388b None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:41.535333 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 144/292] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:41 2022] GET /identity/v3/role_assignments?user.id=2c3838be7e3640feb4a7241b715ea46a&scope.project.id=b1dee2813a11458fad814d5b53a5a15f&role.id=186990d6368647b5b0712c4fedf4afd9 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:41.649769 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ded7f-10d0-4fba-bf46-805fac748a1c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:41.699631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70e5c8-4201-458d-aef6-1f866a8306d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:41.700205 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70e5c8-4201-458d-aef6-1f866a8306d4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:41.700481 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70e5c8-4201-458d-aef6-1f866a8306d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:41.700822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70e5c8-4201-458d-aef6-1f866a8306d4 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:41.701981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70e5c8-4201-458d-aef6-1f866a8306d4 None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:41.703432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70e5c8-4201-458d-aef6-1f866a8306d4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:41.705407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 149/293] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:41 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:41.711097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dba27c-ccf2-4801-a50a-cac98662388b None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:41.857023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dba27c-ccf2-4801-a50a-cac98662388b None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:41.896485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efeb9b3-63dd-489c-8e08-8524fcdb6e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:41.897569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efeb9b3-63dd-489c-8e08-8524fcdb6e3d None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:41.898111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efeb9b3-63dd-489c-8e08-8524fcdb6e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:41.898641 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efeb9b3-63dd-489c-8e08-8524fcdb6e3d None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f/users/a3d00cfe3ac242e8af5650013882e3fa/roles/cfa1c4251ba64c96bf0ddbeb03d57d77` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:41.900897 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efeb9b3-63dd-489c-8e08-8524fcdb6e3d None admin] RBAC: Authorizing `identity:create_grant(project_id=b1dee2813a11458fad814d5b53a5a15f, user_id=a3d00cfe3ac242e8af5650013882e3fa, role_id=cfa1c4251ba64c96bf0ddbeb03d57d77)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:41.902621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efeb9b3-63dd-489c-8e08-8524fcdb6e3d None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:41.919859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 145/294] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:05:41 2022] PUT /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f/users/a3d00cfe3ac242e8af5650013882e3fa/roles/cfa1c4251ba64c96bf0ddbeb03d57d77 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:05:42.299786 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e0ab7-3c54-4df2-97d7-9b7db58d78ad None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:42.300216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e0ab7-3c54-4df2-97d7-9b7db58d78ad None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:42.300316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e0ab7-3c54-4df2-97d7-9b7db58d78ad None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:42.302087 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 150/295] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:42.308124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774baa5b-6da8-4bce-b58d-aba11b75f738 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:42.308446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774baa5b-6da8-4bce-b58d-aba11b75f738 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:42.308664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774baa5b-6da8-4bce-b58d-aba11b75f738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:42.327497 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-774baa5b-6da8-4bce-b58d-aba11b75f738 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:42.328709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-774baa5b-6da8-4bce-b58d-aba11b75f738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:42.346895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:42.399163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 146/296] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:42.421105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e0ab7-3c54-4df2-97d7-9b7db58d78ad None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:42.495149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:42.529962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e0ab7-3c54-4df2-97d7-9b7db58d78ad None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:42.565205 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66e805-06fd-4402-8b5e-7804e5ec2753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:42.565773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66e805-06fd-4402-8b5e-7804e5ec2753 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:42.566055 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66e805-06fd-4402-8b5e-7804e5ec2753 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:42.566327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66e805-06fd-4402-8b5e-7804e5ec2753 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:42.577339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66e805-06fd-4402-8b5e-7804e5ec2753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-6c66e805-06fd-4402-8b5e-7804e5ec2753 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:42.582541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:42.583419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:42.584443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:42.584443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:42.584443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:42.584443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:42.584443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:42.584443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:42.584443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:42.584443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:42.584443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:42.584443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:42.584443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:42.584443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:42.584443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 151/297] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:42.589770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774baa5b-6da8-4bce-b58d-aba11b75f738 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:42.697852 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774baa5b-6da8-4bce-b58d-aba11b75f738 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:42.733321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e16af8-d75a-48a3-b168-6e77bf04c034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:42.733975 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e16af8-d75a-48a3-b168-6e77bf04c034 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:42.734249 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e16af8-d75a-48a3-b168-6e77bf04c034 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:42.734510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e16af8-d75a-48a3-b168-6e77bf04c034 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:42.735182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e16af8-d75a-48a3-b168-6e77bf04c034 None admin] RBAC: Adding query filter params (name=member) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:42.735480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e16af8-d75a-48a3-b168-6e77bf04c034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:42.736904 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e16af8-d75a-48a3-b168-6e77bf04c034 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:42.746998 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 147/298] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:42.755227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66e805-06fd-4402-8b5e-7804e5ec2753 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:42.862843 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66e805-06fd-4402-8b5e-7804e5ec2753 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:42.893170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:42.899689 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18377c7d-a1f7-4287-8ed8-931fe9ccf5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:42.900529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18377c7d-a1f7-4287-8ed8-931fe9ccf5fe None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:42.900959 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18377c7d-a1f7-4287-8ed8-931fe9ccf5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:42.901428 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18377c7d-a1f7-4287-8ed8-931fe9ccf5fe None admin] PATH_INFO: `/v3/users/64fbe653bf344b0595ec17b4a900e6fe` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:42.902640 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18377c7d-a1f7-4287-8ed8-931fe9ccf5fe None admin] RBAC: Authorizing `identity:get_user(user_id=64fbe653bf344b0595ec17b4a900e6fe)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:42.904150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18377c7d-a1f7-4287-8ed8-931fe9ccf5fe None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:42.906087 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 152/299] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:42 2022] GET /identity/v3/users/64fbe653bf344b0595ec17b4a900e6fe => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:42.914800 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e16af8-d75a-48a3-b168-6e77bf04c034 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:42.934022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:43.023419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e16af8-d75a-48a3-b168-6e77bf04c034 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:43.060482 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5da422-1005-47f8-8e04-2226ca80cb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:43.061148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5da422-1005-47f8-8e04-2226ca80cb1a None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:43.061501 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5da422-1005-47f8-8e04-2226ca80cb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:43.061705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5da422-1005-47f8-8e04-2226ca80cb1a None admin] PATH_INFO: `/v3/system/users/64fbe653bf344b0595ec17b4a900e6fe/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:43.063153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5da422-1005-47f8-8e04-2226ca80cb1a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=64fbe653bf344b0595ec17b4a900e6fe, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:43.064614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5da422-1005-47f8-8e04-2226ca80cb1a None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:43.075521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 148/300] 10.222.0.15 () {58 vars in 1334 bytes} [Tue Aug 9 11:05:42 2022] PUT /identity/v3/system/users/64fbe653bf344b0595ec17b4a900e6fe/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:05:43.185061 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340d45b-0903-4d97-aa9f-51ea1346e5e2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:43.185236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340d45b-0903-4d97-aa9f-51ea1346e5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:43.185515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340d45b-0903-4d97-aa9f-51ea1346e5e2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:43.187212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 153/301] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:43.192562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cdc06-663e-42a0-ad3a-c919f4d19f2d None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:43.192864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cdc06-663e-42a0-ad3a-c919f4d19f2d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:43.192954 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b102031-97dc-4323-b53a-2635613069da None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:43.193124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cdc06-663e-42a0-ad3a-c919f4d19f2d None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:43.193211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b102031-97dc-4323-b53a-2635613069da None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:43.193403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b102031-97dc-4323-b53a-2635613069da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:43.194822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 149/302] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:43.200894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2494fe-c694-4051-aa90-3543f7542072 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:43.201234 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2494fe-c694-4051-aa90-3543f7542072 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:43.202485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2494fe-c694-4051-aa90-3543f7542072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:43.214231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3b102031-97dc-4323-b53a-2635613069da None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:43.215624 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3b102031-97dc-4323-b53a-2635613069da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:43.225224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-4e2494fe-c694-4051-aa90-3543f7542072 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:43.227056 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-4e2494fe-c694-4051-aa90-3543f7542072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:43.299332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 154/303] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:43.312781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 150/304] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:43.322048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b102031-97dc-4323-b53a-2635613069da None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:43.337893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2494fe-c694-4051-aa90-3543f7542072 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:43.349042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:43.450766 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b102031-97dc-4323-b53a-2635613069da None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:43.467867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2494fe-c694-4051-aa90-3543f7542072 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:43.485026 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:43.496393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386df05-138b-4146-bb64-f39e9a1ff96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:43.497528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386df05-138b-4146-bb64-f39e9a1ff96d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:43.498023 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386df05-138b-4146-bb64-f39e9a1ff96d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:43.498470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386df05-138b-4146-bb64-f39e9a1ff96d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:43.499890 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386df05-138b-4146-bb64-f39e9a1ff96d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:43.501665 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386df05-138b-4146-bb64-f39e9a1ff96d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:43.509318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 155/305] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:05:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:43.510716 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386df05-138b-4146-bb64-f39e9a1ff96d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:43.519386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8432f-9a10-4d98-9f84-3451ae038c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:43.520130 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8432f-9a10-4d98-9f84-3451ae038c8b None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:43.520417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8432f-9a10-4d98-9f84-3451ae038c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:43.520680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8432f-9a10-4d98-9f84-3451ae038c8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:43.534584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8432f-9a10-4d98-9f84-3451ae038c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-c1b8432f-9a10-4d98-9f84-3451ae038c8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:43.540318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:43.541243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:43.542557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:43.542557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:43.542557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:43.542557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:43.542557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:43.542557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:43.542557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:43.542557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:43.542557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:43.542557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:43.542557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:43.542557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:43.545737 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 151/306] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:05:43.548313 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8432f-9a10-4d98-9f84-3451ae038c8b None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:43.626423 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:43.641365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386df05-138b-4146-bb64-f39e9a1ff96d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:43.664216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8432f-9a10-4d98-9f84-3451ae038c8b None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:43.676770 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc5959-c171-4369-80ef-955a4a2df8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:43.677788 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc5959-c171-4369-80ef-955a4a2df8b5 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:43.678292 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc5959-c171-4369-80ef-955a4a2df8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:43.678813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc5959-c171-4369-80ef-955a4a2df8b5 None admin] PATH_INFO: `/v3/groups` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:43.679640 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc5959-c171-4369-80ef-955a4a2df8b5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:43.681551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc5959-c171-4369-80ef-955a4a2df8b5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:43.701638 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 156/307] 10.222.0.15 () {60 vars in 1134 bytes} [Tue Aug 9 11:05:43 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:05:43.711467 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a1387-c4da-4116-aa35-0e4ec23d7549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:43.712675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a1387-c4da-4116-aa35-0e4ec23d7549 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:43.713220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a1387-c4da-4116-aa35-0e4ec23d7549 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:43.713729 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a1387-c4da-4116-aa35-0e4ec23d7549 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:43.714690 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a1387-c4da-4116-aa35-0e4ec23d7549 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:43.715272 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a1387-c4da-4116-aa35-0e4ec23d7549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:43.717068 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a1387-c4da-4116-aa35-0e4ec23d7549 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:43.728462 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 152/308] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:43.735544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc5959-c171-4369-80ef-955a4a2df8b5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:43.806623 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:43.856674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc5959-c171-4369-80ef-955a4a2df8b5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:43.894130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec22cd4-5ea9-4058-be3a-00f1c4d33800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:43.895262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec22cd4-5ea9-4058-be3a-00f1c4d33800 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:43.895535 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec22cd4-5ea9-4058-be3a-00f1c4d33800 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:43.895804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec22cd4-5ea9-4058-be3a-00f1c4d33800 None admin] PATH_INFO: `/v3/users/b843a4a4c40741a89dde13c1e24d0e58` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:43.911894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec22cd4-5ea9-4058-be3a-00f1c4d33800 None admin] RBAC: Authorizing `identity:get_user(user_id=b843a4a4c40741a89dde13c1e24d0e58)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:43.913379 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec22cd4-5ea9-4058-be3a-00f1c4d33800 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:43.915568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 157/309] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:43 2022] GET /identity/v3/users/b843a4a4c40741a89dde13c1e24d0e58 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:43.921176 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a1387-c4da-4116-aa35-0e4ec23d7549 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:44.029456 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a1387-c4da-4116-aa35-0e4ec23d7549 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:44.062094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661b131-a1d5-47b8-aa46-343c2c25e22d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:44.062286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:44.062820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661b131-a1d5-47b8-aa46-343c2c25e22d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:44.063281 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661b131-a1d5-47b8-aa46-343c2c25e22d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:44.064828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 158/310] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:05:44.068681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bc500-caa5-410b-9bad-a9bd13dcaff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:44.069299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bc500-caa5-410b-9bad-a9bd13dcaff6 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:44.069590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bc500-caa5-410b-9bad-a9bd13dcaff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:44.069887 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bc500-caa5-410b-9bad-a9bd13dcaff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:44.070445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af92c2-9ea4-4c43-b73d-3a3d8ea82201 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:44.070620 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bc500-caa5-410b-9bad-a9bd13dcaff6 None admin] RBAC: Adding query filter params (role.id=cfa1c4251ba64c96bf0ddbeb03d57d77, user.id=b843a4a4c40741a89dde13c1e24d0e58, scope.system=all) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:44.070922 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bc500-caa5-410b-9bad-a9bd13dcaff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:44.071024 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af92c2-9ea4-4c43-b73d-3a3d8ea82201 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:44.071287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af92c2-9ea4-4c43-b73d-3a3d8ea82201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:44.073056 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bc500-caa5-410b-9bad-a9bd13dcaff6 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:44.080235 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 153/311] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Aug 9 11:05:43 2022] GET /identity/v3/role_assignments?user.id=b843a4a4c40741a89dde13c1e24d0e58&scope.system=all&role.id=cfa1c4251ba64c96bf0ddbeb03d57d77 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:44.101835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-81af92c2-9ea4-4c43-b73d-3a3d8ea82201 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:44.103150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-81af92c2-9ea4-4c43-b73d-3a3d8ea82201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:44.194740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 159/312] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:44.217479 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bc500-caa5-410b-9bad-a9bd13dcaff6 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:44.337828 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bc500-caa5-410b-9bad-a9bd13dcaff6 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:44.376652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f9cba-8957-4d33-b6b2-3fcdcaec3457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:44.377292 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f9cba-8957-4d33-b6b2-3fcdcaec3457 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:44.377565 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f9cba-8957-4d33-b6b2-3fcdcaec3457 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:44.377922 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f9cba-8957-4d33-b6b2-3fcdcaec3457 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:44.389436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f9cba-8957-4d33-b6b2-3fcdcaec3457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-7f9f9cba-8957-4d33-b6b2-3fcdcaec3457 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:44.394676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:44.395574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:44.396404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:44.396404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:44.396404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:44.396404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:44.396404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:44.396404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:44.396404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:44.396404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:44.396404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:44.396404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:44.396404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:44.396404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:44.396404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 154/313] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:44.401954 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af92c2-9ea4-4c43-b73d-3a3d8ea82201 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:44.450701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:44.507471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af92c2-9ea4-4c43-b73d-3a3d8ea82201 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:44.543445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bab49-29ae-4f48-84a9-3dee3c03402f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:44.544068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bab49-29ae-4f48-84a9-3dee3c03402f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:44.544345 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bab49-29ae-4f48-84a9-3dee3c03402f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:44.544614 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bab49-29ae-4f48-84a9-3dee3c03402f None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:44.545284 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bab49-29ae-4f48-84a9-3dee3c03402f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:44.545660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bab49-29ae-4f48-84a9-3dee3c03402f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:44.547130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bab49-29ae-4f48-84a9-3dee3c03402f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:44.556523 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 160/314] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:44.562368 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f9cba-8957-4d33-b6b2-3fcdcaec3457 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:44.632173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:44.669630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f9cba-8957-4d33-b6b2-3fcdcaec3457 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:44.704007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03072266-719b-491e-81d1-d4a335dfb5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:44.704641 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03072266-719b-491e-81d1-d4a335dfb5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:44.704918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03072266-719b-491e-81d1-d4a335dfb5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:44.705186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03072266-719b-491e-81d1-d4a335dfb5d7 None admin] PATH_INFO: `/v3/users/a3d00cfe3ac242e8af5650013882e3fa` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:44.706336 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03072266-719b-491e-81d1-d4a335dfb5d7 None admin] RBAC: Authorizing `identity:get_user(user_id=a3d00cfe3ac242e8af5650013882e3fa)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:44.707811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03072266-719b-491e-81d1-d4a335dfb5d7 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:44.709969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 155/315] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:44 2022] GET /identity/v3/users/a3d00cfe3ac242e8af5650013882e3fa => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:44.716361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bab49-29ae-4f48-84a9-3dee3c03402f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:44.824919 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bab49-29ae-4f48-84a9-3dee3c03402f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:44.833504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:44.861947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445c8c5-9014-427e-b098-fe2fe5f46228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:44.863061 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445c8c5-9014-427e-b098-fe2fe5f46228 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:44.863581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445c8c5-9014-427e-b098-fe2fe5f46228 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:44.864164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445c8c5-9014-427e-b098-fe2fe5f46228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:44.935826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445c8c5-9014-427e-b098-fe2fe5f46228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:44.937206 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445c8c5-9014-427e-b098-fe2fe5f46228 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:45.043389 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 161/316] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:05:45.049203 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03072266-719b-491e-81d1-d4a335dfb5d7 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:45.159419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03072266-719b-491e-81d1-d4a335dfb5d7 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:45.184627 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:45.197705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93363a-64ac-4cc4-8ed0-3ae5f3c4d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:45.198538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93363a-64ac-4cc4-8ed0-3ae5f3c4d2ef None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:45.198807 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93363a-64ac-4cc4-8ed0-3ae5f3c4d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:45.199075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93363a-64ac-4cc4-8ed0-3ae5f3c4d2ef None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:45.199921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d1231-abc3-49ab-98bb-0779c305ebad None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:45.200263 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93363a-64ac-4cc4-8ed0-3ae5f3c4d2ef None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:45.200593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d1231-abc3-49ab-98bb-0779c305ebad None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:45.201045 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d1231-abc3-49ab-98bb-0779c305ebad None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:45.201788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93363a-64ac-4cc4-8ed0-3ae5f3c4d2ef None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:45.206976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 156/318] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:45 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:45.207382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 162/318] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:05:45.210037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ca02c-95cf-43ce-a325-0ebebbd2114b None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:45.210037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ca02c-95cf-43ce-a325-0ebebbd2114b None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:45.210251 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ca02c-95cf-43ce-a325-0ebebbd2114b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:45.212073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d1231-abc3-49ab-98bb-0779c305ebad None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:45.221865 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:45.233996 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-7b3ca02c-95cf-43ce-a325-0ebebbd2114b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:45.235359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7b3ca02c-95cf-43ce-a325-0ebebbd2114b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:45.326274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 157/319] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:45.326904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d1231-abc3-49ab-98bb-0779c305ebad None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:45.345083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ca02c-95cf-43ce-a325-0ebebbd2114b None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:45.368363 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e732e4f-3071-448a-951f-70625e33bbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:45.369350 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e732e4f-3071-448a-951f-70625e33bbdb None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:45.369892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e732e4f-3071-448a-951f-70625e33bbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:45.370819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e732e4f-3071-448a-951f-70625e33bbdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:45.372017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e732e4f-3071-448a-951f-70625e33bbdb None admin] RBAC: Adding query filter params (role.id=cfa1c4251ba64c96bf0ddbeb03d57d77, scope.project.id=b1dee2813a11458fad814d5b53a5a15f, user.id=a3d00cfe3ac242e8af5650013882e3fa) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:45.372564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e732e4f-3071-448a-951f-70625e33bbdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:45.374728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e732e4f-3071-448a-951f-70625e33bbdb None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:45.390661 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 163/320] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:05:45 2022] GET /identity/v3/role_assignments?user.id=a3d00cfe3ac242e8af5650013882e3fa&scope.project.id=b1dee2813a11458fad814d5b53a5a15f&role.id=cfa1c4251ba64c96bf0ddbeb03d57d77 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:45.463490 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ca02c-95cf-43ce-a325-0ebebbd2114b None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:45.490432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:45.507930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044b31e-cbc5-4546-b801-38513dd22c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:45.508592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044b31e-cbc5-4546-b801-38513dd22c86 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:45.509019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044b31e-cbc5-4546-b801-38513dd22c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:45.509233 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044b31e-cbc5-4546-b801-38513dd22c86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:45.521703 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044b31e-cbc5-4546-b801-38513dd22c86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-8044b31e-cbc5-4546-b801-38513dd22c86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:45.526644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:45.527685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:45.528477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:45.528477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:45.528477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:45.528477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:45.528477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:45.528477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:45.528477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:45.528477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:45.528477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:45.528477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:45.528477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:45.528477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:45.528477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 158/321] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:05:45.536905 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e732e4f-3071-448a-951f-70625e33bbdb None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:45.620610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:45.655037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e732e4f-3071-448a-951f-70625e33bbdb None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:45.692150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e6edc-cdb0-4fdc-b2aa-8c32bd279144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:45.692773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e6edc-cdb0-4fdc-b2aa-8c32bd279144 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:45.693049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e6edc-cdb0-4fdc-b2aa-8c32bd279144 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:45.693317 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e6edc-cdb0-4fdc-b2aa-8c32bd279144 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:45.694025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e6edc-cdb0-4fdc-b2aa-8c32bd279144 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:45.694327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e6edc-cdb0-4fdc-b2aa-8c32bd279144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:45.695756 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e6edc-cdb0-4fdc-b2aa-8c32bd279144 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:45.705712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 164/322] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:45.711518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044b31e-cbc5-4546-b801-38513dd22c86 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:45.816353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044b31e-cbc5-4546-b801-38513dd22c86 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:45.865518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9229a-5e68-43af-b12d-9b8be763cddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:45.866620 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9229a-5e68-43af-b12d-9b8be763cddc None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:45.867086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9229a-5e68-43af-b12d-9b8be763cddc None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:45.867558 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9229a-5e68-43af-b12d-9b8be763cddc None admin] PATH_INFO: `/v3/users/64fbe653bf344b0595ec17b4a900e6fe` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:45.869547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9229a-5e68-43af-b12d-9b8be763cddc None admin] RBAC: Authorizing `identity:get_user(user_id=64fbe653bf344b0595ec17b4a900e6fe)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:45.872283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9229a-5e68-43af-b12d-9b8be763cddc None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:45.880166 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 159/323] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:45 2022] GET /identity/v3/users/64fbe653bf344b0595ec17b4a900e6fe => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:45.881922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e6edc-cdb0-4fdc-b2aa-8c32bd279144 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:45.925060 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89561f6a-b64f-4383-b1a2-cb571d301070 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:45.925329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89561f6a-b64f-4383-b1a2-cb571d301070 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:45.925570 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89561f6a-b64f-4383-b1a2-cb571d301070 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:45.926951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 160/324] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:45.931955 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284b030-c843-46c4-903b-389089440769 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:45.932224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284b030-c843-46c4-903b-389089440769 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:45.932494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284b030-c843-46c4-903b-389089440769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:45.950484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-c284b030-c843-46c4-903b-389089440769 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:45.951677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c284b030-c843-46c4-903b-389089440769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:45.997978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e6edc-cdb0-4fdc-b2aa-8c32bd279144 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:45.999176 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:46.029768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 161/325] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:46.032504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39906d-8036-45e3-9003-0018c0edbc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:46.033126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39906d-8036-45e3-9003-0018c0edbc46 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:46.033401 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39906d-8036-45e3-9003-0018c0edbc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:46.033899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39906d-8036-45e3-9003-0018c0edbc46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:46.034446 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39906d-8036-45e3-9003-0018c0edbc46 None admin] RBAC: Adding query filter params (role.id=186990d6368647b5b0712c4fedf4afd9, user.id=64fbe653bf344b0595ec17b4a900e6fe, scope.system=all) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:46.034737 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39906d-8036-45e3-9003-0018c0edbc46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:46.035418 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:46.037294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39906d-8036-45e3-9003-0018c0edbc46 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:46.050570 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284b030-c843-46c4-903b-389089440769 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:46.053183 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 165/326] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Aug 9 11:05:45 2022] GET /identity/v3/role_assignments?user.id=64fbe653bf344b0595ec17b4a900e6fe&scope.system=all&role.id=186990d6368647b5b0712c4fedf4afd9 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:46.118344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866b1cd-9b53-48b2-8e5c-95b36804d93e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:46.118527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866b1cd-9b53-48b2-8e5c-95b36804d93e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:46.118786 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866b1cd-9b53-48b2-8e5c-95b36804d93e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:46.120303 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 166/327] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:05:46.126426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523354bb-6623-47bd-ade7-4496676ea483 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:46.126754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523354bb-6623-47bd-ade7-4496676ea483 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:46.126971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523354bb-6623-47bd-ade7-4496676ea483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:46.149837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-523354bb-6623-47bd-ade7-4496676ea483 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:46.151048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-523354bb-6623-47bd-ade7-4496676ea483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:46.173722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284b030-c843-46c4-903b-389089440769 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:46.218685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244b0c6-c6e7-493d-870f-2ae9db0adf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:46.219626 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244b0c6-c6e7-493d-870f-2ae9db0adf97 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:46.219626 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244b0c6-c6e7-493d-870f-2ae9db0adf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:46.220173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244b0c6-c6e7-493d-870f-2ae9db0adf97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:46.220954 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244b0c6-c6e7-493d-870f-2ae9db0adf97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:46.223002 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244b0c6-c6e7-493d-870f-2ae9db0adf97 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:46.224072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 162/328] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:05:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:46.230953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244b0c6-c6e7-493d-870f-2ae9db0adf97 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:46.234324 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 167/329] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:46.256346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523354bb-6623-47bd-ade7-4496676ea483 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:46.283692 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:46.337391 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244b0c6-c6e7-493d-870f-2ae9db0adf97 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:46.358943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523354bb-6623-47bd-ade7-4496676ea483 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:46.371111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042382c-5f41-4b70-bfa4-a731538a6217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:46.371633 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042382c-5f41-4b70-bfa4-a731538a6217 None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:46.371905 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042382c-5f41-4b70-bfa4-a731538a6217 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:46.372141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042382c-5f41-4b70-bfa4-a731538a6217 None admin] PATH_INFO: `/v3/groups` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:46.372763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042382c-5f41-4b70-bfa4-a731538a6217 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:46.374235 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042382c-5f41-4b70-bfa4-a731538a6217 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:46.379964 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:46.391917 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 163/330] 10.222.0.15 () {60 vars in 1134 bytes} [Tue Aug 9 11:05:46 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:05:46.397166 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0228d-cf8c-44b7-9bb7-15b309af6bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:46.397848 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0228d-cf8c-44b7-9bb7-15b309af6bbc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:46.398120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0228d-cf8c-44b7-9bb7-15b309af6bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:46.398385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0228d-cf8c-44b7-9bb7-15b309af6bbc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:46.410528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0228d-cf8c-44b7-9bb7-15b309af6bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-17c0228d-cf8c-44b7-9bb7-15b309af6bbc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:46.415471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:46.416612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:46.417530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:46.417530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:46.417530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:46.417530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:46.417530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:46.417530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:46.417530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:46.417530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:46.417530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:46.417530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:46.417530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:46.417530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:46.417530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 168/331] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:46.423054 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042382c-5f41-4b70-bfa4-a731538a6217 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:46.539607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042382c-5f41-4b70-bfa4-a731538a6217 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:46.547174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:46.577772 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e86e52-dc3a-45bf-be22-3f2f7ab21437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:46.578391 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e86e52-dc3a-45bf-be22-3f2f7ab21437 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:46.578671 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e86e52-dc3a-45bf-be22-3f2f7ab21437 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:46.578939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e86e52-dc3a-45bf-be22-3f2f7ab21437 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:46.579604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e86e52-dc3a-45bf-be22-3f2f7ab21437 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:46.579909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e86e52-dc3a-45bf-be22-3f2f7ab21437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:46.581306 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e86e52-dc3a-45bf-be22-3f2f7ab21437 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:46.590272 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 164/332] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:46.596133 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0228d-cf8c-44b7-9bb7-15b309af6bbc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:46.702673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0228d-cf8c-44b7-9bb7-15b309af6bbc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:46.740224 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeca27-37e7-41ce-b88b-295f60dfbc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:46.740648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeca27-37e7-41ce-b88b-295f60dfbc5f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:46.740930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeca27-37e7-41ce-b88b-295f60dfbc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:46.741204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeca27-37e7-41ce-b88b-295f60dfbc5f None admin] PATH_INFO: `/v3/users/b843a4a4c40741a89dde13c1e24d0e58` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:46.746405 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeca27-37e7-41ce-b88b-295f60dfbc5f None admin] RBAC: Authorizing `identity:get_user(user_id=b843a4a4c40741a89dde13c1e24d0e58)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:46.746405 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeca27-37e7-41ce-b88b-295f60dfbc5f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:46.746405 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 169/333] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:46 2022] GET /identity/v3/users/b843a4a4c40741a89dde13c1e24d0e58 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:46.752167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e86e52-dc3a-45bf-be22-3f2f7ab21437 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:46.863996 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e86e52-dc3a-45bf-be22-3f2f7ab21437 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:46.900797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ba9d9-e5d5-41ec-8a12-a9cb48892783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:46.901454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ba9d9-e5d5-41ec-8a12-a9cb48892783 None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:46.901765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ba9d9-e5d5-41ec-8a12-a9cb48892783 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:46.902036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ba9d9-e5d5-41ec-8a12-a9cb48892783 None admin] PATH_INFO: `/v3/system/users/b843a4a4c40741a89dde13c1e24d0e58/roles/cfa1c4251ba64c96bf0ddbeb03d57d77` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:46.903578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ba9d9-e5d5-41ec-8a12-a9cb48892783 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b843a4a4c40741a89dde13c1e24d0e58, role_id=cfa1c4251ba64c96bf0ddbeb03d57d77)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:46.904994 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ba9d9-e5d5-41ec-8a12-a9cb48892783 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:46.915960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 165/334] 10.222.0.15 () {58 vars in 1334 bytes} [Tue Aug 9 11:05:46 2022] PUT /identity/v3/system/users/b843a4a4c40741a89dde13c1e24d0e58/roles/cfa1c4251ba64c96bf0ddbeb03d57d77 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:05:48.593920 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92b3c8-ef2d-4560-af04-2d6e8cd3113e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:48.594433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92b3c8-ef2d-4560-af04-2d6e8cd3113e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:48.594506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92b3c8-ef2d-4560-af04-2d6e8cd3113e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:48.596117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 170/335] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:48.601672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497dde6-99f2-44ae-86fe-8bc52ba64209 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:48.602146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497dde6-99f2-44ae-86fe-8bc52ba64209 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:48.602219 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497dde6-99f2-44ae-86fe-8bc52ba64209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:48.626729 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-7497dde6-99f2-44ae-86fe-8bc52ba64209 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:48.627961 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7497dde6-99f2-44ae-86fe-8bc52ba64209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:48.661440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:48.710453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 166/336] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:48.742231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92b3c8-ef2d-4560-af04-2d6e8cd3113e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:48.812217 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:48.869659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92b3c8-ef2d-4560-af04-2d6e8cd3113e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:48.912052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2f854-4709-4f8f-9390-7a5d07ff0cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:48.912699 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2f854-4709-4f8f-9390-7a5d07ff0cba None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:48.912969 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2f854-4709-4f8f-9390-7a5d07ff0cba None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:48.913238 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2f854-4709-4f8f-9390-7a5d07ff0cba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:48.928492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2f854-4709-4f8f-9390-7a5d07ff0cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-c8b2f854-4709-4f8f-9390-7a5d07ff0cba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:48.933372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:48.934274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:48.935705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:48.935705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:48.935705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:48.935705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:48.935705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:48.935705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:48.935705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:48.935705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:48.935705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:48.935705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:48.935705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:48.935705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:48.935705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 171/337] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:48.940404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497dde6-99f2-44ae-86fe-8bc52ba64209 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:49.068697 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497dde6-99f2-44ae-86fe-8bc52ba64209 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:49.105001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3984fd-bfbc-4393-939e-d8fa9c085eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:49.106029 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3984fd-bfbc-4393-939e-d8fa9c085eba None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:49.106493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3984fd-bfbc-4393-939e-d8fa9c085eba None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:49.106946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3984fd-bfbc-4393-939e-d8fa9c085eba None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:49.107797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3984fd-bfbc-4393-939e-d8fa9c085eba None admin] RBAC: Adding query filter params (name=member) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:49.108316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3984fd-bfbc-4393-939e-d8fa9c085eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:49.109922 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3984fd-bfbc-4393-939e-d8fa9c085eba None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:49.125774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 167/338] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:49.131419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2f854-4709-4f8f-9390-7a5d07ff0cba None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:49.264893 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2f854-4709-4f8f-9390-7a5d07ff0cba None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:49.275360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:49.305429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25844fc2-52e7-405f-93df-678f98f893fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:49.306179 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25844fc2-52e7-405f-93df-678f98f893fc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:49.306455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25844fc2-52e7-405f-93df-678f98f893fc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:49.306724 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25844fc2-52e7-405f-93df-678f98f893fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:49.387897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25844fc2-52e7-405f-93df-678f98f893fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:49.389294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25844fc2-52e7-405f-93df-678f98f893fc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:49.415618 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0a858-881a-47aa-99ea-4bc789ee3873 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:49.416077 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0a858-881a-47aa-99ea-4bc789ee3873 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:49.416523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0a858-881a-47aa-99ea-4bc789ee3873 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:49.420039 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 168/339] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:49.429835 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d9db2-ee41-4e8c-b4da-8604c49ec421 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:49.430309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d9db2-ee41-4e8c-b4da-8604c49ec421 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:49.430828 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d9db2-ee41-4e8c-b4da-8604c49ec421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:49.484784 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-851d9db2-ee41-4e8c-b4da-8604c49ec421 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:49.494186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-851d9db2-ee41-4e8c-b4da-8604c49ec421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:49.539074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:49.558704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 172/340] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:49.566907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25844fc2-52e7-405f-93df-678f98f893fc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:49.596949 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:49.615860 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 169/341] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:49.639544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d9db2-ee41-4e8c-b4da-8604c49ec421 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:49.746640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d9db2-ee41-4e8c-b4da-8604c49ec421 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:49.786592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea291c1c-13f8-4bdc-934c-36a47a56b3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:49.787485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea291c1c-13f8-4bdc-934c-36a47a56b3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:49.787901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea291c1c-13f8-4bdc-934c-36a47a56b3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:49.788333 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea291c1c-13f8-4bdc-934c-36a47a56b3d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:49.800735 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea291c1c-13f8-4bdc-934c-36a47a56b3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-ea291c1c-13f8-4bdc-934c-36a47a56b3d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:49.806019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:49.807160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:49.808172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:49.808172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:49.808172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:49.808172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:49.808172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:49.808172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:49.808172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:49.808172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:49.808172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:49.808172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:49.808172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:49.808172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:49.810542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 170/342] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:05:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:49.816782 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea291c1c-13f8-4bdc-934c-36a47a56b3d9 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:49.825507 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25844fc2-52e7-405f-93df-678f98f893fc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:49.835690 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:49.917723 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1460049-8c95-4d67-9f2e-e92f3ea21dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:49.918479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1460049-8c95-4d67-9f2e-e92f3ea21dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:49.918868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1460049-8c95-4d67-9f2e-e92f3ea21dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:49.919233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1460049-8c95-4d67-9f2e-e92f3ea21dd5 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:49.920536 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1460049-8c95-4d67-9f2e-e92f3ea21dd5 None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:49.922064 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1460049-8c95-4d67-9f2e-e92f3ea21dd5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:49.924194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 173/343] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:49 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:49.929341 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1460049-8c95-4d67-9f2e-e92f3ea21dd5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:49.931404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea291c1c-13f8-4bdc-934c-36a47a56b3d9 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:49.971910 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ecc55-fcd9-416a-93d8-86a38fa68683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:49.972922 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ecc55-fcd9-416a-93d8-86a38fa68683 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:49.973502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ecc55-fcd9-416a-93d8-86a38fa68683 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:49.973939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ecc55-fcd9-416a-93d8-86a38fa68683 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:49.975326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ecc55-fcd9-416a-93d8-86a38fa68683 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:49.975783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ecc55-fcd9-416a-93d8-86a38fa68683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:49.977752 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ecc55-fcd9-416a-93d8-86a38fa68683 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:49.988207 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 171/344] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:05:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:49.994270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ecc55-fcd9-416a-93d8-86a38fa68683 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:50.081673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:50.083621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:50.113261 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ecc55-fcd9-416a-93d8-86a38fa68683 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:50.118523 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1460049-8c95-4d67-9f2e-e92f3ea21dd5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:50.150583 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c39bf5-56ca-41a0-8d58-c0dabddacfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:50.151476 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c39bf5-56ca-41a0-8d58-c0dabddacfea None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:50.151890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c39bf5-56ca-41a0-8d58-c0dabddacfea None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:50.152294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c39bf5-56ca-41a0-8d58-c0dabddacfea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:50.170697 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802199c-a2d2-4171-aa76-da3719ffcadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:50.171477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802199c-a2d2-4171-aa76-da3719ffcadd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:50.171897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802199c-a2d2-4171-aa76-da3719ffcadd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:50.172255 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802199c-a2d2-4171-aa76-da3719ffcadd None admin] PATH_INFO: `/v3/groups/61f91f482e8041cdaff6e862ff0f22b2` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:50.184537 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802199c-a2d2-4171-aa76-da3719ffcadd None admin] RBAC: Authorizing `identity:get_group(group_id=61f91f482e8041cdaff6e862ff0f22b2)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:50.186287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802199c-a2d2-4171-aa76-da3719ffcadd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:50.192982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 174/345] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Aug 9 11:05:49 2022] GET /identity/v3/groups/61f91f482e8041cdaff6e862ff0f22b2 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:50.194151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1bcda-ebe7-4479-aedb-a2574cec9056 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:50.194526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1bcda-ebe7-4479-aedb-a2574cec9056 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:50.194915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1bcda-ebe7-4479-aedb-a2574cec9056 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:50.196425 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 175/346] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:50.197243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1bcda-ebe7-4479-aedb-a2574cec9056 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:50.235164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c39bf5-56ca-41a0-8d58-c0dabddacfea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:50.236984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c39bf5-56ca-41a0-8d58-c0dabddacfea None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:50.320745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:50.338549 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1bcda-ebe7-4479-aedb-a2574cec9056 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:50.346261 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 172/347] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:05:50.347831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e601f-55e0-49f3-9fb0-7e831a936a34 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:50.353129 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e601f-55e0-49f3-9fb0-7e831a936a34 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:50.353671 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e601f-55e0-49f3-9fb0-7e831a936a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:50.373224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-fa5e601f-55e0-49f3-9fb0-7e831a936a34 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:50.374765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fa5e601f-55e0-49f3-9fb0-7e831a936a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:50.378331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2f8f0-4ee1-4fc1-8a8b-729c089bd42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:50.380065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2f8f0-4ee1-4fc1-8a8b-729c089bd42c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:50.380065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2f8f0-4ee1-4fc1-8a8b-729c089bd42c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:50.380065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2f8f0-4ee1-4fc1-8a8b-729c089bd42c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:50.380692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2f8f0-4ee1-4fc1-8a8b-729c089bd42c None admin] RBAC: Adding query filter params (group.id=61f91f482e8041cdaff6e862ff0f22b2, role.id=186990d6368647b5b0712c4fedf4afd9, scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:50.381054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2f8f0-4ee1-4fc1-8a8b-729c089bd42c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:50.382622 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2f8f0-4ee1-4fc1-8a8b-729c089bd42c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:50.388701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 176/348] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Aug 9 11:05:50 2022] GET /identity/v3/role_assignments?group.id=61f91f482e8041cdaff6e862ff0f22b2&scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b&role.id=186990d6368647b5b0712c4fedf4afd9 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:50.390185 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326eaae-2bec-45ae-a6fc-11bb58e21688 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:50.390535 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326eaae-2bec-45ae-a6fc-11bb58e21688 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:50.390869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326eaae-2bec-45ae-a6fc-11bb58e21688 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:50.392521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 177/349] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:50.393961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326eaae-2bec-45ae-a6fc-11bb58e21688 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:50.430137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:50.457358 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 173/350] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:50.459165 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c80c2-b250-4296-95a4-e993d3efd20f None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:50.459673 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c80c2-b250-4296-95a4-e993d3efd20f None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:50.460260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c80c2-b250-4296-95a4-e993d3efd20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:50.480374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-930c80c2-b250-4296-95a4-e993d3efd20f None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:50.481935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-930c80c2-b250-4296-95a4-e993d3efd20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:50.569758 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326eaae-2bec-45ae-a6fc-11bb58e21688 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:50.603044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 174/351] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:50.604333 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c80c2-b250-4296-95a4-e993d3efd20f None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:50.646271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa77ba-9747-4490-a7fe-797aefe78a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:50.649377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa77ba-9747-4490-a7fe-797aefe78a93 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:50.650894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa77ba-9747-4490-a7fe-797aefe78a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:50.651397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa77ba-9747-4490-a7fe-797aefe78a93 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:50.652858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa77ba-9747-4490-a7fe-797aefe78a93 None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:50.655347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa77ba-9747-4490-a7fe-797aefe78a93 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:50.658024 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 178/352] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:50 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:50.659019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa77ba-9747-4490-a7fe-797aefe78a93 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:50.683309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:50.753864 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:50.813412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa77ba-9747-4490-a7fe-797aefe78a93 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:50.815515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c80c2-b250-4296-95a4-e993d3efd20f None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:50.858462 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2016e52-74f3-4d7c-aa63-bdec4a79088e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:50.859505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2016e52-74f3-4d7c-aa63-bdec4a79088e None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:50.860052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2016e52-74f3-4d7c-aa63-bdec4a79088e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:50.860528 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2016e52-74f3-4d7c-aa63-bdec4a79088e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:50.872718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2016e52-74f3-4d7c-aa63-bdec4a79088e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-f2016e52-74f3-4d7c-aa63-bdec4a79088e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:50.880718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:50.881796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:50.882660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:50.882660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:50.882660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:50.882660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:50.882660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:50.882660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:50.882660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:50.882660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:50.882660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:50.882660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:50.882660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:50.882660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:50.885729 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 175/353] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:50.886869 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2016e52-74f3-4d7c-aa63-bdec4a79088e None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:50.906919 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dbb8e-be14-4c18-8547-2a54ab7fbd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:50.907575 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dbb8e-be14-4c18-8547-2a54ab7fbd86 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:50.907849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dbb8e-be14-4c18-8547-2a54ab7fbd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:50.908115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dbb8e-be14-4c18-8547-2a54ab7fbd86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:50.934375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12dbb8e-be14-4c18-8547-2a54ab7fbd86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-c12dbb8e-be14-4c18-8547-2a54ab7fbd86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:50.945679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:50.946829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:50.947634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:50.947634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:50.947634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:50.947634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:50.947634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:50.947634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:50.947634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:50.947634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:50.947634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:50.947634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:50.947634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 11:05:50.947634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:50.947634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 179/354] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:50.947634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dbb8e-be14-4c18-8547-2a54ab7fbd86 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:51.011711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:51.020155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2016e52-74f3-4d7c-aa63-bdec4a79088e None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:51.074250 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581deef-9127-4088-b441-466e7c704560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:51.075126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581deef-9127-4088-b441-466e7c704560 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:51.075552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581deef-9127-4088-b441-466e7c704560 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:51.075981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581deef-9127-4088-b441-466e7c704560 None admin] PATH_INFO: `/v3/groups/61f91f482e8041cdaff6e862ff0f22b2` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:51.078990 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581deef-9127-4088-b441-466e7c704560 None admin] RBAC: Authorizing `identity:get_group(group_id=61f91f482e8041cdaff6e862ff0f22b2)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:51.080637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581deef-9127-4088-b441-466e7c704560 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:51.082839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 176/355] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Aug 9 11:05:50 2022] GET /identity/v3/groups/61f91f482e8041cdaff6e862ff0f22b2 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:51.084133 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0194ca-fc12-477b-b8d1-e50560072a6d None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:51.084406 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0194ca-fc12-477b-b8d1-e50560072a6d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:51.084672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0194ca-fc12-477b-b8d1-e50560072a6d None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:51.088497 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 177/356] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:51.089283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0194ca-fc12-477b-b8d1-e50560072a6d None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:51.090838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dbb8e-be14-4c18-8547-2a54ab7fbd86 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:51.130176 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:51.137812 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2bbc9-4721-44e1-a2fb-229b114c3ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:51.138715 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2bbc9-4721-44e1-a2fb-229b114c3ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:51.138999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2bbc9-4721-44e1-a2fb-229b114c3ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:51.139274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2bbc9-4721-44e1-a2fb-229b114c3ab0 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:51.140199 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2bbc9-4721-44e1-a2fb-229b114c3ab0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:51.140896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2bbc9-4721-44e1-a2fb-229b114c3ab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:51.142623 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2bbc9-4721-44e1-a2fb-229b114c3ab0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:51.155962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 180/357] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:51.157485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842bdcc-bf2b-46a3-aa87-c0ed5bda3e0b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:51.158225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842bdcc-bf2b-46a3-aa87-c0ed5bda3e0b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:51.158498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842bdcc-bf2b-46a3-aa87-c0ed5bda3e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:51.183930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7842bdcc-bf2b-46a3-aa87-c0ed5bda3e0b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:51.185221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7842bdcc-bf2b-46a3-aa87-c0ed5bda3e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:51.235525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0194ca-fc12-477b-b8d1-e50560072a6d None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:51.283764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 181/358] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:51.284637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842bdcc-bf2b-46a3-aa87-c0ed5bda3e0b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:51.295754 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bfab9-79aa-40c9-a269-c90ec25c5c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:51.296741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bfab9-79aa-40c9-a269-c90ec25c5c8b None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:51.297202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bfab9-79aa-40c9-a269-c90ec25c5c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:51.297684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bfab9-79aa-40c9-a269-c90ec25c5c8b None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:51.298657 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bfab9-79aa-40c9-a269-c90ec25c5c8b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:51.299159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bfab9-79aa-40c9-a269-c90ec25c5c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:51.300955 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bfab9-79aa-40c9-a269-c90ec25c5c8b None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:51.311775 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 178/359] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:51.312925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bfab9-79aa-40c9-a269-c90ec25c5c8b None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:51.350099 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:51.419965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842bdcc-bf2b-46a3-aa87-c0ed5bda3e0b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:51.439818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bfab9-79aa-40c9-a269-c90ec25c5c8b None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:51.447762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:51.468713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b7cde-b772-4ca3-a0d0-e145da72f49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:51.469496 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b7cde-b772-4ca3-a0d0-e145da72f49f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:51.469886 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b7cde-b772-4ca3-a0d0-e145da72f49f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:51.470511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b7cde-b772-4ca3-a0d0-e145da72f49f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:51.471253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b7cde-b772-4ca3-a0d0-e145da72f49f None admin] RBAC: Adding query filter params (group.id=61f91f482e8041cdaff6e862ff0f22b2, role.id=90f6c18c707742de8521c29b89d64215, scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:51.471561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b7cde-b772-4ca3-a0d0-e145da72f49f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:51.474663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b7cde-b772-4ca3-a0d0-e145da72f49f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:51.481440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866dd208-8716-486d-948b-63727edf3215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:51.482090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dd208-8716-486d-948b-63727edf3215 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:51.482365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dd208-8716-486d-948b-63727edf3215 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:51.482633 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866dd208-8716-486d-948b-63727edf3215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:51.484912 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 182/360] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Aug 9 11:05:51 2022] GET /identity/v3/role_assignments?group.id=61f91f482e8041cdaff6e862ff0f22b2&scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b&role.id=90f6c18c707742de8521c29b89d64215 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:51.486728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b6b30-0ed6-4cc9-9feb-595acc1b41af None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:51.487048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b6b30-0ed6-4cc9-9feb-595acc1b41af None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:51.487318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b6b30-0ed6-4cc9-9feb-595acc1b41af None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:51.488892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 183/361] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:51.493988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b6b30-0ed6-4cc9-9feb-595acc1b41af None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:51.594177 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866dd208-8716-486d-948b-63727edf3215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:51.596317 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866dd208-8716-486d-948b-63727edf3215 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:51.643651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:51.657990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b6b30-0ed6-4cc9-9feb-595acc1b41af None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:51.701034 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2856c4-07b6-4dfd-89bd-95266b905478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:51.702156 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2856c4-07b6-4dfd-89bd-95266b905478 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:51.702623 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2856c4-07b6-4dfd-89bd-95266b905478 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:51.703075 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2856c4-07b6-4dfd-89bd-95266b905478 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:51.717703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2856c4-07b6-4dfd-89bd-95266b905478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-ab2856c4-07b6-4dfd-89bd-95266b905478 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:51.723147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:51.724130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:51.724996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:51.724996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:51.724996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:51.724996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:51.724996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:51.724996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:51.724996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:51.724996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:51.724996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:51.724996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:51.724996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:51.724996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:51.727828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 184/362] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:05:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:51.729025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2856c4-07b6-4dfd-89bd-95266b905478 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:51.741785 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 179/363] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:51.743894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f95410-11e6-435b-9e9f-16e3393038d5 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:51.744356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f95410-11e6-435b-9e9f-16e3393038d5 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:51.744792 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f95410-11e6-435b-9e9f-16e3393038d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:51.769002 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-75f95410-11e6-435b-9e9f-16e3393038d5 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:51.770458 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-75f95410-11e6-435b-9e9f-16e3393038d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:51.818029 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:51.870384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2856c4-07b6-4dfd-89bd-95266b905478 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:51.875405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 180/364] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:51.876503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f95410-11e6-435b-9e9f-16e3393038d5 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:51.919808 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73cd5a-c9a4-4683-8e05-4b2e51bc901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:51.920608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73cd5a-c9a4-4683-8e05-4b2e51bc901a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:51.920938 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73cd5a-c9a4-4683-8e05-4b2e51bc901a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:51.921267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73cd5a-c9a4-4683-8e05-4b2e51bc901a None admin] PATH_INFO: `/v3/users/b843a4a4c40741a89dde13c1e24d0e58` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:51.922594 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73cd5a-c9a4-4683-8e05-4b2e51bc901a None admin] RBAC: Authorizing `identity:get_user(user_id=b843a4a4c40741a89dde13c1e24d0e58)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:51.924250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73cd5a-c9a4-4683-8e05-4b2e51bc901a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:51.926637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 185/365] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:05:51 2022] GET /identity/v3/users/b843a4a4c40741a89dde13c1e24d0e58 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:51.927497 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73cd5a-c9a4-4683-8e05-4b2e51bc901a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:51.950653 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:52.002995 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f95410-11e6-435b-9e9f-16e3393038d5 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:52.040492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352321f2-64bf-4ceb-a21a-790c7542501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:52.041529 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352321f2-64bf-4ceb-a21a-790c7542501a None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:52.042050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352321f2-64bf-4ceb-a21a-790c7542501a None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:52.042515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352321f2-64bf-4ceb-a21a-790c7542501a None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:52.043373 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352321f2-64bf-4ceb-a21a-790c7542501a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:52.043870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352321f2-64bf-4ceb-a21a-790c7542501a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:52.046543 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352321f2-64bf-4ceb-a21a-790c7542501a None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:52.056395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 181/366] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:52.057742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352321f2-64bf-4ceb-a21a-790c7542501a None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:52.061384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73cd5a-c9a4-4683-8e05-4b2e51bc901a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:52.079222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:52.100618 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc3725-8a2a-46f9-bcef-aab6b37a2765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:52.101350 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc3725-8a2a-46f9-bcef-aab6b37a2765 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:52.101668 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc3725-8a2a-46f9-bcef-aab6b37a2765 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:52.101943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc3725-8a2a-46f9-bcef-aab6b37a2765 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:52.103243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc3725-8a2a-46f9-bcef-aab6b37a2765 None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:52.106465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc3725-8a2a-46f9-bcef-aab6b37a2765 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:52.108466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 186/367] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:51 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:52.109157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc3725-8a2a-46f9-bcef-aab6b37a2765 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:52.206896 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352321f2-64bf-4ceb-a21a-790c7542501a None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:52.228078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:52.237181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc3725-8a2a-46f9-bcef-aab6b37a2765 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:52.246245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e31af-cc98-420c-bb05-baeabb428fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:52.246980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e31af-cc98-420c-bb05-baeabb428fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:52.247260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e31af-cc98-420c-bb05-baeabb428fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:52.247532 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e31af-cc98-420c-bb05-baeabb428fa7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:52.259798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e31af-cc98-420c-bb05-baeabb428fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-a53e31af-cc98-420c-bb05-baeabb428fa7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:52.265227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:52.266170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:52.266984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:52.266984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:52.266984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:52.266984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:52.266984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:52.266984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:52.266984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:52.266984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:52.266984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:52.266984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:52.266984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:52.266984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:52.266984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 182/368] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:05:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:52.268423 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e31af-cc98-420c-bb05-baeabb428fa7 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:52.279510 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467df6f-529c-4582-9818-299da577e77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:52.280129 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467df6f-529c-4582-9818-299da577e77a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:52.280407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467df6f-529c-4582-9818-299da577e77a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:52.280722 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467df6f-529c-4582-9818-299da577e77a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:52.281491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467df6f-529c-4582-9818-299da577e77a None admin] RBAC: Adding query filter params (role.id=cfa1c4251ba64c96bf0ddbeb03d57d77, user.id=b843a4a4c40741a89dde13c1e24d0e58, scope.system=all) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:52.281831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467df6f-529c-4582-9818-299da577e77a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:52.283332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1467df6f-529c-4582-9818-299da577e77a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:52.297636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 187/369] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Aug 9 11:05:52 2022] GET /identity/v3/role_assignments?user.id=b843a4a4c40741a89dde13c1e24d0e58&scope.system=all&role.id=cfa1c4251ba64c96bf0ddbeb03d57d77 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:52.298519 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467df6f-529c-4582-9818-299da577e77a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:52.346846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:52.413379 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467df6f-529c-4582-9818-299da577e77a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:52.450066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec86d3-a38a-4ea5-9c00-22b9cc7e7833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:52.450717 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec86d3-a38a-4ea5-9c00-22b9cc7e7833 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:52.450990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec86d3-a38a-4ea5-9c00-22b9cc7e7833 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:52.451258 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec86d3-a38a-4ea5-9c00-22b9cc7e7833 None admin] PATH_INFO: `/v3/groups/61f91f482e8041cdaff6e862ff0f22b2` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:52.452526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec86d3-a38a-4ea5-9c00-22b9cc7e7833 None admin] RBAC: Authorizing `identity:get_group(group_id=61f91f482e8041cdaff6e862ff0f22b2)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:52.454080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec86d3-a38a-4ea5-9c00-22b9cc7e7833 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:52.456266 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 188/370] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Aug 9 11:05:52 2022] GET /identity/v3/groups/61f91f482e8041cdaff6e862ff0f22b2 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:52.457276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec86d3-a38a-4ea5-9c00-22b9cc7e7833 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:52.486578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e31af-cc98-420c-bb05-baeabb428fa7 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:52.548238 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491cd66-4e7a-4dfe-af69-74b8acbbd6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:52.548864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491cd66-4e7a-4dfe-af69-74b8acbbd6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:52.549134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491cd66-4e7a-4dfe-af69-74b8acbbd6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:52.549397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491cd66-4e7a-4dfe-af69-74b8acbbd6f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:52.582179 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec86d3-a38a-4ea5-9c00-22b9cc7e7833 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:52.594072 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:52.621731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b9de7-c97e-489f-b021-82daab284c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:52.622634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b9de7-c97e-489f-b021-82daab284c04 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:52.623158 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b9de7-c97e-489f-b021-82daab284c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:52.623614 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b9de7-c97e-489f-b021-82daab284c04 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:52.624496 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b9de7-c97e-489f-b021-82daab284c04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:52.624980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b9de7-c97e-489f-b021-82daab284c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:52.626588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b9de7-c97e-489f-b021-82daab284c04 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:52.627087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:52.636971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 189/371] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:05:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:52.638207 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b9de7-c97e-489f-b021-82daab284c04 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:52.670688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491cd66-4e7a-4dfe-af69-74b8acbbd6f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:52.672773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491cd66-4e7a-4dfe-af69-74b8acbbd6f1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:52.765729 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b9de7-c97e-489f-b021-82daab284c04 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:52.824181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fa795-163e-454e-993a-fd5f360e6164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:52.824719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fa795-163e-454e-993a-fd5f360e6164 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:52.824998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fa795-163e-454e-993a-fd5f360e6164 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:52.825256 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fa795-163e-454e-993a-fd5f360e6164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:52.827412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fa795-163e-454e-993a-fd5f360e6164 None admin] RBAC: Adding query filter params (group.id=61f91f482e8041cdaff6e862ff0f22b2, role.id=186990d6368647b5b0712c4fedf4afd9, scope.project.id=b1dee2813a11458fad814d5b53a5a15f) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:52.827717 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fa795-163e-454e-993a-fd5f360e6164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:52.829174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fa795-163e-454e-993a-fd5f360e6164 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:52.844795 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 190/373] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Aug 9 11:05:52 2022] GET /identity/v3/role_assignments?group.id=61f91f482e8041cdaff6e862ff0f22b2&scope.project.id=b1dee2813a11458fad814d5b53a5a15f&role.id=186990d6368647b5b0712c4fedf4afd9 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:52.845235 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 183/373] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:52.846701 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491cd66-4e7a-4dfe-af69-74b8acbbd6f1 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:52.849585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fa795-163e-454e-993a-fd5f360e6164 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:52.911568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:52.983436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:53.000470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fa795-163e-454e-993a-fd5f360e6164 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:53.014412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491cd66-4e7a-4dfe-af69-74b8acbbd6f1 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:53.051398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c779f7b-0448-43bb-80a3-7b2e39222d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:53.052133 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c779f7b-0448-43bb-80a3-7b2e39222d81 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:53.052471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c779f7b-0448-43bb-80a3-7b2e39222d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:53.052803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c779f7b-0448-43bb-80a3-7b2e39222d81 None admin] PATH_INFO: `/v3/projects/152f15d50a21447fba37927c712cf876` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:53.054049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c779f7b-0448-43bb-80a3-7b2e39222d81 None admin] RBAC: Authorizing `identity:get_project(project_id=152f15d50a21447fba37927c712cf876)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:53.055596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c779f7b-0448-43bb-80a3-7b2e39222d81 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:53.057557 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 191/374] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:52 2022] GET /identity/v3/projects/152f15d50a21447fba37927c712cf876 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:53.059312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e1dd-6f08-4696-a047-7d79ed52daa5 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:53.059591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e1dd-6f08-4696-a047-7d79ed52daa5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:53.059857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363e1dd-6f08-4696-a047-7d79ed52daa5 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:53.061285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 192/375] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:53.064079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9afe7-c68a-44d0-8011-3b52c3434cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:53.064694 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9afe7-c68a-44d0-8011-3b52c3434cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:53.065167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9afe7-c68a-44d0-8011-3b52c3434cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:53.065280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9afe7-c68a-44d0-8011-3b52c3434cf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:53.065933 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363e1dd-6f08-4696-a047-7d79ed52daa5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:53.137723 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9afe7-c68a-44d0-8011-3b52c3434cf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:53.139155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9afe7-c68a-44d0-8011-3b52c3434cf0 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:53.197026 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363e1dd-6f08-4696-a047-7d79ed52daa5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:53.200526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:53.230422 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:53.253852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d264aae-e2d1-4380-95db-5786e5f293cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:53.254854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d264aae-e2d1-4380-95db-5786e5f293cd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:53.255125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d264aae-e2d1-4380-95db-5786e5f293cd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:53.255384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d264aae-e2d1-4380-95db-5786e5f293cd None admin] PATH_INFO: `/v3/groups/3072b416d5f44a8295bb9abe50ffbe0d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:53.257799 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 184/376] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:53.259323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f796aac-88dd-4557-865d-5820c3c47267 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:53.259598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f796aac-88dd-4557-865d-5820c3c47267 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:53.259862 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f796aac-88dd-4557-865d-5820c3c47267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:53.265531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d264aae-e2d1-4380-95db-5786e5f293cd None admin] RBAC: Authorizing `identity:get_group(group_id=3072b416d5f44a8295bb9abe50ffbe0d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:53.267018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d264aae-e2d1-4380-95db-5786e5f293cd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:53.268899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 193/377] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Aug 9 11:05:53 2022] GET /identity/v3/groups/3072b416d5f44a8295bb9abe50ffbe0d => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:53.269445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d264aae-e2d1-4380-95db-5786e5f293cd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:53.279913 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-6f796aac-88dd-4557-865d-5820c3c47267 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:53.281118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6f796aac-88dd-4557-865d-5820c3c47267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:53.354750 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 185/378] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:53.355366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f796aac-88dd-4557-865d-5820c3c47267 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:53.374903 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d264aae-e2d1-4380-95db-5786e5f293cd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:53.410664 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e8d5c-62ab-419f-97f1-3e179d742c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:53.411222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e8d5c-62ab-419f-97f1-3e179d742c22 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:53.411495 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e8d5c-62ab-419f-97f1-3e179d742c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:53.411760 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e8d5c-62ab-419f-97f1-3e179d742c22 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:53.412882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e8d5c-62ab-419f-97f1-3e179d742c22 None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:53.415509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e8d5c-62ab-419f-97f1-3e179d742c22 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:53.417503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 194/379] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:53 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:53.422985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e8d5c-62ab-419f-97f1-3e179d742c22 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:53.467953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:53.507297 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f796aac-88dd-4557-865d-5820c3c47267 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:53.522114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:53.556835 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968e26f-f286-40d7-bfd1-0a867a2141e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:53.557094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e8d5c-62ab-419f-97f1-3e179d742c22 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:53.557908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968e26f-f286-40d7-bfd1-0a867a2141e4 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:53.558332 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968e26f-f286-40d7-bfd1-0a867a2141e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:53.559025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968e26f-f286-40d7-bfd1-0a867a2141e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:53.560898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968e26f-f286-40d7-bfd1-0a867a2141e4 None admin] RBAC: Adding query filter params (group.id=3072b416d5f44a8295bb9abe50ffbe0d, role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=152f15d50a21447fba37927c712cf876) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:53.561384 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968e26f-f286-40d7-bfd1-0a867a2141e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:53.563127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968e26f-f286-40d7-bfd1-0a867a2141e4 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:53.570932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 186/380] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Aug 9 11:05:53 2022] GET /identity/v3/role_assignments?group.id=3072b416d5f44a8295bb9abe50ffbe0d&scope.project.id=152f15d50a21447fba37927c712cf876&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:53.574451 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968e26f-f286-40d7-bfd1-0a867a2141e4 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:53.626703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a84a3-b62a-4ada-b40c-a031de11ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:53.627649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a84a3-b62a-4ada-b40c-a031de11ac69 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:53.628075 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a84a3-b62a-4ada-b40c-a031de11ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:53.628485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a84a3-b62a-4ada-b40c-a031de11ac69 None admin] PATH_INFO: `/v3/groups/61f91f482e8041cdaff6e862ff0f22b2` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:53.631889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a84a3-b62a-4ada-b40c-a031de11ac69 None admin] RBAC: Authorizing `identity:get_group(group_id=61f91f482e8041cdaff6e862ff0f22b2)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:53.633590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a84a3-b62a-4ada-b40c-a031de11ac69 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:53.637969 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 195/381] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Aug 9 11:05:53 2022] GET /identity/v3/groups/61f91f482e8041cdaff6e862ff0f22b2 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:53.645048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a84a3-b62a-4ada-b40c-a031de11ac69 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:53.797415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968e26f-f286-40d7-bfd1-0a867a2141e4 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:53.851119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a84a3-b62a-4ada-b40c-a031de11ac69 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:53.856374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b9312-7239-46d1-bcc3-ebf7231deb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:53.857031 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b9312-7239-46d1-bcc3-ebf7231deb14 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:53.857304 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b9312-7239-46d1-bcc3-ebf7231deb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:53.857567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b9312-7239-46d1-bcc3-ebf7231deb14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:53.864013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:53.887541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b9312-7239-46d1-bcc3-ebf7231deb14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:53.891713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cec5b-4a3f-483a-9d94-132c6c2c590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-622b9312-7239-46d1-bcc3-ebf7231deb14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:53.892411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:53.893530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:53.894574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:53.894574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:53.894574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:53.894574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:53.894574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:53.894574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:53.894574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:53.894574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:53.894574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:53.894574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:53.894574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:53.894574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:53.895525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cec5b-4a3f-483a-9d94-132c6c2c590d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:53.895987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cec5b-4a3f-483a-9d94-132c6c2c590d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:53.896375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cec5b-4a3f-483a-9d94-132c6c2c590d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:53.897251 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cec5b-4a3f-483a-9d94-132c6c2c590d None admin] RBAC: Adding query filter params (group.id=61f91f482e8041cdaff6e862ff0f22b2, role.id=90f6c18c707742de8521c29b89d64215, scope.project.id=b1dee2813a11458fad814d5b53a5a15f) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:53.897727 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cec5b-4a3f-483a-9d94-132c6c2c590d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:53.899332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cec5b-4a3f-483a-9d94-132c6c2c590d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:53.901090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 187/382] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:53.902544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17357048-00e0-45e5-ab8c-d7ebb34624ce None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:53.902835 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17357048-00e0-45e5-ab8c-d7ebb34624ce None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:53.903105 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17357048-00e0-45e5-ab8c-d7ebb34624ce None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:53.904748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 188/383] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:53.906090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 196/384] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Aug 9 11:05:53 2022] GET /identity/v3/role_assignments?group.id=61f91f482e8041cdaff6e862ff0f22b2&scope.project.id=b1dee2813a11458fad814d5b53a5a15f&role.id=90f6c18c707742de8521c29b89d64215 => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:53.909822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17357048-00e0-45e5-ab8c-d7ebb34624ce None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:53.915371 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a62d-8619-4b49-9b24-c2a5f31d44a1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:53.915773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a62d-8619-4b49-9b24-c2a5f31d44a1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:53.916138 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a62d-8619-4b49-9b24-c2a5f31d44a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:53.956912 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8b42a62d-8619-4b49-9b24-c2a5f31d44a1 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:53.958703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8b42a62d-8619-4b49-9b24-c2a5f31d44a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:53.978203 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:54.098722 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 197/385] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:54.108283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17357048-00e0-45e5-ab8c-d7ebb34624ce None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:54.139104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42a62d-8619-4b49-9b24-c2a5f31d44a1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:54.160226 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deeab3-ca1a-4da8-ad0f-90ecfd8d8253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:54.160854 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deeab3-ca1a-4da8-ad0f-90ecfd8d8253 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:54.161131 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deeab3-ca1a-4da8-ad0f-90ecfd8d8253 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:54.161401 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81deeab3-ca1a-4da8-ad0f-90ecfd8d8253 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:54.163804 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81deeab3-ca1a-4da8-ad0f-90ecfd8d8253 None admin] RBAC: Adding query filter params (name=member) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:54.164109 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81deeab3-ca1a-4da8-ad0f-90ecfd8d8253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:54.165602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81deeab3-ca1a-4da8-ad0f-90ecfd8d8253 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:54.178809 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 189/386] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:54.186599 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deeab3-ca1a-4da8-ad0f-90ecfd8d8253 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:54.284151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:54.291242 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42a62d-8619-4b49-9b24-c2a5f31d44a1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:54.349953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24ea7d-a710-4f27-be21-da1ad5d184bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:54.350508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24ea7d-a710-4f27-be21-da1ad5d184bd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:54.350779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24ea7d-a710-4f27-be21-da1ad5d184bd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:54.351045 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24ea7d-a710-4f27-be21-da1ad5d184bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:54.360943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:54.370715 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24ea7d-a710-4f27-be21-da1ad5d184bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:54.372031 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81deeab3-ca1a-4da8-ad0f-90ecfd8d8253 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-ea24ea7d-a710-4f27-be21-da1ad5d184bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:54.377498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:54.378636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:54.380025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:54.380025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:54.380025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:54.380025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:54.380025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:54.380025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:54.380025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:54.380025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:54.380025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:54.380025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:54.380025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:54.380025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:54.383027 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 198/387] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:05:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:05:54.390631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24ea7d-a710-4f27-be21-da1ad5d184bd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:54.415263 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4f2e2-7cef-4dcd-bdaf-873d4ea5fc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:54.415904 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4f2e2-7cef-4dcd-bdaf-873d4ea5fc70 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:54.417316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4f2e2-7cef-4dcd-bdaf-873d4ea5fc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:54.417316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4f2e2-7cef-4dcd-bdaf-873d4ea5fc70 None admin] PATH_INFO: `/v3/groups/61f91f482e8041cdaff6e862ff0f22b2` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:54.417558 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4f2e2-7cef-4dcd-bdaf-873d4ea5fc70 None admin] RBAC: Authorizing `identity:get_group(group_id=61f91f482e8041cdaff6e862ff0f22b2)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:54.419074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4f2e2-7cef-4dcd-bdaf-873d4ea5fc70 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:54.422714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 190/388] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Aug 9 11:05:54 2022] GET /identity/v3/groups/61f91f482e8041cdaff6e862ff0f22b2 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:54.426545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4f2e2-7cef-4dcd-bdaf-873d4ea5fc70 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:54.542110 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24ea7d-a710-4f27-be21-da1ad5d184bd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:54.584717 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfa9c9-8abe-4be9-9708-a3d22f455dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:54.585508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfa9c9-8abe-4be9-9708-a3d22f455dbd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:54.585812 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfa9c9-8abe-4be9-9708-a3d22f455dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:54.586105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfa9c9-8abe-4be9-9708-a3d22f455dbd None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:54.587094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfa9c9-8abe-4be9-9708-a3d22f455dbd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:54.587395 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfa9c9-8abe-4be9-9708-a3d22f455dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:54.588889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfa9c9-8abe-4be9-9708-a3d22f455dbd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:54.594745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4f2e2-7cef-4dcd-bdaf-873d4ea5fc70 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:54.603557 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 199/389] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:05:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:54.622585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfa9c9-8abe-4be9-9708-a3d22f455dbd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:54.655187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bba1e1-385e-41ea-b0bd-f0cfbad1def0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:54.655591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:54.655843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bba1e1-385e-41ea-b0bd-f0cfbad1def0 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:54.656119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bba1e1-385e-41ea-b0bd-f0cfbad1def0 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:54.656388 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bba1e1-385e-41ea-b0bd-f0cfbad1def0 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:54.662563 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bba1e1-385e-41ea-b0bd-f0cfbad1def0 None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:54.664078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bba1e1-385e-41ea-b0bd-f0cfbad1def0 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:54.666365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 191/390] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:54 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:54.672545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bba1e1-385e-41ea-b0bd-f0cfbad1def0 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:54.717207 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:54.759982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfa9c9-8abe-4be9-9708-a3d22f455dbd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:54.801892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19432899-dadc-480d-bf91-69a2acbf2fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:54.802643 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432899-dadc-480d-bf91-69a2acbf2fdd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:54.802922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432899-dadc-480d-bf91-69a2acbf2fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:54.803196 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19432899-dadc-480d-bf91-69a2acbf2fdd None admin] PATH_INFO: `/v3/groups/61f91f482e8041cdaff6e862ff0f22b2` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:54.806287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19432899-dadc-480d-bf91-69a2acbf2fdd None admin] RBAC: Authorizing `identity:get_group(group_id=61f91f482e8041cdaff6e862ff0f22b2)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:54.807756 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19432899-dadc-480d-bf91-69a2acbf2fdd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:54.809977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 200/391] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Aug 9 11:05:54 2022] GET /identity/v3/groups/61f91f482e8041cdaff6e862ff0f22b2 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:54.817390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19432899-dadc-480d-bf91-69a2acbf2fdd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:54.825417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bba1e1-385e-41ea-b0bd-f0cfbad1def0 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:54.880640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65e2aa-597b-4c18-a126-14eb285878fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:54.881427 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65e2aa-597b-4c18-a126-14eb285878fc None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:54.881659 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65e2aa-597b-4c18-a126-14eb285878fc None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:54.881812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65e2aa-597b-4c18-a126-14eb285878fc None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b/groups/61f91f482e8041cdaff6e862ff0f22b2/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:54.886987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65e2aa-597b-4c18-a126-14eb285878fc None admin] RBAC: Authorizing `identity:create_grant(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b, group_id=61f91f482e8041cdaff6e862ff0f22b2, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:54.888474 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65e2aa-597b-4c18-a126-14eb285878fc None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:54.914757 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 192/392] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Aug 9 11:05:54 2022] PUT /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b/groups/61f91f482e8041cdaff6e862ff0f22b2/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:05:54.954083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:54.972235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19432899-dadc-480d-bf91-69a2acbf2fdd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:55.023139 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdc4e5-51a2-46a8-ad81-b36fac951ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:55.023814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdc4e5-51a2-46a8-ad81-b36fac951ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:55.024180 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdc4e5-51a2-46a8-ad81-b36fac951ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:55.024512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdc4e5-51a2-46a8-ad81-b36fac951ea6 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:55.025937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bdc4e5-51a2-46a8-ad81-b36fac951ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:55.027427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bdc4e5-51a2-46a8-ad81-b36fac951ea6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:55.029545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 201/393] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:54 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:55.035495 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65e2aa-597b-4c18-a126-14eb285878fc None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:55.140933 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cc8ae-ea78-49bc-a196-e70b01170bae None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:55.141117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cc8ae-ea78-49bc-a196-e70b01170bae None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:55.141386 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cc8ae-ea78-49bc-a196-e70b01170bae None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:55.142793 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 202/394] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:55.152492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31764b6a-dd88-4dd0-ab5b-aa22a1930f14 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:55.152803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31764b6a-dd88-4dd0-ab5b-aa22a1930f14 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:55.153046 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31764b6a-dd88-4dd0-ab5b-aa22a1930f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:55.164506 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:55.175482 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65e2aa-597b-4c18-a126-14eb285878fc None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:55.189203 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-31764b6a-dd88-4dd0-ab5b-aa22a1930f14 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:55.190584 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-31764b6a-dd88-4dd0-ab5b-aa22a1930f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:55.220013 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd065d-4afc-47c0-b20d-64533a068f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:55.220684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd065d-4afc-47c0-b20d-64533a068f70 None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:55.220951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd065d-4afc-47c0-b20d-64533a068f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:55.221210 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd065d-4afc-47c0-b20d-64533a068f70 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b/groups/61f91f482e8041cdaff6e862ff0f22b2/roles/90f6c18c707742de8521c29b89d64215` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:55.224620 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd065d-4afc-47c0-b20d-64533a068f70 None admin] RBAC: Authorizing `identity:create_grant(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b, group_id=61f91f482e8041cdaff6e862ff0f22b2, role_id=90f6c18c707742de8521c29b89d64215)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:55.226445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd065d-4afc-47c0-b20d-64533a068f70 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:55.251521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 193/395] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Aug 9 11:05:55 2022] PUT /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b/groups/61f91f482e8041cdaff6e862ff0f22b2/roles/90f6c18c707742de8521c29b89d64215 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:05:55.299137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 203/396] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 09 11:05:55.333999 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd065d-4afc-47c0-b20d-64533a068f70 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:55.476907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd065d-4afc-47c0-b20d-64533a068f70 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:55.515062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff206c-3572-436d-b780-7261a589d54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:55.515791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff206c-3572-436d-b780-7261a589d54a None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:55.516071 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff206c-3572-436d-b780-7261a589d54a None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:55.516339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff206c-3572-436d-b780-7261a589d54a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:55.528675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff206c-3572-436d-b780-7261a589d54a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-6eff206c-3572-436d-b780-7261a589d54a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:55.533523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:55.534499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:55.535301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:55.535301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:55.535301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:55.535301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:55.535301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:55.535301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:55.535301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:55.535301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:55.535301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:55.535301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:55.535301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:55.535301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:55.535301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 194/397] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:55.540941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31764b6a-dd88-4dd0-ab5b-aa22a1930f14 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:55.648429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:55.669164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31764b6a-dd88-4dd0-ab5b-aa22a1930f14 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:55.719594 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d067498-103f-44ba-a702-3859402603e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:55.720218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d067498-103f-44ba-a702-3859402603e3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:55.720547 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d067498-103f-44ba-a702-3859402603e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:55.720814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d067498-103f-44ba-a702-3859402603e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:55.721478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d067498-103f-44ba-a702-3859402603e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:55.721810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d067498-103f-44ba-a702-3859402603e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:55.723208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d067498-103f-44ba-a702-3859402603e3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:55.733034 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 204/398] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:55.738658 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff206c-3572-436d-b780-7261a589d54a None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:55.766702 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:55.890719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff206c-3572-436d-b780-7261a589d54a None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:55.936180 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83447b-c208-4bfe-bd09-0c0ed90a02e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:55.937222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83447b-c208-4bfe-bd09-0c0ed90a02e4 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:55.937719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83447b-c208-4bfe-bd09-0c0ed90a02e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:55.938180 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83447b-c208-4bfe-bd09-0c0ed90a02e4 None admin] PATH_INFO: `/v3/groups/61f91f482e8041cdaff6e862ff0f22b2` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:55.939577 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83447b-c208-4bfe-bd09-0c0ed90a02e4 None admin] RBAC: Authorizing `identity:get_group(group_id=61f91f482e8041cdaff6e862ff0f22b2)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:55.941240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83447b-c208-4bfe-bd09-0c0ed90a02e4 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:55.943397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 195/399] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Aug 9 11:05:55 2022] GET /identity/v3/groups/61f91f482e8041cdaff6e862ff0f22b2 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:55.950808 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d067498-103f-44ba-a702-3859402603e3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:56.083539 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d067498-103f-44ba-a702-3859402603e3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:56.120462 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd309ec2-39ac-4437-9a7d-b5fb0f1a1442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:56.121088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd309ec2-39ac-4437-9a7d-b5fb0f1a1442 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:56.121359 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd309ec2-39ac-4437-9a7d-b5fb0f1a1442 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:56.121646 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd309ec2-39ac-4437-9a7d-b5fb0f1a1442 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:56.122758 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd309ec2-39ac-4437-9a7d-b5fb0f1a1442 None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:56.124252 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd309ec2-39ac-4437-9a7d-b5fb0f1a1442 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:56.125935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 205/400] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:55 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:56.132294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83447b-c208-4bfe-bd09-0c0ed90a02e4 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:56.231907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:56.256752 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83447b-c208-4bfe-bd09-0c0ed90a02e4 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:56.299778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff34d4-017b-4e84-9171-c5f441f5ba46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:56.300450 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff34d4-017b-4e84-9171-c5f441f5ba46 None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:56.300723 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff34d4-017b-4e84-9171-c5f441f5ba46 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:56.300989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff34d4-017b-4e84-9171-c5f441f5ba46 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f/groups/61f91f482e8041cdaff6e862ff0f22b2/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:56.302942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff34d4-017b-4e84-9171-c5f441f5ba46 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1dee2813a11458fad814d5b53a5a15f, group_id=61f91f482e8041cdaff6e862ff0f22b2, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:56.304401 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff34d4-017b-4e84-9171-c5f441f5ba46 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:56.321385 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 196/401] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Aug 9 11:05:56 2022] PUT /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f/groups/61f91f482e8041cdaff6e862ff0f22b2/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:05:56.461835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae2761-ef84-4576-a1bf-72606d65abb2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:56.465373 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae2761-ef84-4576-a1bf-72606d65abb2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:56.465373 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae2761-ef84-4576-a1bf-72606d65abb2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:56.466389 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 206/402] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:56.471417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed2543-98f4-4522-ac1d-e514f9c0f775 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:56.471802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed2543-98f4-4522-ac1d-e514f9c0f775 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:56.471969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed2543-98f4-4522-ac1d-e514f9c0f775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:56.502874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-20ed2543-98f4-4522-ac1d-e514f9c0f775 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:56.504163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-20ed2543-98f4-4522-ac1d-e514f9c0f775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:56.606723 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 197/403] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:56.631942 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae2761-ef84-4576-a1bf-72606d65abb2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:56.672466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:56.769826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae2761-ef84-4576-a1bf-72606d65abb2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:56.816853 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1199d-38fa-4619-b77e-da241d016415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:56.817484 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1199d-38fa-4619-b77e-da241d016415 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:56.817799 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1199d-38fa-4619-b77e-da241d016415 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:56.818063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1199d-38fa-4619-b77e-da241d016415 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:56.829469 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1199d-38fa-4619-b77e-da241d016415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-44f1199d-38fa-4619-b77e-da241d016415 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:56.834831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:56.835837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:56.836713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:56.836713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:56.836713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:56.836713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:56.836713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:56.836713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:56.836713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:56.836713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:56.836713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:56.836713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:56.836713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:05:56.836713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:56.836713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 207/404] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:05:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:56.842204 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed2543-98f4-4522-ac1d-e514f9c0f775 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:56.928862 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:56.972656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed2543-98f4-4522-ac1d-e514f9c0f775 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:57.023430 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac71422-41de-4294-81fb-03a4a6f0556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:57.023978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac71422-41de-4294-81fb-03a4a6f0556f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:57.024342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac71422-41de-4294-81fb-03a4a6f0556f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:57.024604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac71422-41de-4294-81fb-03a4a6f0556f None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:57.025277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac71422-41de-4294-81fb-03a4a6f0556f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:57.025571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac71422-41de-4294-81fb-03a4a6f0556f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:57.027071 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac71422-41de-4294-81fb-03a4a6f0556f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:57.033596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32c959-1130-435b-b364-59df46cda04d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:57.033895 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32c959-1130-435b-b364-59df46cda04d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:57.034145 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32c959-1130-435b-b364-59df46cda04d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:57.035491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 208/405] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:57.040083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 198/406] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:57.045974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d6a57-ba2d-4281-9e87-6923365ae1a8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:57.046247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d6a57-ba2d-4281-9e87-6923365ae1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:57.046513 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d6a57-ba2d-4281-9e87-6923365ae1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:57.050584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac71422-41de-4294-81fb-03a4a6f0556f None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:57.078687 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e33d6a57-ba2d-4281-9e87-6923365ae1a8 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:57.079899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e33d6a57-ba2d-4281-9e87-6923365ae1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:57.174230 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac71422-41de-4294-81fb-03a4a6f0556f None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:57.204462 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:57.211812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca68491-a040-46df-a066-369446cfcc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:57.212730 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca68491-a040-46df-a066-369446cfcc61 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:57.213207 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca68491-a040-46df-a066-369446cfcc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:57.213689 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca68491-a040-46df-a066-369446cfcc61 None admin] PATH_INFO: `/v3/groups/3072b416d5f44a8295bb9abe50ffbe0d` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:57.215073 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca68491-a040-46df-a066-369446cfcc61 None admin] RBAC: Authorizing `identity:get_group(group_id=3072b416d5f44a8295bb9abe50ffbe0d)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:57.216766 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca68491-a040-46df-a066-369446cfcc61 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:57.218568 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 199/407] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Aug 9 11:05:57 2022] GET /identity/v3/groups/3072b416d5f44a8295bb9abe50ffbe0d => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:57.224958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca68491-a040-46df-a066-369446cfcc61 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:57.244552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 209/408] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:57.286813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d6a57-ba2d-4281-9e87-6923365ae1a8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:57.309988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:57.347325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca68491-a040-46df-a066-369446cfcc61 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:57.382377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cc70e-071e-44e2-a6c2-9a7219202d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:57.383008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cc70e-071e-44e2-a6c2-9a7219202d5f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:57.383279 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cc70e-071e-44e2-a6c2-9a7219202d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:57.383578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cc70e-071e-44e2-a6c2-9a7219202d5f None admin] PATH_INFO: `/v3/projects/152f15d50a21447fba37927c712cf876` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:57.384685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cc70e-071e-44e2-a6c2-9a7219202d5f None admin] RBAC: Authorizing `identity:get_project(project_id=152f15d50a21447fba37927c712cf876)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:57.386279 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cc70e-071e-44e2-a6c2-9a7219202d5f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:57.388339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 200/409] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:57 2022] GET /identity/v3/projects/152f15d50a21447fba37927c712cf876 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:57.401163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cc70e-071e-44e2-a6c2-9a7219202d5f None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:57.478962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d6a57-ba2d-4281-9e87-6923365ae1a8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:57.519776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:57.547779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761299e-8983-4ffe-b713-8facf79cad33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:57.548426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761299e-8983-4ffe-b713-8facf79cad33 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:57.548692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761299e-8983-4ffe-b713-8facf79cad33 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:57.548954 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761299e-8983-4ffe-b713-8facf79cad33 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:57.567654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761299e-8983-4ffe-b713-8facf79cad33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-a761299e-8983-4ffe-b713-8facf79cad33 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:57.574670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:57.575595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:57.576420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:57.576420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:57.576420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:57.576420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:57.576420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:57.576420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:57.576420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:57.576420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:57.576420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:57.576420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:57.576420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:57.576420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:57.576420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 210/410] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:05:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:57.584697 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761299e-8983-4ffe-b713-8facf79cad33 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:57.589128 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cc70e-071e-44e2-a6c2-9a7219202d5f None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:57.629701 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b571b0-a20b-4800-b614-408dd61413d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:57.630393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b571b0-a20b-4800-b614-408dd61413d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:57.630664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b571b0-a20b-4800-b614-408dd61413d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:57.631378 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b571b0-a20b-4800-b614-408dd61413d5 None admin] PATH_INFO: `/v3/projects/152f15d50a21447fba37927c712cf876/groups/3072b416d5f44a8295bb9abe50ffbe0d/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:57.634022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b571b0-a20b-4800-b614-408dd61413d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=152f15d50a21447fba37927c712cf876, group_id=3072b416d5f44a8295bb9abe50ffbe0d, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:57.635730 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b571b0-a20b-4800-b614-408dd61413d5 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:57.657746 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 201/411] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Aug 9 11:05:57 2022] PUT /identity/v3/projects/152f15d50a21447fba37927c712cf876/groups/3072b416d5f44a8295bb9abe50ffbe0d/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:05:57.659486 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076ec09-21a3-43e9-aa33-5201aa3923c3 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:57.659808 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076ec09-21a3-43e9-aa33-5201aa3923c3 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:57.660164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076ec09-21a3-43e9-aa33-5201aa3923c3 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:57.662067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 202/412] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:57.671867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bfaff-766d-4540-a58b-12275014a199 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:57.672203 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bfaff-766d-4540-a58b-12275014a199 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:57.672418 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bfaff-766d-4540-a58b-12275014a199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:57.677933 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:57.714233 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-f98bfaff-766d-4540-a58b-12275014a199 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:57.716442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f98bfaff-766d-4540-a58b-12275014a199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:57.750897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761299e-8983-4ffe-b713-8facf79cad33 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:57.832021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44332b8-949b-4831-be7b-22bc33ff9903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:57.832557 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44332b8-949b-4831-be7b-22bc33ff9903 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:57.832828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44332b8-949b-4831-be7b-22bc33ff9903 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:57.833098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44332b8-949b-4831-be7b-22bc33ff9903 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:57.833810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44332b8-949b-4831-be7b-22bc33ff9903 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:57.834112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44332b8-949b-4831-be7b-22bc33ff9903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:57.835524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44332b8-949b-4831-be7b-22bc33ff9903 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:57.853204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 211/413] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:05:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:57.859180 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 203/414] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:05:57.860447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44332b8-949b-4831-be7b-22bc33ff9903 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:57.883013 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bfaff-766d-4540-a58b-12275014a199 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:57.950987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:57.981816 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44332b8-949b-4831-be7b-22bc33ff9903 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:58.017914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bfaff-766d-4540-a58b-12275014a199 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:58.027069 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:58.036648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b66eb-4b1d-4108-8002-1737b1ee2c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:58.037760 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b66eb-4b1d-4108-8002-1737b1ee2c84 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:58.038428 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b66eb-4b1d-4108-8002-1737b1ee2c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:58.038971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b66eb-4b1d-4108-8002-1737b1ee2c84 None admin] PATH_INFO: `/v3/groups/61f91f482e8041cdaff6e862ff0f22b2` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:58.040777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b66eb-4b1d-4108-8002-1737b1ee2c84 None admin] RBAC: Authorizing `identity:get_group(group_id=61f91f482e8041cdaff6e862ff0f22b2)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:58.043051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b66eb-4b1d-4108-8002-1737b1ee2c84 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:58.045565 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 212/415] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Aug 9 11:05:57 2022] GET /identity/v3/groups/61f91f482e8041cdaff6e862ff0f22b2 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:58.047050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c713a-5c9e-4372-b1c4-62bfa0d0c4fb None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:58.047660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c713a-5c9e-4372-b1c4-62bfa0d0c4fb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:58.048161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c713a-5c9e-4372-b1c4-62bfa0d0c4fb None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:58.050016 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 213/416] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:58.051253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c713a-5c9e-4372-b1c4-62bfa0d0c4fb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:58.060205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a95ec0-2b58-4647-b152-942bf554179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:58.060992 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a95ec0-2b58-4647-b152-942bf554179e None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:58.061394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a95ec0-2b58-4647-b152-942bf554179e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:58.062347 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a95ec0-2b58-4647-b152-942bf554179e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:58.076517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a95ec0-2b58-4647-b152-942bf554179e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-c3a95ec0-2b58-4647-b152-942bf554179e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:58.082726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:58.083760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:58.084576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:58.084576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:58.084576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:58.084576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:58.084576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:58.084576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:58.084576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:58.084576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:58.084576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:58.084576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:58.084576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:58.084576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:58.084576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 204/417] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:05:58.090127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ff35f-7f43-43dd-9444-90213016a547 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:58.090681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ff35f-7f43-43dd-9444-90213016a547 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:58.091108 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ff35f-7f43-43dd-9444-90213016a547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:58.112544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-315ff35f-7f43-43dd-9444-90213016a547 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:58.114582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-315ff35f-7f43-43dd-9444-90213016a547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:58.195050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c713a-5c9e-4372-b1c4-62bfa0d0c4fb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:58.217647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 205/418] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:58.217647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ff35f-7f43-43dd-9444-90213016a547 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:58.269921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d38976-edb9-4987-934c-f3b8fb8b2637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:58.270744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:58.272279 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d38976-edb9-4987-934c-f3b8fb8b2637 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:58.273070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d38976-edb9-4987-934c-f3b8fb8b2637 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:58.273844 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d38976-edb9-4987-934c-f3b8fb8b2637 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:58.276755 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d38976-edb9-4987-934c-f3b8fb8b2637 None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:58.280905 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d38976-edb9-4987-934c-f3b8fb8b2637 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:58.285115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 214/419] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:58 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:58.287010 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d38976-edb9-4987-934c-f3b8fb8b2637 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:58.334677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ff35f-7f43-43dd-9444-90213016a547 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:58.368943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa33e4e-9f51-4cbb-99c7-7563a329df9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:58.369548 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa33e4e-9f51-4cbb-99c7-7563a329df9c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:58.369855 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa33e4e-9f51-4cbb-99c7-7563a329df9c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:58.370091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa33e4e-9f51-4cbb-99c7-7563a329df9c None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:58.370746 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa33e4e-9f51-4cbb-99c7-7563a329df9c None admin] RBAC: Adding query filter params (name=member) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:58.371057 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa33e4e-9f51-4cbb-99c7-7563a329df9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:58.372409 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa33e4e-9f51-4cbb-99c7-7563a329df9c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:58.386686 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 206/420] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:58.387576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa33e4e-9f51-4cbb-99c7-7563a329df9c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:58.404990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:58.478498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d38976-edb9-4987-934c-f3b8fb8b2637 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:58.503391 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa33e4e-9f51-4cbb-99c7-7563a329df9c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:58.514866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:58.523970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b89c46-7184-4088-97fc-b8593d732c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:58.525200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b89c46-7184-4088-97fc-b8593d732c99 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:58.526006 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b89c46-7184-4088-97fc-b8593d732c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:58.526421 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b89c46-7184-4088-97fc-b8593d732c99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:58.542312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b89c46-7184-4088-97fc-b8593d732c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:58.543657 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65688c07-9b9f-429c-9761-fdc75fbd55b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:58.544436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65688c07-9b9f-429c-9761-fdc75fbd55b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:58.544875 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65688c07-9b9f-429c-9761-fdc75fbd55b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:58.545231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65688c07-9b9f-429c-9761-fdc75fbd55b8 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f/groups/61f91f482e8041cdaff6e862ff0f22b2/roles/90f6c18c707742de8521c29b89d64215` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:58.547608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65688c07-9b9f-429c-9761-fdc75fbd55b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1dee2813a11458fad814d5b53a5a15f, group_id=61f91f482e8041cdaff6e862ff0f22b2, role_id=90f6c18c707742de8521c29b89d64215)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-22b89c46-7184-4088-97fc-b8593d732c99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:58.549048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:58.550128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:58.551244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:58.551244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:58.551244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:58.551244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:58.551244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:58.551244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:58.551244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:58.551244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:58.551244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:58.551244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:58.551244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:05:58.551244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:05:58.551996 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65688c07-9b9f-429c-9761-fdc75fbd55b8 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:58.558228 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 215/421] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:05:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:58.559867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b89c46-7184-4088-97fc-b8593d732c99 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:58.573040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 207/422] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Aug 9 11:05:58 2022] PUT /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f/groups/61f91f482e8041cdaff6e862ff0f22b2/roles/90f6c18c707742de8521c29b89d64215 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:05:58.573909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65688c07-9b9f-429c-9761-fdc75fbd55b8 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:58.678853 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b89c46-7184-4088-97fc-b8593d732c99 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:58.697475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65688c07-9b9f-429c-9761-fdc75fbd55b8 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:58.707430 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:58.721477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b1814-0c2f-416d-8434-82581d04efbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:58.722526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b1814-0c2f-416d-8434-82581d04efbf None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:58.722999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b1814-0c2f-416d-8434-82581d04efbf None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:58.723460 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b1814-0c2f-416d-8434-82581d04efbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:58.741191 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0d1b4-3353-4855-9302-8a8190c29ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:58.741874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0d1b4-3353-4855-9302-8a8190c29ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:58.742143 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0d1b4-3353-4855-9302-8a8190c29ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:58.742410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0d1b4-3353-4855-9302-8a8190c29ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:58.743202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0d1b4-3353-4855-9302-8a8190c29ff0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:58.743502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0d1b4-3353-4855-9302-8a8190c29ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:58.745050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0d1b4-3353-4855-9302-8a8190c29ff0 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:58.755748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 208/423] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:05:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:58.761982 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0d1b4-3353-4855-9302-8a8190c29ff0 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:58.798717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:58.813882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b1814-0c2f-416d-8434-82581d04efbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:58.815875 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b1814-0c2f-416d-8434-82581d04efbf None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:58.890179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0d1b4-3353-4855-9302-8a8190c29ff0 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:58.926850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d279b-bd63-4159-b072-a0544f62ae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:58.927456 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d279b-bd63-4159-b072-a0544f62ae35 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:58.927727 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d279b-bd63-4159-b072-a0544f62ae35 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:58.927991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d279b-bd63-4159-b072-a0544f62ae35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:58.936973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 216/424] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:05:58.943704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b1814-0c2f-416d-8434-82581d04efbf None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:58.971710 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:59.005495 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d279b-bd63-4159-b072-a0544f62ae35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:59.007012 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d279b-bd63-4159-b072-a0544f62ae35 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:59.041001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:59.059816 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b1814-0c2f-416d-8434-82581d04efbf None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:59.097347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd687ef-548f-4dbe-806b-c4ca383315e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:59.098528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd687ef-548f-4dbe-806b-c4ca383315e0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:59.099142 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd687ef-548f-4dbe-806b-c4ca383315e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:59.099623 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd687ef-548f-4dbe-806b-c4ca383315e0 None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:59.101004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd687ef-548f-4dbe-806b-c4ca383315e0 None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:59.102898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd687ef-548f-4dbe-806b-c4ca383315e0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:59.105164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 217/425] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:58 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:59.110889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd687ef-548f-4dbe-806b-c4ca383315e0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:59.119401 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 209/426] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:05:59.121179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcee6d7-dd48-486c-9167-0f5d5b7aa3a1 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:59.121179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcee6d7-dd48-486c-9167-0f5d5b7aa3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:59.121444 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcee6d7-dd48-486c-9167-0f5d5b7aa3a1 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:59.127387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 210/427] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:05:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:05:59.128265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcee6d7-dd48-486c-9167-0f5d5b7aa3a1 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:59.215105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:59.225684 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd687ef-548f-4dbe-806b-c4ca383315e0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:59.242542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcee6d7-dd48-486c-9167-0f5d5b7aa3a1 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:59.266310 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a7744-74cb-4a91-8e17-ada66bda1c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:59.267406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a7744-74cb-4a91-8e17-ada66bda1c63 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:59.267894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a7744-74cb-4a91-8e17-ada66bda1c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:59.268357 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a7744-74cb-4a91-8e17-ada66bda1c63 None admin] PATH_INFO: `/v3/groups/61f91f482e8041cdaff6e862ff0f22b2` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:59.269911 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a7744-74cb-4a91-8e17-ada66bda1c63 None admin] RBAC: Authorizing `identity:get_group(group_id=61f91f482e8041cdaff6e862ff0f22b2)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:59.271603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a7744-74cb-4a91-8e17-ada66bda1c63 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:59.279226 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 218/428] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Aug 9 11:05:59 2022] GET /identity/v3/groups/61f91f482e8041cdaff6e862ff0f22b2 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:59.279967 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:59.282486 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd51d-49e3-47a8-be54-0303bf89b37b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:59.282864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2a0ca-cee8-4591-ba77-aa1ec1b8686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:59.283273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd51d-49e3-47a8-be54-0303bf89b37b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:59.283524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2a0ca-cee8-4591-ba77-aa1ec1b8686f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:59.283861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2a0ca-cee8-4591-ba77-aa1ec1b8686f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:59.284133 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2a0ca-cee8-4591-ba77-aa1ec1b8686f None admin] PATH_INFO: `/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:59.284371 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabd51d-49e3-47a8-be54-0303bf89b37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:59.285475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2a0ca-cee8-4591-ba77-aa1ec1b8686f None admin] RBAC: Authorizing `identity:get_project(project_id=d10f9f9fe8fa4aa4bed43e57384ef26b)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:59.287477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2a0ca-cee8-4591-ba77-aa1ec1b8686f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:59.289657 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 211/429] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:05:59 2022] GET /identity/v3/projects/d10f9f9fe8fa4aa4bed43e57384ef26b => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:59.295349 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2a0ca-cee8-4591-ba77-aa1ec1b8686f None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:59.305446 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5aabd51d-49e3-47a8-be54-0303bf89b37b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:05:59.306996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5aabd51d-49e3-47a8-be54-0303bf89b37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:05:59.379670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 219/430] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:05:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:05:59.380943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabd51d-49e3-47a8-be54-0303bf89b37b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:59.403767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2a0ca-cee8-4591-ba77-aa1ec1b8686f None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:59.440753 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e02ecf-f53a-4d36-9f0c-b5f1a54e2fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:59.441492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e02ecf-f53a-4d36-9f0c-b5f1a54e2fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:59.441759 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e02ecf-f53a-4d36-9f0c-b5f1a54e2fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:59.442021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e02ecf-f53a-4d36-9f0c-b5f1a54e2fa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:59.442835 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e02ecf-f53a-4d36-9f0c-b5f1a54e2fa4 None admin] RBAC: Adding query filter params (group.id=61f91f482e8041cdaff6e862ff0f22b2, role.id=186990d6368647b5b0712c4fedf4afd9, scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:59.443091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e02ecf-f53a-4d36-9f0c-b5f1a54e2fa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:59.444661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e02ecf-f53a-4d36-9f0c-b5f1a54e2fa4 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:59.451634 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 212/431] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Aug 9 11:05:59 2022] GET /identity/v3/role_assignments?group.id=61f91f482e8041cdaff6e862ff0f22b2&scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b&role.id=186990d6368647b5b0712c4fedf4afd9 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:59.457800 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e02ecf-f53a-4d36-9f0c-b5f1a54e2fa4 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:59.543484 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:59.550412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:59.572582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e02ecf-f53a-4d36-9f0c-b5f1a54e2fa4 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:59.574907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabd51d-49e3-47a8-be54-0303bf89b37b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:59.615544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0e4e8-0fb3-41ad-b47b-7faf466adc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:59.616204 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0e4e8-0fb3-41ad-b47b-7faf466adc3c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:59.616473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0e4e8-0fb3-41ad-b47b-7faf466adc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:59.616734 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0e4e8-0fb3-41ad-b47b-7faf466adc3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:59.630008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0e4e8-0fb3-41ad-b47b-7faf466adc3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-42b0e4e8-0fb3-41ad-b47b-7faf466adc3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:05:59.635789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:05:59.636765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:05:59.637580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:05:59.637580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:05:59.637580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:05:59.637580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:05:59.637580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:05:59.637580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:05:59.637580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:05:59.637580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:05:59.637580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:05:59.637580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:05:59.637580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 11:05:59.637580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:05:59.637580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 213/432] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:05:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:05:59.646127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0e4e8-0fb3-41ad-b47b-7faf466adc3c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:59.689970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8cba2-198d-43a4-a6f3-58aee6cb1748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:59.690636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8cba2-198d-43a4-a6f3-58aee6cb1748 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:59.690912 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8cba2-198d-43a4-a6f3-58aee6cb1748 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:59.691183 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8cba2-198d-43a4-a6f3-58aee6cb1748 None admin] PATH_INFO: `/v3/groups/61f91f482e8041cdaff6e862ff0f22b2` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:59.694657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8cba2-198d-43a4-a6f3-58aee6cb1748 None admin] RBAC: Authorizing `identity:get_group(group_id=61f91f482e8041cdaff6e862ff0f22b2)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:59.697404 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8cba2-198d-43a4-a6f3-58aee6cb1748 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:59.704341 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 220/433] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Aug 9 11:05:59 2022] GET /identity/v3/groups/61f91f482e8041cdaff6e862ff0f22b2 => generated 226 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:59.708871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8cba2-198d-43a4-a6f3-58aee6cb1748 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:59.788657 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0e4e8-0fb3-41ad-b47b-7faf466adc3c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:59.814977 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:05:59.835077 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca99ad-2094-4bb5-9418-594619125352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:59.835946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca99ad-2094-4bb5-9418-594619125352 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:59.836743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca99ad-2094-4bb5-9418-594619125352 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:59.837084 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca99ad-2094-4bb5-9418-594619125352 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:59.838090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca99ad-2094-4bb5-9418-594619125352 None admin] RBAC: Adding query filter params (name=member) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:59.838404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca99ad-2094-4bb5-9418-594619125352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:59.840399 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca99ad-2094-4bb5-9418-594619125352 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:59.847838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8cba2-198d-43a4-a6f3-58aee6cb1748 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:05:59.857810 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 214/434] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:05:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:05:59.860028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca99ad-2094-4bb5-9418-594619125352 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:05:59.896167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd70f3-9860-4cf1-9351-8826df6c1b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:05:59.897015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd70f3-9860-4cf1-9351-8826df6c1b38 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:05:59.897290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd70f3-9860-4cf1-9351-8826df6c1b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:05:59.897998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd70f3-9860-4cf1-9351-8826df6c1b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:05:59.899017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd70f3-9860-4cf1-9351-8826df6c1b38 None admin] RBAC: Adding query filter params (group.id=61f91f482e8041cdaff6e862ff0f22b2, role.id=90f6c18c707742de8521c29b89d64215, scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:05:59.899332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd70f3-9860-4cf1-9351-8826df6c1b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:05:59.901423 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd70f3-9860-4cf1-9351-8826df6c1b38 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:05:59.909340 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 221/435] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Aug 9 11:05:59 2022] GET /identity/v3/role_assignments?group.id=61f91f482e8041cdaff6e862ff0f22b2&scope.project.id=d10f9f9fe8fa4aa4bed43e57384ef26b&role.id=90f6c18c707742de8521c29b89d64215 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:05:59.984291 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca99ad-2094-4bb5-9418-594619125352 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:00.024480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2eb93-50eb-417f-9c68-0a1d4d462915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:00.025131 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2eb93-50eb-417f-9c68-0a1d4d462915 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:00.025356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2eb93-50eb-417f-9c68-0a1d4d462915 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:00.025648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2eb93-50eb-417f-9c68-0a1d4d462915 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:00.086763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:00.095137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c644ebb-7133-43e5-8e52-66ed48d1e71e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:00.095572 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c644ebb-7133-43e5-8e52-66ed48d1e71e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:00.095887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c644ebb-7133-43e5-8e52-66ed48d1e71e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:00.098013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 222/436] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:06:00.104608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c5679-fb88-4546-a619-cbe075f4053b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:00.104608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c5679-fb88-4546-a619-cbe075f4053b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:00.104608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c5679-fb88-4546-a619-cbe075f4053b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:00.106583 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2eb93-50eb-417f-9c68-0a1d4d462915 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:00.107088 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2eb93-50eb-417f-9c68-0a1d4d462915 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:00.131656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6c1c5679-fb88-4546-a619-cbe075f4053b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:00.132108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6c1c5679-fb88-4546-a619-cbe075f4053b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:00.159332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:00.231205 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 223/437] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:06:00.241715 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 215/438] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:05:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:06:00.243159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c5679-fb88-4546-a619-cbe075f4053b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:00.258474 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2eb93-50eb-417f-9c68-0a1d4d462915 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:00.374744 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c5679-fb88-4546-a619-cbe075f4053b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:00.388557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:00.414507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2eb93-50eb-417f-9c68-0a1d4d462915 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:00.425727 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38dfc9-2c69-43fa-be07-7243d2b72d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:00.427170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38dfc9-2c69-43fa-be07-7243d2b72d0a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:00.427902 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38dfc9-2c69-43fa-be07-7243d2b72d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:00.428593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38dfc9-2c69-43fa-be07-7243d2b72d0a None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:00.431432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38dfc9-2c69-43fa-be07-7243d2b72d0a None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:00.433281 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38dfc9-2c69-43fa-be07-7243d2b72d0a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:00.435548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 224/439] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:06:00 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:00.441420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38dfc9-2c69-43fa-be07-7243d2b72d0a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:00.465211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de90980-0cbb-473b-9a3a-3befb02aaef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:00.466289 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:00.466400 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de90980-0cbb-473b-9a3a-3befb02aaef3 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:00.466840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de90980-0cbb-473b-9a3a-3befb02aaef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:00.467271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de90980-0cbb-473b-9a3a-3befb02aaef3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:00.499610 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de90980-0cbb-473b-9a3a-3befb02aaef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-4de90980-0cbb-473b-9a3a-3befb02aaef3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:00.504749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:00.505806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:00.506923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:00.506923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:00.506923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:00.506923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:00.506923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:00.506923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:00.506923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:00.506923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:00.506923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:00.506923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:00.506923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:06:00.506923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:00.506923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 216/440] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:06:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:00.512773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de90980-0cbb-473b-9a3a-3befb02aaef3 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:00.577784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38dfc9-2c69-43fa-be07-7243d2b72d0a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:00.619425 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e974c-8d96-4aef-9073-ec42f2da193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:00.620056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e974c-8d96-4aef-9073-ec42f2da193e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:00.620327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e974c-8d96-4aef-9073-ec42f2da193e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:00.620594 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e974c-8d96-4aef-9073-ec42f2da193e None admin] PATH_INFO: `/v3/groups/61f91f482e8041cdaff6e862ff0f22b2` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:00.621709 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e974c-8d96-4aef-9073-ec42f2da193e None admin] RBAC: Authorizing `identity:get_group(group_id=61f91f482e8041cdaff6e862ff0f22b2)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:00.623132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e974c-8d96-4aef-9073-ec42f2da193e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:00.624921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 225/441] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Aug 9 11:06:00 2022] GET /identity/v3/groups/61f91f482e8041cdaff6e862ff0f22b2 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:00.631038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e974c-8d96-4aef-9073-ec42f2da193e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:00.639206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de90980-0cbb-473b-9a3a-3befb02aaef3 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:00.677193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d1c84-6157-4727-aee9-35c3cf8ccdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:00.677936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d1c84-6157-4727-aee9-35c3cf8ccdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:00.678207 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d1c84-6157-4727-aee9-35c3cf8ccdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:00.678469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d1c84-6157-4727-aee9-35c3cf8ccdb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:00.679263 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d1c84-6157-4727-aee9-35c3cf8ccdb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:00.679557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d1c84-6157-4727-aee9-35c3cf8ccdb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:00.680996 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d1c84-6157-4727-aee9-35c3cf8ccdb8 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:00.691553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 217/442] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:06:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:00.696954 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d1c84-6157-4727-aee9-35c3cf8ccdb8 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:00.706767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:00.732300 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:00.744337 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e974c-8d96-4aef-9073-ec42f2da193e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:00.780420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf3ece-ddc6-4fc3-b39f-23eb9104e79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:00.781038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf3ece-ddc6-4fc3-b39f-23eb9104e79b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:00.781311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf3ece-ddc6-4fc3-b39f-23eb9104e79b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:00.781577 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf3ece-ddc6-4fc3-b39f-23eb9104e79b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:00.782340 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf3ece-ddc6-4fc3-b39f-23eb9104e79b None admin] RBAC: Adding query filter params (group.id=61f91f482e8041cdaff6e862ff0f22b2, role.id=186990d6368647b5b0712c4fedf4afd9, scope.project.id=b1dee2813a11458fad814d5b53a5a15f) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:00.782695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf3ece-ddc6-4fc3-b39f-23eb9104e79b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:00.784123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf3ece-ddc6-4fc3-b39f-23eb9104e79b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:00.801668 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 226/443] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Aug 9 11:06:00 2022] GET /identity/v3/role_assignments?group.id=61f91f482e8041cdaff6e862ff0f22b2&scope.project.id=b1dee2813a11458fad814d5b53a5a15f&role.id=186990d6368647b5b0712c4fedf4afd9 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:00.829424 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d1c84-6157-4727-aee9-35c3cf8ccdb8 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:00.867763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d83f3d-78f8-42d1-aef0-1fb7a810f378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:00.868413 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d83f3d-78f8-42d1-aef0-1fb7a810f378 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:00.868686 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d83f3d-78f8-42d1-aef0-1fb7a810f378 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:00.868951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d83f3d-78f8-42d1-aef0-1fb7a810f378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:00.944151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d83f3d-78f8-42d1-aef0-1fb7a810f378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:00.945556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d83f3d-78f8-42d1-aef0-1fb7a810f378 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:00.954268 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:01.056162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 218/444] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:06:01.061684 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf3ece-ddc6-4fc3-b39f-23eb9104e79b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:01.071440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001ebdd-b304-4347-a78c-4ca9a7006429 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:01.071765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001ebdd-b304-4347-a78c-4ca9a7006429 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:01.071974 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001ebdd-b304-4347-a78c-4ca9a7006429 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:01.073489 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 219/445] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:06:01.080999 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b23835-0e18-472d-8adc-6c244f3cb404 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:01.081254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b23835-0e18-472d-8adc-6c244f3cb404 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:01.081503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b23835-0e18-472d-8adc-6c244f3cb404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:01.104472 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-93b23835-0e18-472d-8adc-6c244f3cb404 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:01.106607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-93b23835-0e18-472d-8adc-6c244f3cb404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:01.185091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 220/446] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:06:01.185290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf3ece-ddc6-4fc3-b39f-23eb9104e79b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:01.208189 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b23835-0e18-472d-8adc-6c244f3cb404 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:01.218095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990ea74-12a2-4c57-9d63-45d868ea2e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:01.218723 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990ea74-12a2-4c57-9d63-45d868ea2e58 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:01.218992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990ea74-12a2-4c57-9d63-45d868ea2e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:01.219230 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990ea74-12a2-4c57-9d63-45d868ea2e58 None admin] PATH_INFO: `/v3/projects/152f15d50a21447fba37927c712cf876` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:01.220377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990ea74-12a2-4c57-9d63-45d868ea2e58 None admin] RBAC: Authorizing `identity:get_project(project_id=152f15d50a21447fba37927c712cf876)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:01.221831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990ea74-12a2-4c57-9d63-45d868ea2e58 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:01.223477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 227/447] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:06:01 2022] GET /identity/v3/projects/152f15d50a21447fba37927c712cf876 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:01.229125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990ea74-12a2-4c57-9d63-45d868ea2e58 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:01.243315 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:01.251257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:01.313074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b23835-0e18-472d-8adc-6c244f3cb404 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:01.329206 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990ea74-12a2-4c57-9d63-45d868ea2e58 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:01.347028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eae53-9776-4075-a728-cc5d3ca1f4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:01.347645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eae53-9776-4075-a728-cc5d3ca1f4ac None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:01.347913 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eae53-9776-4075-a728-cc5d3ca1f4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:01.348173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eae53-9776-4075-a728-cc5d3ca1f4ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:01.358348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870eae53-9776-4075-a728-cc5d3ca1f4ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:01.362108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd365722-e923-42ba-be2b-97173bb39383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:01.362736 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd365722-e923-42ba-be2b-97173bb39383 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-870eae53-9776-4075-a728-cc5d3ca1f4ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:01.362983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:01.363957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:01.365011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:01.365011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:01.365011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:01.365011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:01.365011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:01.365011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:01.365011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:01.365011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:01.365011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:01.365011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:01.365011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:06:01.365011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:01.366072 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd365722-e923-42ba-be2b-97173bb39383 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:01.366072 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd365722-e923-42ba-be2b-97173bb39383 None admin] PATH_INFO: `/v3/groups/3072b416d5f44a8295bb9abe50ffbe0d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:01.366072 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd365722-e923-42ba-be2b-97173bb39383 None admin] RBAC: Authorizing `identity:get_group(group_id=3072b416d5f44a8295bb9abe50ffbe0d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:01.366304 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 221/448] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:06:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:01.366400 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd365722-e923-42ba-be2b-97173bb39383 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:01.367621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 228/449] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Aug 9 11:06:01 2022] GET /identity/v3/groups/3072b416d5f44a8295bb9abe50ffbe0d => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:01.370285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eae53-9776-4075-a728-cc5d3ca1f4ac None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:01.373224 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd365722-e923-42ba-be2b-97173bb39383 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:01.467870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:01.475102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eae53-9776-4075-a728-cc5d3ca1f4ac None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:01.479345 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:01.488880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd365722-e923-42ba-be2b-97173bb39383 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:01.513113 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7fc43-07d4-401a-9099-c30c48356c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:01.513741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7fc43-07d4-401a-9099-c30c48356c94 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:01.514013 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7fc43-07d4-401a-9099-c30c48356c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:01.514273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7fc43-07d4-401a-9099-c30c48356c94 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:01.515020 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7fc43-07d4-401a-9099-c30c48356c94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:01.515319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7fc43-07d4-401a-9099-c30c48356c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:01.516700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7fc43-07d4-401a-9099-c30c48356c94 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:01.524496 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2056ac-87c6-4837-81d6-6ac3d35c225e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:01.525205 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2056ac-87c6-4837-81d6-6ac3d35c225e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:01.525545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2056ac-87c6-4837-81d6-6ac3d35c225e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:01.525905 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2056ac-87c6-4837-81d6-6ac3d35c225e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:01.526525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 222/450] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:01.526632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2056ac-87c6-4837-81d6-6ac3d35c225e None admin] RBAC: Adding query filter params (group.id=3072b416d5f44a8295bb9abe50ffbe0d, role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=152f15d50a21447fba37927c712cf876) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:01.526925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2056ac-87c6-4837-81d6-6ac3d35c225e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:01.528378 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2056ac-87c6-4837-81d6-6ac3d35c225e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:01.532149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7fc43-07d4-401a-9099-c30c48356c94 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:01.549652 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 229/451] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Aug 9 11:06:01 2022] GET /identity/v3/role_assignments?group.id=3072b416d5f44a8295bb9abe50ffbe0d&scope.project.id=152f15d50a21447fba37927c712cf876&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:01.640171 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7fc43-07d4-401a-9099-c30c48356c94 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:01.679117 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e533e-5df4-4e88-b7be-b5049f050c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:01.679747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e533e-5df4-4e88-b7be-b5049f050c6c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:01.680022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e533e-5df4-4e88-b7be-b5049f050c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:01.680293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e533e-5df4-4e88-b7be-b5049f050c6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:01.708774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:01.750721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e533e-5df4-4e88-b7be-b5049f050c6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:01.752112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e533e-5df4-4e88-b7be-b5049f050c6c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:01.852832 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 223/452] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:06:01.858975 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2056ac-87c6-4837-81d6-6ac3d35c225e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:01.962490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2056ac-87c6-4837-81d6-6ac3d35c225e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:02.001676 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aab75-cf55-4e0d-acf2-0e79c241aa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:02.002457 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aab75-cf55-4e0d-acf2-0e79c241aa58 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:02.002846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aab75-cf55-4e0d-acf2-0e79c241aa58 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:02.003215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aab75-cf55-4e0d-acf2-0e79c241aa58 None admin] PATH_INFO: `/v3/projects/b1dee2813a11458fad814d5b53a5a15f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:02.005457 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aab75-cf55-4e0d-acf2-0e79c241aa58 None admin] RBAC: Authorizing `identity:get_project(project_id=b1dee2813a11458fad814d5b53a5a15f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:02.007752 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aab75-cf55-4e0d-acf2-0e79c241aa58 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:02.009842 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 230/453] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:06:01 2022] GET /identity/v3/projects/b1dee2813a11458fad814d5b53a5a15f => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:02.015729 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e533e-5df4-4e88-b7be-b5049f050c6c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:02.077744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:02.121208 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e533e-5df4-4e88-b7be-b5049f050c6c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:02.163859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458ffda-2863-4fae-a897-180a2cf696b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:02.164486 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458ffda-2863-4fae-a897-180a2cf696b8 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:02.164752 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458ffda-2863-4fae-a897-180a2cf696b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:02.165014 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458ffda-2863-4fae-a897-180a2cf696b8 None admin] PATH_INFO: `/v3/groups/61f91f482e8041cdaff6e862ff0f22b2` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:02.166193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458ffda-2863-4fae-a897-180a2cf696b8 None admin] RBAC: Authorizing `identity:get_group(group_id=61f91f482e8041cdaff6e862ff0f22b2)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:02.167647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458ffda-2863-4fae-a897-180a2cf696b8 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:02.169204 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 224/454] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Aug 9 11:06:02 2022] GET /identity/v3/groups/61f91f482e8041cdaff6e862ff0f22b2 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:02.175912 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aab75-cf55-4e0d-acf2-0e79c241aa58 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:02.198847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:02.277897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aab75-cf55-4e0d-acf2-0e79c241aa58 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:02.311583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dc9a5-3a43-41f5-b27b-f7f54b32c519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:02.312179 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dc9a5-3a43-41f5-b27b-f7f54b32c519 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:02.312447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dc9a5-3a43-41f5-b27b-f7f54b32c519 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:02.312706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dc9a5-3a43-41f5-b27b-f7f54b32c519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:02.313409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dc9a5-3a43-41f5-b27b-f7f54b32c519 None admin] RBAC: Adding query filter params (group.id=61f91f482e8041cdaff6e862ff0f22b2, role.id=90f6c18c707742de8521c29b89d64215, scope.project.id=b1dee2813a11458fad814d5b53a5a15f) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:02.313734 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dc9a5-3a43-41f5-b27b-f7f54b32c519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:02.315155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dc9a5-3a43-41f5-b27b-f7f54b32c519 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:02.321002 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 231/455] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Aug 9 11:06:02 2022] GET /identity/v3/role_assignments?group.id=61f91f482e8041cdaff6e862ff0f22b2&scope.project.id=b1dee2813a11458fad814d5b53a5a15f&role.id=90f6c18c707742de8521c29b89d64215 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:05.027474 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c388d-c5c7-48bc-a11f-030ade319b49 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:05.028379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c388d-c5c7-48bc-a11f-030ade319b49 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:05.028790 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c388d-c5c7-48bc-a11f-030ade319b49 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:05.030585 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 225/456] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:05.035928 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a9eb9-fdbc-4099-a895-40ad77213269 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:05.036759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a9eb9-fdbc-4099-a895-40ad77213269 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:05.037173 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a9eb9-fdbc-4099-a895-40ad77213269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:05.066775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-349a9eb9-fdbc-4099-a895-40ad77213269 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:05.068238 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-349a9eb9-fdbc-4099-a895-40ad77213269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:05.151969 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 232/457] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:05.198871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c388d-c5c7-48bc-a11f-030ade319b49 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:05.218235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079932b-abd0-4108-a2de-7ad9bbc32020 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:05.218760 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079932b-abd0-4108-a2de-7ad9bbc32020 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:05.219180 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079932b-abd0-4108-a2de-7ad9bbc32020 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:05.221477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 233/458] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:05.223197 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcb1d6-0574-4e33-9aef-de480cc0c595 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:05.224030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcb1d6-0574-4e33-9aef-de480cc0c595 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:05.224509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcb1d6-0574-4e33-9aef-de480cc0c595 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:05.226252 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 234/459] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:05.232308 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a70995-c735-4f45-909d-ba26a8d3bee1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:05.233111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a70995-c735-4f45-909d-ba26a8d3bee1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:05.233590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a70995-c735-4f45-909d-ba26a8d3bee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:05.256388 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-14a70995-c735-4f45-909d-ba26a8d3bee1 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:05.257103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-14a70995-c735-4f45-909d-ba26a8d3bee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:05.269852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:05.332141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 235/460] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:06:05.337826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739a920-fef0-4822-9d5a-117e94c83bba None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:05.337826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739a920-fef0-4822-9d5a-117e94c83bba None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:05.337826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739a920-fef0-4822-9d5a-117e94c83bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:05.347205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c388d-c5c7-48bc-a11f-030ade319b49 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:05.352236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9739a920-fef0-4822-9d5a-117e94c83bba None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:05.353417 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9739a920-fef0-4822-9d5a-117e94c83bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:05.388744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:05.403753 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509a5c3-3f5c-41b1-88b8-76c467256e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:05.405261 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509a5c3-3f5c-41b1-88b8-76c467256e08 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:05.405868 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509a5c3-3f5c-41b1-88b8-76c467256e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:05.406339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509a5c3-3f5c-41b1-88b8-76c467256e08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:05.420102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509a5c3-3f5c-41b1-88b8-76c467256e08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:05.422204 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509a5c3-3f5c-41b1-88b8-76c467256e08 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:05.424115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 236/461] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:05.424962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739a920-fef0-4822-9d5a-117e94c83bba None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-3509a5c3-3f5c-41b1-88b8-76c467256e08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:05.439552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:05.440549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:05.441435 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:05.441435 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:05.441435 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:05.444075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 226/462] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:05.453168 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509a5c3-3f5c-41b1-88b8-76c467256e08 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:05.532389 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:05.560143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739a920-fef0-4822-9d5a-117e94c83bba None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:05.587726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509a5c3-3f5c-41b1-88b8-76c467256e08 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:05.597784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137d983-4c7f-4e12-9d64-bbdc2e128758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:05.598437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137d983-4c7f-4e12-9d64-bbdc2e128758 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:05.598712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137d983-4c7f-4e12-9d64-bbdc2e128758 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:05.598982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137d983-4c7f-4e12-9d64-bbdc2e128758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:05.610092 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137d983-4c7f-4e12-9d64-bbdc2e128758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:05.611615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137d983-4c7f-4e12-9d64-bbdc2e128758 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-a137d983-4c7f-4e12-9d64-bbdc2e128758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:05.628195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:05.629533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:05.631071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:05.631071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:05.631071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:05.631071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 237/463] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:05.631071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137d983-4c7f-4e12-9d64-bbdc2e128758 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:05.635723 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc163ec2-279a-47e5-b871-85f0aabdc36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:05.636336 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc163ec2-279a-47e5-b871-85f0aabdc36c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:05.636606 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc163ec2-279a-47e5-b871-85f0aabdc36c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:05.636869 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc163ec2-279a-47e5-b871-85f0aabdc36c None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:05.637513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc163ec2-279a-47e5-b871-85f0aabdc36c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:05.637856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc163ec2-279a-47e5-b871-85f0aabdc36c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:05.639235 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc163ec2-279a-47e5-b871-85f0aabdc36c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:05.663075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 227/464] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:05.664552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc163ec2-279a-47e5-b871-85f0aabdc36c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:05.714902 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:05.748009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137d983-4c7f-4e12-9d64-bbdc2e128758 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:05.775059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:05.781441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc163ec2-279a-47e5-b871-85f0aabdc36c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:05.784658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9648f-6719-46b2-8009-74c1159bae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:05.785293 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9648f-6719-46b2-8009-74c1159bae86 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:05.785571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9648f-6719-46b2-8009-74c1159bae86 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:05.785887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9648f-6719-46b2-8009-74c1159bae86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:05.797293 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9648f-6719-46b2-8009-74c1159bae86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:05.798801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9648f-6719-46b2-8009-74c1159bae86 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-01f9648f-6719-46b2-8009-74c1159bae86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:05.813490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:05.814479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:05.818672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:05.818672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:05.818672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:05.818672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 238/465] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:05.818672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9648f-6719-46b2-8009-74c1159bae86 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:05.824868 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdd9f3-8935-4eaa-b7bf-0127d0a605d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:05.825792 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdd9f3-8935-4eaa-b7bf-0127d0a605d2 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:05.826241 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdd9f3-8935-4eaa-b7bf-0127d0a605d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:05.826704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdd9f3-8935-4eaa-b7bf-0127d0a605d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:05.827304 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdd9f3-8935-4eaa-b7bf-0127d0a605d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:05.827604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdd9f3-8935-4eaa-b7bf-0127d0a605d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:05.829037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cdd9f3-8935-4eaa-b7bf-0127d0a605d2 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:05.841509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 228/466] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:05.843152 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f466211-1fdc-4d7f-9b39-b36a3b41ba51 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:05.843631 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f466211-1fdc-4d7f-9b39-b36a3b41ba51 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:05.844087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f466211-1fdc-4d7f-9b39-b36a3b41ba51 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:05.845567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 229/467] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:05.846491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f466211-1fdc-4d7f-9b39-b36a3b41ba51 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:05.931409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9648f-6719-46b2-8009-74c1159bae86 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:05.957218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:05.961933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f466211-1fdc-4d7f-9b39-b36a3b41ba51 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:05.968978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d79291-0e21-481a-a5a4-abee9bd9285e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:05.970076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d79291-0e21-481a-a5a4-abee9bd9285e None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:05.970354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d79291-0e21-481a-a5a4-abee9bd9285e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:05.970624 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d79291-0e21-481a-a5a4-abee9bd9285e None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:05.971593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d79291-0e21-481a-a5a4-abee9bd9285e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:05.973385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d79291-0e21-481a-a5a4-abee9bd9285e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:06.005647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 239/468] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:06:05 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:06:06.005892 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9eb278-7bee-4399-9652-96afce537cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:06.006005 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d79291-0e21-481a-a5a4-abee9bd9285e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:06.006090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9eb278-7bee-4399-9652-96afce537cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:06.006090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9eb278-7bee-4399-9652-96afce537cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:06.006090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9eb278-7bee-4399-9652-96afce537cb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:06.006090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9eb278-7bee-4399-9652-96afce537cb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:06.006090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9eb278-7bee-4399-9652-96afce537cb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:06.006090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9eb278-7bee-4399-9652-96afce537cb1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:06.019768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 230/469] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:06.021255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ef3a-cfd6-4943-b467-504fa7641b40 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:06.021605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ef3a-cfd6-4943-b467-504fa7641b40 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:06.021989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ef3a-cfd6-4943-b467-504fa7641b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:06.041377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-73e1ef3a-cfd6-4943-b467-504fa7641b40 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:06.042745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-73e1ef3a-cfd6-4943-b467-504fa7641b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:06.053375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:06.124840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 231/470] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:06.125947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1ef3a-cfd6-4943-b467-504fa7641b40 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:06.138464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d79291-0e21-481a-a5a4-abee9bd9285e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:06.178203 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413b493-cd10-4c28-802f-df68132c8988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:06.179095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b493-cd10-4c28-802f-df68132c8988 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:06.179533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b493-cd10-4c28-802f-df68132c8988 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:06.179810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413b493-cd10-4c28-802f-df68132c8988 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:06.180491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413b493-cd10-4c28-802f-df68132c8988 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:06.182003 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413b493-cd10-4c28-802f-df68132c8988 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:06.213860 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 240/471] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:06:05 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:06:06.214903 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413b493-cd10-4c28-802f-df68132c8988 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:06.224556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:06.239905 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1ef3a-cfd6-4943-b467-504fa7641b40 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:06.285815 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72579fbd-4416-43d6-a625-4e3686fc6f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:06.286446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72579fbd-4416-43d6-a625-4e3686fc6f4f None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:06.286717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72579fbd-4416-43d6-a625-4e3686fc6f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:06.286973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72579fbd-4416-43d6-a625-4e3686fc6f4f None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:06.287637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72579fbd-4416-43d6-a625-4e3686fc6f4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:06.289121 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72579fbd-4416-43d6-a625-4e3686fc6f4f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:06.319453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 232/472] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:06:06 2022] POST /identity/v3/users => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:06:06.320942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2bc84-9f34-41b9-9223-04c8b0d229bb None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:06.321405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2bc84-9f34-41b9-9223-04c8b0d229bb None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:06.321690 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2bc84-9f34-41b9-9223-04c8b0d229bb None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:06.324395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 233/473] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:06.339567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc13bb-c852-4156-a304-e93db584726e None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:06.340139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc13bb-c852-4156-a304-e93db584726e None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:06.340648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc13bb-c852-4156-a304-e93db584726e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:06.353612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:06.361785 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-d0fc13bb-c852-4156-a304-e93db584726e None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:06.362327 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d0fc13bb-c852-4156-a304-e93db584726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:06.368475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413b493-cd10-4c28-802f-df68132c8988 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:06.412515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7661628-f31e-4787-a207-f3317846ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:06.413646 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7661628-f31e-4787-a207-f3317846ef50 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:06.414070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7661628-f31e-4787-a207-f3317846ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:06.415645 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7661628-f31e-4787-a207-f3317846ef50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:06.431149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7661628-f31e-4787-a207-f3317846ef50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:06.433860 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7661628-f31e-4787-a207-f3317846ef50 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-b7661628-f31e-4787-a207-f3317846ef50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:06.456181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:06.457368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:06.458442 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:06.458442 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:06.458442 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:06.459064 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 234/474] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:06:06.460088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 241/475] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:06.466170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc13bb-c852-4156-a304-e93db584726e None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:06.482541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7661628-f31e-4787-a207-f3317846ef50 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:06.552058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:06.594028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc13bb-c852-4156-a304-e93db584726e None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:06.615219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7661628-f31e-4787-a207-f3317846ef50 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:06.644433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d17f2-cd45-46fb-850a-ce81355006d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:06.645364 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d17f2-cd45-46fb-850a-ce81355006d1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:06.645693 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d17f2-cd45-46fb-850a-ce81355006d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:06.645972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d17f2-cd45-46fb-850a-ce81355006d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:06.646892 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d17f2-cd45-46fb-850a-ce81355006d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:06.647671 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d17f2-cd45-46fb-850a-ce81355006d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:06.650887 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d17f2-cd45-46fb-850a-ce81355006d1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:06.659962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef7d02-fa3a-4393-98be-167040fa8763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:06.660577 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef7d02-fa3a-4393-98be-167040fa8763 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:06.660847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef7d02-fa3a-4393-98be-167040fa8763 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:06.661108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef7d02-fa3a-4393-98be-167040fa8763 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:06.661850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef7d02-fa3a-4393-98be-167040fa8763 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:06.663310 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef7d02-fa3a-4393-98be-167040fa8763 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:06.664793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 235/476] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:06.671123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d17f2-cd45-46fb-850a-ce81355006d1 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:06.672506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.sql.core [None req-e0ef7d02-fa3a-4393-98be-167040fa8763 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 11:06:06.672506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 11:06:06.672506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [parameters: {'id': '5e7d1fc7dc154147a3eeeab569b7c129', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 11:06:06.672506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80168) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 11:06:06.691141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-e0ef7d02-fa3a-4393-98be-167040fa8763 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 11:06:06.691141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:06.691141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 11:06:06.691141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 11:06:06.691141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 11:06:06.691141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 11:06:06.691141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 11:06:06.691141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 11:06:06.691141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 11:06:06.691141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application conn.query(q) Aug 09 11:06:06.691141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 11:06:06.691141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 11:06:06.691141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 11:06:06.691141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result.read() Aug 09 11:06:06.691141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return ref.to_dict() Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 11:06:06.692114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application next(self.gen) Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application yield resource Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application next(self.gen) Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise self.value Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application session.commit() Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 11:06:06.693204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.session.flush() Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application compat.raise_( Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 11:06:06.694106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 11:06:06.695066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application conn.query(q) Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result.read() Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 11:06:06.698267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [parameters: {'id': '5e7d1fc7dc154147a3eeeab569b7c129', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:06.700307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 11:06:06.702287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:06.705704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 242/477] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Aug 9 11:06:06 2022] POST /identity/v3/roles => generated 144 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:06.705704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef7d02-fa3a-4393-98be-167040fa8763 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:06.710342 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:06.835572 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef7d02-fa3a-4393-98be-167040fa8763 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:06.845933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d17f2-cd45-46fb-850a-ce81355006d1 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:06.885000 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c76d9b-37c0-4994-b55a-64c39a4e0ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:06.885735 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c76d9b-37c0-4994-b55a-64c39a4e0ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:06.886009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c76d9b-37c0-4994-b55a-64c39a4e0ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:06.886275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c76d9b-37c0-4994-b55a-64c39a4e0ad3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:06.891780 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2d895-10c2-41d4-b834-058fcab434bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:06.892401 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d895-10c2-41d4-b834-058fcab434bc None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:06.892682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d895-10c2-41d4-b834-058fcab434bc None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:06.892955 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d895-10c2-41d4-b834-058fcab434bc None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:06.893598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2d895-10c2-41d4-b834-058fcab434bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:06.895207 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2d895-10c2-41d4-b834-058fcab434bc None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:06.898754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c76d9b-37c0-4994-b55a-64c39a4e0ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:06.903668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-57c76d9b-37c0-4994-b55a-64c39a4e0ad3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:06.903943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:06.904840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:06.905696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:06.905696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:06.905696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:06.905696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:06.905696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:06.905696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:06.905696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:06.905696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:06.905696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:06.905696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:06.905696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 11:06:06.905696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:06.906315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 243/478] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:06:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:06.912370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c76d9b-37c0-4994-b55a-64c39a4e0ad3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:06.929894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 236/479] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:06:06 2022] POST /identity/v3/users => generated 249 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:06:06.991957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:07.047744 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c76d9b-37c0-4994-b55a-64c39a4e0ad3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:07.101299 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378a192-ca45-430a-ae2c-8050b5924f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:07.102022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378a192-ca45-430a-ae2c-8050b5924f03 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:07.102273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378a192-ca45-430a-ae2c-8050b5924f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:07.102538 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378a192-ca45-430a-ae2c-8050b5924f03 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:07.103206 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378a192-ca45-430a-ae2c-8050b5924f03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:07.103500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378a192-ca45-430a-ae2c-8050b5924f03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:07.104866 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378a192-ca45-430a-ae2c-8050b5924f03 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:07.114269 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 244/480] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:08.610883 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2a315-cff6-403d-8ef7-1017167c2576 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:08.611406 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2a315-cff6-403d-8ef7-1017167c2576 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:08.611406 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2a315-cff6-403d-8ef7-1017167c2576 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:08.613035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 237/481] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:08.618330 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bbf91-f43c-4cdc-a67a-6893816b5759 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:08.618725 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bbf91-f43c-4cdc-a67a-6893816b5759 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:08.618874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bbf91-f43c-4cdc-a67a-6893816b5759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:08.637823 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-861bbf91-f43c-4cdc-a67a-6893816b5759 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:08.639015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-861bbf91-f43c-4cdc-a67a-6893816b5759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:08.654397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339314b-933a-4549-b242-c4c66a20a5ba None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:08.654673 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339314b-933a-4549-b242-c4c66a20a5ba None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:08.654934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339314b-933a-4549-b242-c4c66a20a5ba None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:08.656480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 238/482] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:08.661343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129331c-48e7-497c-9089-6c91ce8723d8 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:08.661746 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129331c-48e7-497c-9089-6c91ce8723d8 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:08.662015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129331c-48e7-497c-9089-6c91ce8723d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:08.698653 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-6129331c-48e7-497c-9089-6c91ce8723d8 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:08.699843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6129331c-48e7-497c-9089-6c91ce8723d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:08.707255 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 245/483] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:08.729902 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bbf91-f43c-4cdc-a67a-6893816b5759 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:08.788381 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:08.830335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bbf91-f43c-4cdc-a67a-6893816b5759 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:08.832263 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 239/484] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:06:08.864315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0a6e3-b4d8-45b2-a696-d613ef2b3d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:08.864941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0a6e3-b4d8-45b2-a696-d613ef2b3d26 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:08.865217 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0a6e3-b4d8-45b2-a696-d613ef2b3d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:08.865485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0a6e3-b4d8-45b2-a696-d613ef2b3d26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:08.867074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129331c-48e7-497c-9089-6c91ce8723d8 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:08.876820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0a6e3-b4d8-45b2-a696-d613ef2b3d26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-70e0a6e3-b4d8-45b2-a696-d613ef2b3d26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:08.881870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:08.884022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:08.885994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:08.885994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:08.885994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:08.885994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:08.885994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:08.885994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:08.885994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:08.885994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:08.885994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:08.885994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:08.885994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:08.885994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:08.885994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 246/485] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:08.893641 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0a6e3-b4d8-45b2-a696-d613ef2b3d26 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:08.994191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0a6e3-b4d8-45b2-a696-d613ef2b3d26 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:09.022119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:09.035405 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5428a3f-7d6f-466d-9f62-ba3427bddd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:09.036022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5428a3f-7d6f-466d-9f62-ba3427bddd5d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:09.036300 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5428a3f-7d6f-466d-9f62-ba3427bddd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:09.036574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5428a3f-7d6f-466d-9f62-ba3427bddd5d None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:09.037243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5428a3f-7d6f-466d-9f62-ba3427bddd5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:09.037540 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5428a3f-7d6f-466d-9f62-ba3427bddd5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:09.039015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5428a3f-7d6f-466d-9f62-ba3427bddd5d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:09.057433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 247/486] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:09.067629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5428a3f-7d6f-466d-9f62-ba3427bddd5d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:09.097866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129331c-48e7-497c-9089-6c91ce8723d8 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:09.145570 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:09.177552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b0e4b-7208-42af-9005-49b1d772ffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:09.178661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b0e4b-7208-42af-9005-49b1d772ffa6 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:09.180202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b0e4b-7208-42af-9005-49b1d772ffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:09.180202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b0e4b-7208-42af-9005-49b1d772ffa6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:09.196365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b0e4b-7208-42af-9005-49b1d772ffa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-a37b0e4b-7208-42af-9005-49b1d772ffa6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:09.204114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:09.205033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:09.205898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:09.205898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:09.205898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:09.205898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:09.205898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:09.205898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:09.205898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:09.205898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:09.205898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:09.205898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:09.205898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:09.205898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:09.205898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 240/487] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:09.218656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b0e4b-7208-42af-9005-49b1d772ffa6 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:09.246692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5428a3f-7d6f-466d-9f62-ba3427bddd5d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:09.282486 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d0e64-fff8-41da-8778-70383a15f7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:09.283487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d0e64-fff8-41da-8778-70383a15f7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:09.284047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d0e64-fff8-41da-8778-70383a15f7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:09.284504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d0e64-fff8-41da-8778-70383a15f7c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:09.295974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d0e64-fff8-41da-8778-70383a15f7c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:09.297764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d0e64-fff8-41da-8778-70383a15f7c1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-3e2d0e64-fff8-41da-8778-70383a15f7c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:09.312663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:09.313633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:09.314500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:09.314500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:09.314500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:09.316680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 248/488] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:09.322384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d0e64-fff8-41da-8778-70383a15f7c1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:09.367661 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:09.433271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b0e4b-7208-42af-9005-49b1d772ffa6 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:09.495562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829142a-4df0-44f7-815f-56d418022e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:09.496783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829142a-4df0-44f7-815f-56d418022e13 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:09.498153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829142a-4df0-44f7-815f-56d418022e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:09.498582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829142a-4df0-44f7-815f-56d418022e13 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:09.499262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829142a-4df0-44f7-815f-56d418022e13 None admin] RBAC: Adding query filter params (name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:09.499593 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829142a-4df0-44f7-815f-56d418022e13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:09.501253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829142a-4df0-44f7-815f-56d418022e13 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:09.509593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d0e64-fff8-41da-8778-70383a15f7c1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:09.511259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 241/489] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:09.513588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c993136-419d-4129-ae6b-82ac8ab94aad None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:09.513910 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c993136-419d-4129-ae6b-82ac8ab94aad None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:09.514180 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c993136-419d-4129-ae6b-82ac8ab94aad None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:09.515549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 242/490] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:09.520566 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c993136-419d-4129-ae6b-82ac8ab94aad None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:09.548482 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015633e8-3e02-4644-a40c-3b48c37ef9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:09.548989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015633e8-3e02-4644-a40c-3b48c37ef9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:09.549264 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015633e8-3e02-4644-a40c-3b48c37ef9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:09.549525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015633e8-3e02-4644-a40c-3b48c37ef9c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:09.550208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015633e8-3e02-4644-a40c-3b48c37ef9c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:09.550508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015633e8-3e02-4644-a40c-3b48c37ef9c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:09.551875 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015633e8-3e02-4644-a40c-3b48c37ef9c4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:09.568085 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 249/491] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:09.569228 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49380d1a-4732-45e4-bbcc-5d5f4753b083 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:09.569506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49380d1a-4732-45e4-bbcc-5d5f4753b083 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:09.569795 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49380d1a-4732-45e4-bbcc-5d5f4753b083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:09.570298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:09.587849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-49380d1a-4732-45e4-bbcc-5d5f4753b083 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:09.589032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-49380d1a-4732-45e4-bbcc-5d5f4753b083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:09.641273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c993136-419d-4129-ae6b-82ac8ab94aad None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:09.663105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 250/492] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:09.664524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a388147-5b54-47cb-b4db-a70703b12a05 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:09.664805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a388147-5b54-47cb-b4db-a70703b12a05 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:09.665125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a388147-5b54-47cb-b4db-a70703b12a05 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:09.669659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 251/493] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:09.669659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a388147-5b54-47cb-b4db-a70703b12a05 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:09.690271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5332f-c6f2-432c-a81e-be5bb930334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:09.690925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5332f-c6f2-432c-a81e-be5bb930334a None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:09.691188 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5332f-c6f2-432c-a81e-be5bb930334a None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:09.691446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5332f-c6f2-432c-a81e-be5bb930334a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:09.702319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5332f-c6f2-432c-a81e-be5bb930334a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:09.703631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:09.703764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5332f-c6f2-432c-a81e-be5bb930334a None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-f2e5332f-c6f2-432c-a81e-be5bb930334a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:09.719079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:09.720037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:09.720930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:09.720930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:09.720930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:09.720930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 243/494] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:09.721460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f0ab1-2509-4b7b-97f6-7635827afea7 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:09.721769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f0ab1-2509-4b7b-97f6-7635827afea7 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:09.722042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f0ab1-2509-4b7b-97f6-7635827afea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:09.740105 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-fb8f0ab1-2509-4b7b-97f6-7635827afea7 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:09.741339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fb8f0ab1-2509-4b7b-97f6-7635827afea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:09.792944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a388147-5b54-47cb-b4db-a70703b12a05 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:09.807333 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 244/495] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:09.808495 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608daa69-ab05-4388-a98d-89671278e3e9 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:09.808772 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608daa69-ab05-4388-a98d-89671278e3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:09.809041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608daa69-ab05-4388-a98d-89671278e3e9 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:09.814310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 245/496] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:09.814310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608daa69-ab05-4388-a98d-89671278e3e9 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:09.832790 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b44935-2205-427d-89ca-4da3eae269ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:09.833414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b44935-2205-427d-89ca-4da3eae269ea None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:09.833718 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b44935-2205-427d-89ca-4da3eae269ea None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:09.833986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b44935-2205-427d-89ca-4da3eae269ea None admin] PATH_INFO: `/v3/users/glance` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:09.835090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:09.841326 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b44935-2205-427d-89ca-4da3eae269ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:09.842814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b44935-2205-427d-89ca-4da3eae269ea None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-89b44935-2205-427d-89ca-4da3eae269ea None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:09.856208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:09.857223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:09.858376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:09.858376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:09.858376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:09.858376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:09.858376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:09.858376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:09.858376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:09.858376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:09.858376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 11:06:09.858376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:09.858376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 252/497] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:06:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:09.858376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b44935-2205-427d-89ca-4da3eae269ea None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:09.919792 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608daa69-ab05-4388-a98d-89671278e3e9 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:09.937516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:09.953261 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df90c5-48f0-4693-9683-54525714664c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:09.953915 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df90c5-48f0-4693-9683-54525714664c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:09.954188 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df90c5-48f0-4693-9683-54525714664c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:09.954455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df90c5-48f0-4693-9683-54525714664c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:09.955334 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b44935-2205-427d-89ca-4da3eae269ea None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:09.964279 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df90c5-48f0-4693-9683-54525714664c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-04df90c5-48f0-4693-9683-54525714664c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:09.968931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:09.969861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:09.970699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:09.970699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:09.970699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:09.970699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:09.970699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:09.970699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:09.970699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:09.970699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:09.970699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:09.970699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:09.970699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:09.970699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:09.970699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 246/498] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:09.971377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e31c4a-212e-4f09-b6a7-90e970c45d59 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:09.971557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e31c4a-212e-4f09-b6a7-90e970c45d59 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:09.971821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e31c4a-212e-4f09-b6a7-90e970c45d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:09.989210 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-42e31c4a-212e-4f09-b6a7-90e970c45d59 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:09.990435 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-42e31c4a-212e-4f09-b6a7-90e970c45d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:09.993279 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfd4f1-3aba-4f0c-bd8f-740e5db9240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:09.993930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfd4f1-3aba-4f0c-bd8f-740e5db9240f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:09.994210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfd4f1-3aba-4f0c-bd8f-740e5db9240f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:09.994482 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfd4f1-3aba-4f0c-bd8f-740e5db9240f None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:09.995126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfd4f1-3aba-4f0c-bd8f-740e5db9240f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:09.995427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfd4f1-3aba-4f0c-bd8f-740e5db9240f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:09.996810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfd4f1-3aba-4f0c-bd8f-740e5db9240f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:10.016716 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 253/499] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:10.016716 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfd4f1-3aba-4f0c-bd8f-740e5db9240f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:10.066153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 247/500] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:10.068016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e31c4a-212e-4f09-b6a7-90e970c45d59 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:10.089961 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:10.141297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfd4f1-3aba-4f0c-bd8f-740e5db9240f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:10.176720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e31c4a-212e-4f09-b6a7-90e970c45d59 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:10.177888 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963dc5a-65b8-4262-9f69-57cd5202db32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:10.178672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963dc5a-65b8-4262-9f69-57cd5202db32 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:10.179024 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963dc5a-65b8-4262-9f69-57cd5202db32 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:10.179314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963dc5a-65b8-4262-9f69-57cd5202db32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:10.191475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963dc5a-65b8-4262-9f69-57cd5202db32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:10.193285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963dc5a-65b8-4262-9f69-57cd5202db32 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:10.195687 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:10.211233 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fe8b4-1814-4a79-8ea8-1e1fc3c93538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:10.211874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fe8b4-1814-4a79-8ea8-1e1fc3c93538 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:10.212146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fe8b4-1814-4a79-8ea8-1e1fc3c93538 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:10.212406 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fe8b4-1814-4a79-8ea8-1e1fc3c93538 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:10.213146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fe8b4-1814-4a79-8ea8-1e1fc3c93538 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:10.213440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fe8b4-1814-4a79-8ea8-1e1fc3c93538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-5963dc5a-65b8-4262-9f69-57cd5202db32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:10.213528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:10.214543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:10.220603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:10.220603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:10.220603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:10.220771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fe8b4-1814-4a79-8ea8-1e1fc3c93538 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:10.220851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 254/501] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:10.220851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963dc5a-65b8-4262-9f69-57cd5202db32 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:10.255552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 248/502] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Aug 9 11:06:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:10.256321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fe8b4-1814-4a79-8ea8-1e1fc3c93538 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:10.327163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:10.328853 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963dc5a-65b8-4262-9f69-57cd5202db32 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:10.357832 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fe8b4-1814-4a79-8ea8-1e1fc3c93538 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:10.365839 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248897e1-2012-4095-a3d3-7fbdf68c0369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:10.366453 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248897e1-2012-4095-a3d3-7fbdf68c0369 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:10.366726 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248897e1-2012-4095-a3d3-7fbdf68c0369 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:10.366986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248897e1-2012-4095-a3d3-7fbdf68c0369 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:10.367794 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248897e1-2012-4095-a3d3-7fbdf68c0369 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:10.368098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248897e1-2012-4095-a3d3-7fbdf68c0369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:10.369504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248897e1-2012-4095-a3d3-7fbdf68c0369 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:10.378114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 255/503] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:10.379006 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248897e1-2012-4095-a3d3-7fbdf68c0369 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:10.393390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d1408-603e-4db3-94e3-5a0e24a39108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:10.394155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d1408-603e-4db3-94e3-5a0e24a39108 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:10.394430 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d1408-603e-4db3-94e3-5a0e24a39108 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:10.394705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d1408-603e-4db3-94e3-5a0e24a39108 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:10.401861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d1408-603e-4db3-94e3-5a0e24a39108 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:10.403323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d1408-603e-4db3-94e3-5a0e24a39108 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-a95d1408-603e-4db3-94e3-5a0e24a39108 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:10.416437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:10.417438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:10.418463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:10.418463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:10.418463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:10.418463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:10.418463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:10.418463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:10.418463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:10.418463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:10.418463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:06:10.418463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:10.418463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 249/504] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:06:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:10.419260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d1408-603e-4db3-94e3-5a0e24a39108 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:10.441505 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:10.488699 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248897e1-2012-4095-a3d3-7fbdf68c0369 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:10.525253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73280f94-d7fc-4467-b185-5b7e65af1185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:10.525924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73280f94-d7fc-4467-b185-5b7e65af1185 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:10.526195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73280f94-d7fc-4467-b185-5b7e65af1185 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:10.526457 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73280f94-d7fc-4467-b185-5b7e65af1185 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:10.537162 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73280f94-d7fc-4467-b185-5b7e65af1185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-73280f94-d7fc-4467-b185-5b7e65af1185 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:10.542275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:10.543288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:10.544105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:10.544105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:10.544105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:10.544105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:10.544105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:10.544105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:10.544105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:10.544105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:10.544105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:10.544105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:10.544105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:10.544105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:10.544709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d1408-603e-4db3-94e3-5a0e24a39108 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:10.545945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 256/505] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:10.546666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73280f94-d7fc-4467-b185-5b7e65af1185 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:10.577342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:10.582899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951411-e682-46ca-9372-dba97b6c4d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:10.583500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951411-e682-46ca-9372-dba97b6c4d24 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:10.583767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951411-e682-46ca-9372-dba97b6c4d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:10.584025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951411-e682-46ca-9372-dba97b6c4d24 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:10.584661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951411-e682-46ca-9372-dba97b6c4d24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:10.584953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951411-e682-46ca-9372-dba97b6c4d24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:10.586471 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951411-e682-46ca-9372-dba97b6c4d24 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:10.598240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 250/506] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:10.599049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951411-e682-46ca-9372-dba97b6c4d24 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:10.655065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73280f94-d7fc-4467-b185-5b7e65af1185 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:10.672216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:10.690995 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacf5b3-0f58-49c0-917f-34a25e3d85e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:10.691608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacf5b3-0f58-49c0-917f-34a25e3d85e4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:10.691882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacf5b3-0f58-49c0-917f-34a25e3d85e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:10.692151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacf5b3-0f58-49c0-917f-34a25e3d85e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:10.705295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951411-e682-46ca-9372-dba97b6c4d24 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:10.741398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a66daa-e1c5-45b0-bf69-512476ff59a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:10.742040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a66daa-e1c5-45b0-bf69-512476ff59a1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:10.742331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a66daa-e1c5-45b0-bf69-512476ff59a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:10.742592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a66daa-e1c5-45b0-bf69-512476ff59a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:10.753562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a66daa-e1c5-45b0-bf69-512476ff59a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:10.755396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a66daa-e1c5-45b0-bf69-512476ff59a1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:10.762566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacf5b3-0f58-49c0-917f-34a25e3d85e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:10.764033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacf5b3-0f58-49c0-917f-34a25e3d85e4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-19a66daa-e1c5-45b0-bf69-512476ff59a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:10.771016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:10.772684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:10.773928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:10.773928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:10.773928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:10.773928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 251/507] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:10.773928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a66daa-e1c5-45b0-bf69-512476ff59a1 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:10.830861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:10.870440 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 257/508] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:06:10.871441 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacf5b3-0f58-49c0-917f-34a25e3d85e4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:10.894285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:10.895848 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a66daa-e1c5-45b0-bf69-512476ff59a1 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:10.931308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936d3e3-e564-4f17-9fc1-0238fc1d7323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:10.931911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936d3e3-e564-4f17-9fc1-0238fc1d7323 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:10.932183 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936d3e3-e564-4f17-9fc1-0238fc1d7323 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:10.932453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936d3e3-e564-4f17-9fc1-0238fc1d7323 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:10.933172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936d3e3-e564-4f17-9fc1-0238fc1d7323 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:10.933468 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936d3e3-e564-4f17-9fc1-0238fc1d7323 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:10.934965 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936d3e3-e564-4f17-9fc1-0238fc1d7323 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:10.954164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 252/509] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Aug 9 11:06:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:10.954992 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936d3e3-e564-4f17-9fc1-0238fc1d7323 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:10.987958 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacf5b3-0f58-49c0-917f-34a25e3d85e4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:11.022536 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c90ff6-3ddd-4e29-a701-2b9cdd0bdc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:11.023142 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c90ff6-3ddd-4e29-a701-2b9cdd0bdc60 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:11.023411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c90ff6-3ddd-4e29-a701-2b9cdd0bdc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:11.023675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c90ff6-3ddd-4e29-a701-2b9cdd0bdc60 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:11.024358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c90ff6-3ddd-4e29-a701-2b9cdd0bdc60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:11.024358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c90ff6-3ddd-4e29-a701-2b9cdd0bdc60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:11.026014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c90ff6-3ddd-4e29-a701-2b9cdd0bdc60 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:11.034114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 258/510] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:11.034921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c90ff6-3ddd-4e29-a701-2b9cdd0bdc60 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:11.065992 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936d3e3-e564-4f17-9fc1-0238fc1d7323 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:11.068324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:11.106106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c1ad2-3f89-4bcd-a6bc-968a6b7bcdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:11.106745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c1ad2-3f89-4bcd-a6bc-968a6b7bcdc8 None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:11.107095 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c1ad2-3f89-4bcd-a6bc-968a6b7bcdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:11.107463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c1ad2-3f89-4bcd-a6bc-968a6b7bcdc8 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:11.108169 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c1ad2-3f89-4bcd-a6bc-968a6b7bcdc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:11.109918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c1ad2-3f89-4bcd-a6bc-968a6b7bcdc8 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:11.118225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:11.131706 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 253/511] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:06:10 2022] POST /identity/v3/users => generated 247 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:06:11.132563 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c1ad2-3f89-4bcd-a6bc-968a6b7bcdc8 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:11.155396 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c90ff6-3ddd-4e29-a701-2b9cdd0bdc60 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:11.199664 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb923c0f-da48-4c1c-85bc-89b1304d9329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:11.200408 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb923c0f-da48-4c1c-85bc-89b1304d9329 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:11.200692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb923c0f-da48-4c1c-85bc-89b1304d9329 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:11.200962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb923c0f-da48-4c1c-85bc-89b1304d9329 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:11.201609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb923c0f-da48-4c1c-85bc-89b1304d9329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:11.201939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb923c0f-da48-4c1c-85bc-89b1304d9329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:11.203448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb923c0f-da48-4c1c-85bc-89b1304d9329 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:11.217026 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 259/512] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:11.217945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb923c0f-da48-4c1c-85bc-89b1304d9329 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:11.267298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c1ad2-3f89-4bcd-a6bc-968a6b7bcdc8 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:11.313440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaaf97-2538-4625-98f1-15b23da823de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:11.314369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaaf97-2538-4625-98f1-15b23da823de None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:11.314787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaaf97-2538-4625-98f1-15b23da823de None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:11.315048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaaf97-2538-4625-98f1-15b23da823de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:11.328270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feaaf97-2538-4625-98f1-15b23da823de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:11.329803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feaaf97-2538-4625-98f1-15b23da823de None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:11.339853 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb923c0f-da48-4c1c-85bc-89b1304d9329 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-3feaaf97-2538-4625-98f1-15b23da823de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:11.346793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:11.347958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:11.349032 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:11.349032 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:11.349032 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:11.349032 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 254/513] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:11.349032 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaaf97-2538-4625-98f1-15b23da823de None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:11.364281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:11.390693 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c087cf9-a061-4743-aee3-c2aa36b767ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:11.391335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c087cf9-a061-4743-aee3-c2aa36b767ef None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:11.391608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c087cf9-a061-4743-aee3-c2aa36b767ef None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:11.391868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c087cf9-a061-4743-aee3-c2aa36b767ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:11.401679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:11.456363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaaf97-2538-4625-98f1-15b23da823de None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:11.467051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c087cf9-a061-4743-aee3-c2aa36b767ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:11.468507 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c087cf9-a061-4743-aee3-c2aa36b767ef None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:11.499811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63f8f0-7a06-45f2-be4a-d6eb8b5e560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:11.500476 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63f8f0-7a06-45f2-be4a-d6eb8b5e560e None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:11.500815 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63f8f0-7a06-45f2-be4a-d6eb8b5e560e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:11.501093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63f8f0-7a06-45f2-be4a-d6eb8b5e560e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:11.512950 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63f8f0-7a06-45f2-be4a-d6eb8b5e560e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:11.514977 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63f8f0-7a06-45f2-be4a-d6eb8b5e560e None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-ce63f8f0-7a06-45f2-be4a-d6eb8b5e560e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:11.530417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:11.531393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:11.532255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:11.532255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:11.532255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:11.532255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 255/514] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:11.532480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63f8f0-7a06-45f2-be4a-d6eb8b5e560e None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:11.585188 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 260/515] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:06:11.586541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c087cf9-a061-4743-aee3-c2aa36b767ef None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:11.599435 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:11.628427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:11.649644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63f8f0-7a06-45f2-be4a-d6eb8b5e560e None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:11.683273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8ef41-fa93-4d96-bf1f-02b000f463bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:11.683904 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8ef41-fa93-4d96-bf1f-02b000f463bd None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:11.684170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8ef41-fa93-4d96-bf1f-02b000f463bd None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:11.684433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8ef41-fa93-4d96-bf1f-02b000f463bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:11.692490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c087cf9-a061-4743-aee3-c2aa36b767ef None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:11.693053 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8ef41-fa93-4d96-bf1f-02b000f463bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:11.694011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8ef41-fa93-4d96-bf1f-02b000f463bd None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-f1b8ef41-fa93-4d96-bf1f-02b000f463bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:11.708148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:11.710018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:11.710972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:11.710972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:11.710972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:11.710972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:11.710972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:11.710972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:11.710972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:11.710972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:11.710972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:06:11.710972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:11.710972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 256/516] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Aug 9 11:06:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:11.710972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8ef41-fa93-4d96-bf1f-02b000f463bd None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:11.735782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c0970-bf9d-4817-a7d0-9c405c829e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:11.736587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c0970-bf9d-4817-a7d0-9c405c829e70 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:11.736949 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c0970-bf9d-4817-a7d0-9c405c829e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:11.737309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c0970-bf9d-4817-a7d0-9c405c829e70 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:11.738085 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c0970-bf9d-4817-a7d0-9c405c829e70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:11.738477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c0970-bf9d-4817-a7d0-9c405c829e70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:11.739950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c0970-bf9d-4817-a7d0-9c405c829e70 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:11.756576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 261/517] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:11.756576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c0970-bf9d-4817-a7d0-9c405c829e70 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:11.828357 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8ef41-fa93-4d96-bf1f-02b000f463bd None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:11.852990 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:11.863661 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:11.866766 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed4598-b7e7-4f01-8c75-2fe3869ca1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:11.867395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed4598-b7e7-4f01-8c75-2fe3869ca1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:11.867715 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed4598-b7e7-4f01-8c75-2fe3869ca1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:11.867982 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed4598-b7e7-4f01-8c75-2fe3869ca1c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:11.868736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed4598-b7e7-4f01-8c75-2fe3869ca1c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:11.868914 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c0970-bf9d-4817-a7d0-9c405c829e70 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:11.869038 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed4598-b7e7-4f01-8c75-2fe3869ca1c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:11.871074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed4598-b7e7-4f01-8c75-2fe3869ca1c9 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:11.884940 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 257/518] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:11.887076 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed4598-b7e7-4f01-8c75-2fe3869ca1c9 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:11.909613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a5941-2818-4e80-9969-2e0cc9530429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:11.910541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a5941-2818-4e80-9969-2e0cc9530429 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:11.910920 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a5941-2818-4e80-9969-2e0cc9530429 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:11.911289 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a5941-2818-4e80-9969-2e0cc9530429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:11.924129 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a5941-2818-4e80-9969-2e0cc9530429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:11.925872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a5941-2818-4e80-9969-2e0cc9530429 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-681a5941-2818-4e80-9969-2e0cc9530429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:11.942257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:11.943411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:11.944466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:11.944466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:11.944466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:11.945858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 262/519] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:11.946777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a5941-2818-4e80-9969-2e0cc9530429 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:12.003429 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed4598-b7e7-4f01-8c75-2fe3869ca1c9 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:12.045025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763dc6b-9079-45fc-8de6-0c1b16d41515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:12.046150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763dc6b-9079-45fc-8de6-0c1b16d41515 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:12.046979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763dc6b-9079-45fc-8de6-0c1b16d41515 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:12.047530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763dc6b-9079-45fc-8de6-0c1b16d41515 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:12.048921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763dc6b-9079-45fc-8de6-0c1b16d41515 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:12.049376 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763dc6b-9079-45fc-8de6-0c1b16d41515 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:12.051500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763dc6b-9079-45fc-8de6-0c1b16d41515 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:12.052395 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a5941-2818-4e80-9969-2e0cc9530429 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:12.073688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 258/520] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Aug 9 11:06:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:12.074322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763dc6b-9079-45fc-8de6-0c1b16d41515 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:12.096694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1083d19-a7bd-4892-bfe8-23da3ae79055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:12.097433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1083d19-a7bd-4892-bfe8-23da3ae79055 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:12.097810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1083d19-a7bd-4892-bfe8-23da3ae79055 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:12.098150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1083d19-a7bd-4892-bfe8-23da3ae79055 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:12.113013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1083d19-a7bd-4892-bfe8-23da3ae79055 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:12.114707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1083d19-a7bd-4892-bfe8-23da3ae79055 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:12.120003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:12.130891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-b1083d19-a7bd-4892-bfe8-23da3ae79055 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:12.130891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:12.130891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:12.130891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:12.130891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:12.130891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:12.130891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:12.130891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:12.130891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:12.130891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:12.130891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:12.130891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:12.130891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:12.130891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:12.130891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:12.131981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:12.133032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:12.133032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:12.133032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:12.133032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:12.133032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:12.133032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:12.133032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:12.133032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:12.137040 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 263/521] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:12.137890 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1083d19-a7bd-4892-bfe8-23da3ae79055 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:12.150862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:12.188937 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763dc6b-9079-45fc-8de6-0c1b16d41515 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:12.224679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c7233-e5cb-4148-8bad-75e69528e3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:12.225416 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c7233-e5cb-4148-8bad-75e69528e3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:12.225784 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c7233-e5cb-4148-8bad-75e69528e3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:12.226115 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c7233-e5cb-4148-8bad-75e69528e3d8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:12.234428 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c7233-e5cb-4148-8bad-75e69528e3d8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:12.236022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c7233-e5cb-4148-8bad-75e69528e3d8 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:12.246463 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1083d19-a7bd-4892-bfe8-23da3ae79055 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-9b7c7233-e5cb-4148-8bad-75e69528e3d8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:12.248592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:12.249814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:12.250762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:12.250762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:12.250762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:12.250762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:12.250762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:12.250762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:12.250762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:12.250762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:12.250762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 11:06:12.250762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:12.250762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 259/522] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:12.250762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c7233-e5cb-4148-8bad-75e69528e3d8 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:12.287466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89cbcd-641d-415b-b458-d75b30464027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:12.288200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89cbcd-641d-415b-b458-d75b30464027 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:12.288537 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89cbcd-641d-415b-b458-d75b30464027 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:12.288869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89cbcd-641d-415b-b458-d75b30464027 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:12.289696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89cbcd-641d-415b-b458-d75b30464027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:12.290066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89cbcd-641d-415b-b458-d75b30464027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:12.291575 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89cbcd-641d-415b-b458-d75b30464027 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:12.309261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 264/523] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:12.309261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89cbcd-641d-415b-b458-d75b30464027 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:12.353600 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:12.356899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c7233-e5cb-4148-8bad-75e69528e3d8 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:12.385778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:12.393929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb329c6d-b7cb-40be-970c-c1fbd80e8df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:12.394565 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb329c6d-b7cb-40be-970c-c1fbd80e8df1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:12.394882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb329c6d-b7cb-40be-970c-c1fbd80e8df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:12.395209 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb329c6d-b7cb-40be-970c-c1fbd80e8df1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:12.428880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89cbcd-641d-415b-b458-d75b30464027 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:12.466704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb329c6d-b7cb-40be-970c-c1fbd80e8df1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:12.468249 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb329c6d-b7cb-40be-970c-c1fbd80e8df1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:12.469581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffbc91-2692-4b6c-829e-83db5af770fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:12.470458 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffbc91-2692-4b6c-829e-83db5af770fa None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:12.470735 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffbc91-2692-4b6c-829e-83db5af770fa None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:12.471893 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffbc91-2692-4b6c-829e-83db5af770fa None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:12.472603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffbc91-2692-4b6c-829e-83db5af770fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:12.472929 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffbc91-2692-4b6c-829e-83db5af770fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:12.476331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffbc91-2692-4b6c-829e-83db5af770fa None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:12.502642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 265/524] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:12.502642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffbc91-2692-4b6c-829e-83db5af770fa None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:12.571850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:12.576584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 260/525] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:06:12.578540 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb329c6d-b7cb-40be-970c-c1fbd80e8df1 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:12.608246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffbc91-2692-4b6c-829e-83db5af770fa None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:12.641342 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:12.647430 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e55a7-5664-41c7-8cf5-4e07dda8f8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:12.648131 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e55a7-5664-41c7-8cf5-4e07dda8f8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:12.648405 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e55a7-5664-41c7-8cf5-4e07dda8f8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:12.648697 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e55a7-5664-41c7-8cf5-4e07dda8f8e8 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:12.650000 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e55a7-5664-41c7-8cf5-4e07dda8f8e8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:12.650459 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e55a7-5664-41c7-8cf5-4e07dda8f8e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:12.651876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9e55a7-5664-41c7-8cf5-4e07dda8f8e8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:12.682597 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb329c6d-b7cb-40be-970c-c1fbd80e8df1 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:12.694501 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 266/526] 10.222.0.15 () {56 vars in 1139 bytes} [Tue Aug 9 11:06:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:12.694501 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e55a7-5664-41c7-8cf5-4e07dda8f8e8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:12.723167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8a60d-83ce-49cf-bb55-8c23f8b715a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:12.723886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8a60d-83ce-49cf-bb55-8c23f8b715a8 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:12.724232 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8a60d-83ce-49cf-bb55-8c23f8b715a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:12.724649 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8a60d-83ce-49cf-bb55-8c23f8b715a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:12.731540 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8a60d-83ce-49cf-bb55-8c23f8b715a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:12.733026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8a60d-83ce-49cf-bb55-8c23f8b715a8 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:12.744802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-cea8a60d-83ce-49cf-bb55-8c23f8b715a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:12.744802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:12.744802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:12.744802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:12.744802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:12.744802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:12.744802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:12.744802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:12.744802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:12.744802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:12.744802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:12.744802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:12.744802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:12.744802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:12.744802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:12.745744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:12.746637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:12.746637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:12.746637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:12.746637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:12.746637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:12.746637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:12.746637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:12.746637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:12.746637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 261/527] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:12.747596 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8a60d-83ce-49cf-bb55-8c23f8b715a8 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:12.802904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e55a7-5664-41c7-8cf5-4e07dda8f8e8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:12.820540 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:12.839939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da352e15-da7b-4fa3-87ba-2625076a5af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:12.840551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da352e15-da7b-4fa3-87ba-2625076a5af4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:12.840826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da352e15-da7b-4fa3-87ba-2625076a5af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:12.841094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da352e15-da7b-4fa3-87ba-2625076a5af4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:12.841852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da352e15-da7b-4fa3-87ba-2625076a5af4 None admin] RBAC: Adding query filter params (role.id=bcdb152b51e34826a39fc0f8c3d60664, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=5356835ef79c458bbfa7d6adafd0cb36) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:12.842153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da352e15-da7b-4fa3-87ba-2625076a5af4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:12.843599 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da352e15-da7b-4fa3-87ba-2625076a5af4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:12.857649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 267/528] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:12 2022] GET /identity/v3/role_assignments?user.id=5356835ef79c458bbfa7d6adafd0cb36&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=bcdb152b51e34826a39fc0f8c3d60664 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:12.857649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da352e15-da7b-4fa3-87ba-2625076a5af4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:12.874331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8a60d-83ce-49cf-bb55-8c23f8b715a8 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:12.913983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc169d06-3532-4b1b-88d2-4ee4836fdf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:12.914701 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc169d06-3532-4b1b-88d2-4ee4836fdf2b None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:12.914972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc169d06-3532-4b1b-88d2-4ee4836fdf2b None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:12.915241 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc169d06-3532-4b1b-88d2-4ee4836fdf2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:12.921644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:12.929475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc169d06-3532-4b1b-88d2-4ee4836fdf2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:12.931509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc169d06-3532-4b1b-88d2-4ee4836fdf2b None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-fc169d06-3532-4b1b-88d2-4ee4836fdf2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:12.947630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:12.948681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:12.949569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:12.949569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:12.949569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:12.956412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 262/529] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:12.957672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc169d06-3532-4b1b-88d2-4ee4836fdf2b None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:12.984452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da352e15-da7b-4fa3-87ba-2625076a5af4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:13.026156 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f634a-4717-43eb-b918-bbddfe8fa681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:13.027376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f634a-4717-43eb-b918-bbddfe8fa681 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:13.027835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f634a-4717-43eb-b918-bbddfe8fa681 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:13.028536 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f634a-4717-43eb-b918-bbddfe8fa681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:13.093949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc169d06-3532-4b1b-88d2-4ee4836fdf2b None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:13.112751 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:13.113864 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f634a-4717-43eb-b918-bbddfe8fa681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:13.115475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f634a-4717-43eb-b918-bbddfe8fa681 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:13.140830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382980b2-57fa-4f4e-824f-29d498babdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:13.142008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382980b2-57fa-4f4e-824f-29d498babdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:13.142420 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382980b2-57fa-4f4e-824f-29d498babdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:13.143079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382980b2-57fa-4f4e-824f-29d498babdb4 None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:13.144380 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382980b2-57fa-4f4e-824f-29d498babdb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:13.144969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382980b2-57fa-4f4e-824f-29d498babdb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:13.147365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382980b2-57fa-4f4e-824f-29d498babdb4 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:13.172450 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 263/530] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:13.173504 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382980b2-57fa-4f4e-824f-29d498babdb4 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:13.175806 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:13.231704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 268/531] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:06:13.232779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f634a-4717-43eb-b918-bbddfe8fa681 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:13.290565 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382980b2-57fa-4f4e-824f-29d498babdb4 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:13.325708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c86b2-b756-40a6-90be-b0090d28fc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:13.326323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c86b2-b756-40a6-90be-b0090d28fc6b None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:13.326599 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c86b2-b756-40a6-90be-b0090d28fc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:13.326869 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c86b2-b756-40a6-90be-b0090d28fc6b None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:13.327516 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c86b2-b756-40a6-90be-b0090d28fc6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:13.327818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c86b2-b756-40a6-90be-b0090d28fc6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:13.329219 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c86b2-b756-40a6-90be-b0090d28fc6b None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:13.344885 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 264/532] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:13.344885 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f9e35-4411-40c5-91e3-e12f63160eaf None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:13.344885 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f9e35-4411-40c5-91e3-e12f63160eaf None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:13.344885 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f9e35-4411-40c5-91e3-e12f63160eaf None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:13.344885 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 265/533] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:13.346399 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f9e35-4411-40c5-91e3-e12f63160eaf None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:13.347270 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f634a-4717-43eb-b918-bbddfe8fa681 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:13.385567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:13.388722 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee07eb-6ffa-4728-80db-ad45ae7d4a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:13.389344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee07eb-6ffa-4728-80db-ad45ae7d4a55 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:13.389638 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee07eb-6ffa-4728-80db-ad45ae7d4a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:13.389913 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee07eb-6ffa-4728-80db-ad45ae7d4a55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:13.390643 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee07eb-6ffa-4728-80db-ad45ae7d4a55 None admin] RBAC: Adding query filter params (role.id=bcdb152b51e34826a39fc0f8c3d60664, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=097822b9d7954dd0b27e9f650b6e36f9) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:13.390951 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee07eb-6ffa-4728-80db-ad45ae7d4a55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:13.392415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee07eb-6ffa-4728-80db-ad45ae7d4a55 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:13.406765 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 269/534] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:13 2022] GET /identity/v3/role_assignments?user.id=097822b9d7954dd0b27e9f650b6e36f9&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=bcdb152b51e34826a39fc0f8c3d60664 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:13.406765 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee07eb-6ffa-4728-80db-ad45ae7d4a55 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:13.420195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:13.472693 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f9e35-4411-40c5-91e3-e12f63160eaf None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:13.522022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc84e9-01f8-4210-92bc-4beb5989a81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:13.523085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc84e9-01f8-4210-92bc-4beb5989a81c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:13.523454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc84e9-01f8-4210-92bc-4beb5989a81c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:13.524341 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc84e9-01f8-4210-92bc-4beb5989a81c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:13.530014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee07eb-6ffa-4728-80db-ad45ae7d4a55 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:13.539772 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc84e9-01f8-4210-92bc-4beb5989a81c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:13.541965 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc84e9-01f8-4210-92bc-4beb5989a81c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-01bc84e9-01f8-4210-92bc-4beb5989a81c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:13.561844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:13.563009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:13.564625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:13.564625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:13.564625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:13.568041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 266/535] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:13.569454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e297d5-0f10-4460-8f04-977551f7ea0c None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:13.569772 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e297d5-0f10-4460-8f04-977551f7ea0c None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:13.570043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e297d5-0f10-4460-8f04-977551f7ea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:13.573591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed5b5c-10a1-4ef7-949f-7bc4eb38b7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:13.574359 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed5b5c-10a1-4ef7-949f-7bc4eb38b7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:13.574646 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed5b5c-10a1-4ef7-949f-7bc4eb38b7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:13.575006 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed5b5c-10a1-4ef7-949f-7bc4eb38b7d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:13.584405 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed5b5c-10a1-4ef7-949f-7bc4eb38b7d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:13.585948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed5b5c-10a1-4ef7-949f-7bc4eb38b7d6 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:13.590897 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-c6e297d5-0f10-4460-8f04-977551f7ea0c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:13.592425 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c6e297d5-0f10-4460-8f04-977551f7ea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:13.599937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-d3ed5b5c-10a1-4ef7-949f-7bc4eb38b7d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:13.599937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:13.599937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:13.599937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:13.599937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:13.599937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:13.599937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:13.599937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:13.599937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:13.599937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:13.599937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:13.599937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:13.599937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:13.599937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:13.599937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:13.600830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:13.602870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:13.602870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:13.602870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:13.602870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:13.602870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:13.602870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:13.602870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:13.602870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:13.602870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 270/536] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:13.602870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed5b5c-10a1-4ef7-949f-7bc4eb38b7d6 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:13.685027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 267/537] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:13.685027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e297d5-0f10-4460-8f04-977551f7ea0c None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:13.698317 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:13.702622 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:13.739986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed5b5c-10a1-4ef7-949f-7bc4eb38b7d6 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:13.776859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d27ca-a7f2-4b46-af1d-477cbf43496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:13.777850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d27ca-a7f2-4b46-af1d-477cbf43496f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:13.778356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d27ca-a7f2-4b46-af1d-477cbf43496f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:13.778850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d27ca-a7f2-4b46-af1d-477cbf43496f None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:13.779599 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d27ca-a7f2-4b46-af1d-477cbf43496f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:13.780021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d27ca-a7f2-4b46-af1d-477cbf43496f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:13.781509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d27ca-a7f2-4b46-af1d-477cbf43496f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:13.798823 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 271/538] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:13.799845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d27ca-a7f2-4b46-af1d-477cbf43496f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:13.805356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e297d5-0f10-4460-8f04-977551f7ea0c None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:13.848166 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0164d5b-9b61-4b9c-b9c1-9d3119d105c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:13.849239 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0164d5b-9b61-4b9c-b9c1-9d3119d105c9 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:13.849915 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0164d5b-9b61-4b9c-b9c1-9d3119d105c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:13.850275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0164d5b-9b61-4b9c-b9c1-9d3119d105c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:13.852122 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0164d5b-9b61-4b9c-b9c1-9d3119d105c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:13.853728 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0164d5b-9b61-4b9c-b9c1-9d3119d105c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:13.855353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0164d5b-9b61-4b9c-b9c1-9d3119d105c9 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:13.868185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 268/539] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:13.870532 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0164d5b-9b61-4b9c-b9c1-9d3119d105c9 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:13.916222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d27ca-a7f2-4b46-af1d-477cbf43496f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:13.954104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7487ade-4dcc-4212-9357-9c7de3c63ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:13.954989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7487ade-4dcc-4212-9357-9c7de3c63ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:13.955396 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7487ade-4dcc-4212-9357-9c7de3c63ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:13.955821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7487ade-4dcc-4212-9357-9c7de3c63ce7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:13.959230 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:13.969700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7487ade-4dcc-4212-9357-9c7de3c63ce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:13.971470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-a7487ade-4dcc-4212-9357-9c7de3c63ce7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:13.976490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:13.977657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:13.978597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:13.978597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:13.978597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:13.978597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:13.978597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:13.978597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:13.978597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:13.978597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:13.978597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:13.978597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:13.978597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:13.978597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:13.980877 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 272/540] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:13.981965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7487ade-4dcc-4212-9357-9c7de3c63ce7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:14.015287 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0164d5b-9b61-4b9c-b9c1-9d3119d105c9 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:14.053160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c975a2-7468-4f50-aecb-9638273f4c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:14.054072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c975a2-7468-4f50-aecb-9638273f4c2d None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:14.054501 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c975a2-7468-4f50-aecb-9638273f4c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:14.054898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c975a2-7468-4f50-aecb-9638273f4c2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:14.062203 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c975a2-7468-4f50-aecb-9638273f4c2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:14.063830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c975a2-7468-4f50-aecb-9638273f4c2d None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:14.075275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-21c975a2-7468-4f50-aecb-9638273f4c2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:14.075275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:14.075275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:14.075275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:14.075275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:14.075275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:14.075275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:14.075275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:14.075275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:14.075275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:14.075275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:14.075275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:14.075275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:14.075275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:14.075275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:14.076343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:14.077395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:14.077395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:14.077395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:14.077395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:14.077395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:14.077395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:14.077395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:14.077395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:14.079534 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 269/541] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:14.080520 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c975a2-7468-4f50-aecb-9638273f4c2d None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:14.116651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7487ade-4dcc-4212-9357-9c7de3c63ce7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:14.168484 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baa3af-52b8-44db-bb35-964508ef8426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:14.169255 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baa3af-52b8-44db-bb35-964508ef8426 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:14.169887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baa3af-52b8-44db-bb35-964508ef8426 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:14.171084 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baa3af-52b8-44db-bb35-964508ef8426 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:14.171985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baa3af-52b8-44db-bb35-964508ef8426 None admin] RBAC: Adding query filter params (role.id=bcdb152b51e34826a39fc0f8c3d60664, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=881030d7605b40879762d1c199362ee1) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:14.172363 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baa3af-52b8-44db-bb35-964508ef8426 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:14.174314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baa3af-52b8-44db-bb35-964508ef8426 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:14.187765 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 273/542] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:13 2022] GET /identity/v3/role_assignments?user.id=881030d7605b40879762d1c199362ee1&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=bcdb152b51e34826a39fc0f8c3d60664 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:14.188524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baa3af-52b8-44db-bb35-964508ef8426 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:14.194618 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c975a2-7468-4f50-aecb-9638273f4c2d None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:14.238253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734efa79-5694-4efb-891e-b2307e0d8878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:14.239275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734efa79-5694-4efb-891e-b2307e0d8878 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:14.239747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734efa79-5694-4efb-891e-b2307e0d8878 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:14.240706 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734efa79-5694-4efb-891e-b2307e0d8878 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:14.241594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734efa79-5694-4efb-891e-b2307e0d8878 None admin] RBAC: Adding query filter params (name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:14.242155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734efa79-5694-4efb-891e-b2307e0d8878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:14.243883 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734efa79-5694-4efb-891e-b2307e0d8878 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:14.246295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:14.256884 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 270/543] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:14.275544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734efa79-5694-4efb-891e-b2307e0d8878 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:14.327836 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:14.408961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baa3af-52b8-44db-bb35-964508ef8426 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:14.447100 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734efa79-5694-4efb-891e-b2307e0d8878 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:14.490584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e1a50-b93d-4c75-8f6d-c53ac0c46341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:14.492516 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e1a50-b93d-4c75-8f6d-c53ac0c46341 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:14.493522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e1a50-b93d-4c75-8f6d-c53ac0c46341 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:14.494452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e1a50-b93d-4c75-8f6d-c53ac0c46341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:14.498129 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bef739-e3e0-4b32-82ad-31f0a6dd5ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:14.499030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bef739-e3e0-4b32-82ad-31f0a6dd5ebf None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:14.500616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bef739-e3e0-4b32-82ad-31f0a6dd5ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:14.501089 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bef739-e3e0-4b32-82ad-31f0a6dd5ebf None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:14.502312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bef739-e3e0-4b32-82ad-31f0a6dd5ebf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:14.504654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bef739-e3e0-4b32-82ad-31f0a6dd5ebf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:14.509308 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bef739-e3e0-4b32-82ad-31f0a6dd5ebf None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:14.518801 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e1a50-b93d-4c75-8f6d-c53ac0c46341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:14.520297 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e1a50-b93d-4c75-8f6d-c53ac0c46341 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:14.532338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 274/544] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:14.534445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bef739-e3e0-4b32-82ad-31f0a6dd5ebf None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-133e1a50-b93d-4c75-8f6d-c53ac0c46341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:14.552124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:14.553123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:14.554040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:14.554040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:14.554040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:14.558651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 271/545] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:14.564207 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e1a50-b93d-4c75-8f6d-c53ac0c46341 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:14.670086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:14.715381 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e1a50-b93d-4c75-8f6d-c53ac0c46341 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:14.767484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b48396-b3c2-4144-9259-f094538956dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:14.768096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b48396-b3c2-4144-9259-f094538956dd None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:14.768369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b48396-b3c2-4144-9259-f094538956dd None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:14.768635 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b48396-b3c2-4144-9259-f094538956dd None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:14.769284 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b48396-b3c2-4144-9259-f094538956dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:14.769580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b48396-b3c2-4144-9259-f094538956dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:14.771007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b48396-b3c2-4144-9259-f094538956dd None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:14.783258 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bef739-e3e0-4b32-82ad-31f0a6dd5ebf None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:14.796270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 272/546] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:14.800375 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b48396-b3c2-4144-9259-f094538956dd None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:14.819290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:14.848516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4046247-a86f-415e-82b2-29f165f3c309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:14.849120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4046247-a86f-415e-82b2-29f165f3c309 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:14.849394 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4046247-a86f-415e-82b2-29f165f3c309 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:14.851573 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4046247-a86f-415e-82b2-29f165f3c309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:14.852345 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4046247-a86f-415e-82b2-29f165f3c309 None admin] RBAC: Adding query filter params (role.id=bcdb152b51e34826a39fc0f8c3d60664, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=0ee3889add1541418ccda24268831979) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:14.852650 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4046247-a86f-415e-82b2-29f165f3c309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:14.854879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4046247-a86f-415e-82b2-29f165f3c309 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:14.867857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 275/547] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:14 2022] GET /identity/v3/role_assignments?user.id=0ee3889add1541418ccda24268831979&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=bcdb152b51e34826a39fc0f8c3d60664 => generated 259 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:14.981137 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b48396-b3c2-4144-9259-f094538956dd None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:15.000295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:15.044549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed286891-e363-4edf-bc5b-fd01a72ba801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:15.045589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed286891-e363-4edf-bc5b-fd01a72ba801 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:15.046138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed286891-e363-4edf-bc5b-fd01a72ba801 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:15.046651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed286891-e363-4edf-bc5b-fd01a72ba801 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:15.052297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6c5fc-074b-423f-b992-c21fec3b6663 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:15.053084 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6c5fc-074b-423f-b992-c21fec3b6663 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:15.053809 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6c5fc-074b-423f-b992-c21fec3b6663 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:15.056817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 276/548] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:15.061246 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed286891-e363-4edf-bc5b-fd01a72ba801 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:15.061246 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed286891-e363-4edf-bc5b-fd01a72ba801 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:15.065398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54140f-8926-42bf-9a46-af61a73bebc1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:15.065704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54140f-8926-42bf-9a46-af61a73bebc1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:15.065985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54140f-8926-42bf-9a46-af61a73bebc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-ed286891-e363-4edf-bc5b-fd01a72ba801 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:15.089440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:15.091743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:15.093842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:15.093842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:15.093842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:15.093842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:15.093842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:15.093842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:15.093842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:15.093842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:15.093842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:06:15.093842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:15.098911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 273/549] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:06:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:15.105349 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed286891-e363-4edf-bc5b-fd01a72ba801 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:15.114939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1e54140f-8926-42bf-9a46-af61a73bebc1 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:15.117132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1e54140f-8926-42bf-9a46-af61a73bebc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:15.236930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed286891-e363-4edf-bc5b-fd01a72ba801 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:15.255151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 277/550] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:15.277610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54140f-8926-42bf-9a46-af61a73bebc1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:15.278994 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001614d5-ae4a-43c2-8299-33c617875059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:15.279675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001614d5-ae4a-43c2-8299-33c617875059 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:15.280018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001614d5-ae4a-43c2-8299-33c617875059 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:15.280351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001614d5-ae4a-43c2-8299-33c617875059 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:15.281268 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001614d5-ae4a-43c2-8299-33c617875059 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:15.281680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001614d5-ae4a-43c2-8299-33c617875059 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:15.283474 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001614d5-ae4a-43c2-8299-33c617875059 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:15.302321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 274/551] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Aug 9 11:06:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:15.308153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001614d5-ae4a-43c2-8299-33c617875059 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:15.336675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:15.434312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54140f-8926-42bf-9a46-af61a73bebc1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:15.478155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001614d5-ae4a-43c2-8299-33c617875059 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:15.483611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:15.504564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5619347-00ca-4361-99f8-54a5158b6d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:15.505203 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5619347-00ca-4361-99f8-54a5158b6d68 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:15.505477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5619347-00ca-4361-99f8-54a5158b6d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:15.505766 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5619347-00ca-4361-99f8-54a5158b6d68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:15.521853 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f3a4a-640f-4544-b4cc-b640b3d5cf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:15.522693 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f3a4a-640f-4544-b4cc-b640b3d5cf1b None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:15.523241 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f3a4a-640f-4544-b4cc-b640b3d5cf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:15.523662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f3a4a-640f-4544-b4cc-b640b3d5cf1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:15.524668 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5619347-00ca-4361-99f8-54a5158b6d68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-e5619347-00ca-4361-99f8-54a5158b6d68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:15.529588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:15.530845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:15.531986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:15.531986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:15.531986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:15.531986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:15.531986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:15.531986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:15.531986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:15.531986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:15.531986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:15.531986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:15.531986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:15.531986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:15.537850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 278/552] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:15.538831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5619347-00ca-4361-99f8-54a5158b6d68 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:15.609472 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f3a4a-640f-4544-b4cc-b640b3d5cf1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:15.610907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f3a4a-640f-4544-b4cc-b640b3d5cf1b None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:15.650929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:15.680601 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5619347-00ca-4361-99f8-54a5158b6d68 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:15.716908 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a09e08-0533-4fc0-8b45-a30573bfe9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:15.717515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a09e08-0533-4fc0-8b45-a30573bfe9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:15.717815 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a09e08-0533-4fc0-8b45-a30573bfe9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:15.718081 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a09e08-0533-4fc0-8b45-a30573bfe9c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:15.718896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a09e08-0533-4fc0-8b45-a30573bfe9c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:15.719199 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a09e08-0533-4fc0-8b45-a30573bfe9c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:15.720582 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a09e08-0533-4fc0-8b45-a30573bfe9c9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:15.730044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 279/553] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:15.731331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578bc8a-9630-4de1-855e-aaaf509e7226 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:15.731611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578bc8a-9630-4de1-855e-aaaf509e7226 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:15.731882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578bc8a-9630-4de1-855e-aaaf509e7226 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:15.733321 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 280/554] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:15.734944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578bc8a-9630-4de1-855e-aaaf509e7226 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:15.749010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 275/555] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:06:15.750416 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50f468-aa80-4894-8cd4-4c946de44049 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:15.750698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50f468-aa80-4894-8cd4-4c946de44049 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:15.750963 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50f468-aa80-4894-8cd4-4c946de44049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:15.769070 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-ea50f468-aa80-4894-8cd4-4c946de44049 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:15.770305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ea50f468-aa80-4894-8cd4-4c946de44049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:15.785827 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:15.842834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 276/556] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:15.843979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50f468-aa80-4894-8cd4-4c946de44049 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:15.875974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578bc8a-9630-4de1-855e-aaaf509e7226 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:15.917135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:15.921362 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2d958-aa23-4407-9a0f-9e8b5910240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:15.922080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2d958-aa23-4407-9a0f-9e8b5910240f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:15.922324 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2d958-aa23-4407-9a0f-9e8b5910240f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:15.922591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2d958-aa23-4407-9a0f-9e8b5910240f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:15.935418 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2d958-aa23-4407-9a0f-9e8b5910240f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:15.936608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2d958-aa23-4407-9a0f-9e8b5910240f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-0ff2d958-aa23-4407-9a0f-9e8b5910240f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:15.951546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:15.952492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:15.953361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:15.953361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:15.953361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:15.957571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 281/557] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:15.958478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2d958-aa23-4407-9a0f-9e8b5910240f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:15.971387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50f468-aa80-4894-8cd4-4c946de44049 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:16.016514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a3124-2b00-486e-b2e0-152d3fa4b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:16.018425 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a3124-2b00-486e-b2e0-152d3fa4b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:16.018692 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a3124-2b00-486e-b2e0-152d3fa4b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:16.018961 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a3124-2b00-486e-b2e0-152d3fa4b7c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:16.034628 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a3124-2b00-486e-b2e0-152d3fa4b7c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:16.037153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a3124-2b00-486e-b2e0-152d3fa4b7c2 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-cb2a3124-2b00-486e-b2e0-152d3fa4b7c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:16.055533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:16.057040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:16.057946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:16.057946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:16.057946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:16.058128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:16.060758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 277/558] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:16.061999 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a3124-2b00-486e-b2e0-152d3fa4b7c2 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:16.073303 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2d958-aa23-4407-9a0f-9e8b5910240f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:16.109448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec676a-a394-44db-a7c6-c5d4520c0f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:16.110307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec676a-a394-44db-a7c6-c5d4520c0f9e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:16.110669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec676a-a394-44db-a7c6-c5d4520c0f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:16.111335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec676a-a394-44db-a7c6-c5d4520c0f9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:16.122541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec676a-a394-44db-a7c6-c5d4520c0f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-01ec676a-a394-44db-a7c6-c5d4520c0f9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:16.128102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:16.129374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:16.130320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:16.130320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:16.130320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:16.130320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:16.130320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:16.130320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:16.130320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:16.130320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:16.130320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:16.130320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:16.130320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:16.130320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:16.134213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 282/559] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:16.135171 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec676a-a394-44db-a7c6-c5d4520c0f9e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:16.188586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a3124-2b00-486e-b2e0-152d3fa4b7c2 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:16.200216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:16.233179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d63264-912c-4c74-a4c2-b6baff243519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:16.234191 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d63264-912c-4c74-a4c2-b6baff243519 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:16.234699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d63264-912c-4c74-a4c2-b6baff243519 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:16.235173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d63264-912c-4c74-a4c2-b6baff243519 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:16.236030 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d63264-912c-4c74-a4c2-b6baff243519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:16.236538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d63264-912c-4c74-a4c2-b6baff243519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:16.238424 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d63264-912c-4c74-a4c2-b6baff243519 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:16.259123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec676a-a394-44db-a7c6-c5d4520c0f9e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:16.259548 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 278/560] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:16.260780 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d63264-912c-4c74-a4c2-b6baff243519 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:16.298170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b86fca-55a7-4be7-ae3a-9138f0863544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:16.298770 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b86fca-55a7-4be7-ae3a-9138f0863544 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:16.299822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b86fca-55a7-4be7-ae3a-9138f0863544 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:16.300121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b86fca-55a7-4be7-ae3a-9138f0863544 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:16.300749 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b86fca-55a7-4be7-ae3a-9138f0863544 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:16.301049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b86fca-55a7-4be7-ae3a-9138f0863544 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:16.302479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b86fca-55a7-4be7-ae3a-9138f0863544 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:16.318000 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 283/561] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:16.319064 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b86fca-55a7-4be7-ae3a-9138f0863544 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:16.340858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:16.384269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d63264-912c-4c74-a4c2-b6baff243519 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:16.422250 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451c41a-03a5-40c5-a335-56c39e06178e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:16.423270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451c41a-03a5-40c5-a335-56c39e06178e None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:16.423813 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451c41a-03a5-40c5-a335-56c39e06178e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:16.424272 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451c41a-03a5-40c5-a335-56c39e06178e None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:16.425166 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451c41a-03a5-40c5-a335-56c39e06178e None admin] RBAC: Adding query filter params (name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:16.425694 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451c41a-03a5-40c5-a335-56c39e06178e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:16.427482 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451c41a-03a5-40c5-a335-56c39e06178e None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:16.441103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 279/562] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:16.442312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451c41a-03a5-40c5-a335-56c39e06178e None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:16.455376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b86fca-55a7-4be7-ae3a-9138f0863544 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:16.476523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:16.494100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2145a9-98e9-4387-a7bd-d4cc6ca78776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:16.494564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2145a9-98e9-4387-a7bd-d4cc6ca78776 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:16.494830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2145a9-98e9-4387-a7bd-d4cc6ca78776 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:16.495123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2145a9-98e9-4387-a7bd-d4cc6ca78776 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:16.503750 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2145a9-98e9-4387-a7bd-d4cc6ca78776 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:16.505564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2145a9-98e9-4387-a7bd-d4cc6ca78776 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-bb2145a9-98e9-4387-a7bd-d4cc6ca78776 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:16.520332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:16.521526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:16.530103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:16.530103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:16.530103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:16.530103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:16.530103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:16.530103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:16.530103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:16.530103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:16.530103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 11:06:16.530103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:16.530103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 284/563] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:06:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:16.530103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2145a9-98e9-4387-a7bd-d4cc6ca78776 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:16.550095 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451c41a-03a5-40c5-a335-56c39e06178e None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:16.584258 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca4fab-d0ae-44d3-a6e0-3b3b85d5a7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:16.584880 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca4fab-d0ae-44d3-a6e0-3b3b85d5a7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:16.585150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca4fab-d0ae-44d3-a6e0-3b3b85d5a7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:16.585417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca4fab-d0ae-44d3-a6e0-3b3b85d5a7e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:16.592740 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca4fab-d0ae-44d3-a6e0-3b3b85d5a7e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:16.594218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca4fab-d0ae-44d3-a6e0-3b3b85d5a7e1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:16.604374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:16.605010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-54ca4fab-d0ae-44d3-a6e0-3b3b85d5a7e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:16.605010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:16.605010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:16.605010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:16.605010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:16.605010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:16.605010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:16.605010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:16.605010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:16.605010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:16.605010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:16.605010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:16.605010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:16.605010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:16.605010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:16.606037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:16.607093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:16.607093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:16.607093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:16.607093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:16.607093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:16.607093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:16.607093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:16.607093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:16.610911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 280/564] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:16.612173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4f6b2-6487-4e8a-ab75-0cddb076487a None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:16.612453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4f6b2-6487-4e8a-ab75-0cddb076487a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:16.612738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4f6b2-6487-4e8a-ab75-0cddb076487a None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:16.614025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 281/565] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:16.614701 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4f6b2-6487-4e8a-ab75-0cddb076487a None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:16.647368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2145a9-98e9-4387-a7bd-d4cc6ca78776 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:16.686108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d9800-9080-4425-a367-cee0a8b7fb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:16.697963 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d9800-9080-4425-a367-cee0a8b7fb2f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:16.697963 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d9800-9080-4425-a367-cee0a8b7fb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:16.697963 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d9800-9080-4425-a367-cee0a8b7fb2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:16.700907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d9800-9080-4425-a367-cee0a8b7fb2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:16.702406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d9800-9080-4425-a367-cee0a8b7fb2f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-c46d9800-9080-4425-a367-cee0a8b7fb2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:16.716552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:16.723202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:16.724309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:16.724309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:16.724309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:16.724309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 285/566] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:16.724309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d9800-9080-4425-a367-cee0a8b7fb2f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:16.724634 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:16.731382 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4f6b2-6487-4e8a-ab75-0cddb076487a None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:16.766006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721a3c3-dfa7-421f-9db5-44a34ce81b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:16.766612 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721a3c3-dfa7-421f-9db5-44a34ce81b3e None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:16.766882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721a3c3-dfa7-421f-9db5-44a34ce81b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:16.767416 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721a3c3-dfa7-421f-9db5-44a34ce81b3e None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:16.767869 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721a3c3-dfa7-421f-9db5-44a34ce81b3e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:16.768158 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721a3c3-dfa7-421f-9db5-44a34ce81b3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:16.769598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721a3c3-dfa7-421f-9db5-44a34ce81b3e None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:16.787315 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 282/567] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Aug 9 11:06:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:16.788759 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ad823-3e12-4bbe-87ad-cdfe883c62cd None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:16.789174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ad823-3e12-4bbe-87ad-cdfe883c62cd None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:16.789659 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ad823-3e12-4bbe-87ad-cdfe883c62cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:16.807944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-5b7ad823-3e12-4bbe-87ad-cdfe883c62cd None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:16.809126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5b7ad823-3e12-4bbe-87ad-cdfe883c62cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:16.834522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d9800-9080-4425-a367-cee0a8b7fb2f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:16.863753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:16.885296 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d0c9d-6523-43d0-a754-f21aa1e68691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:16.886320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d0c9d-6523-43d0-a754-f21aa1e68691 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:16.887016 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d0c9d-6523-43d0-a754-f21aa1e68691 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:16.887137 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 283/568] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:16.887229 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d0c9d-6523-43d0-a754-f21aa1e68691 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:16.888246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d0c9d-6523-43d0-a754-f21aa1e68691 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:16.888718 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d0c9d-6523-43d0-a754-f21aa1e68691 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:16.891011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d0c9d-6523-43d0-a754-f21aa1e68691 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:16.894553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ad823-3e12-4bbe-87ad-cdfe883c62cd None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:16.915003 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 286/569] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:16.916610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d0c9d-6523-43d0-a754-f21aa1e68691 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:16.978135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:17.001369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ad823-3e12-4bbe-87ad-cdfe883c62cd None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:17.027607 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d0c9d-6523-43d0-a754-f21aa1e68691 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:17.036460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976f819-18dc-4606-b807-45169c698508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:17.037068 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976f819-18dc-4606-b807-45169c698508 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:17.037343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976f819-18dc-4606-b807-45169c698508 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:17.037613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976f819-18dc-4606-b807-45169c698508 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:17.038282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976f819-18dc-4606-b807-45169c698508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:17.038581 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976f819-18dc-4606-b807-45169c698508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:17.040063 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976f819-18dc-4606-b807-45169c698508 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:17.051217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 284/570] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:17.052022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976f819-18dc-4606-b807-45169c698508 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:17.072246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbddef9-438b-479a-b787-e7c1658a73ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:17.072880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbddef9-438b-479a-b787-e7c1658a73ff None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:17.073149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbddef9-438b-479a-b787-e7c1658a73ff None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:17.073419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbddef9-438b-479a-b787-e7c1658a73ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:17.084398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbddef9-438b-479a-b787-e7c1658a73ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:17.085865 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbddef9-438b-479a-b787-e7c1658a73ff None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-2fbddef9-438b-479a-b787-e7c1658a73ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:17.101600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:17.102707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:17.103597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:17.103597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:17.103597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:17.103597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 287/571] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:17.103597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbddef9-438b-479a-b787-e7c1658a73ff None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:17.134184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:17.163280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976f819-18dc-4606-b807-45169c698508 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:17.196034 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ab4e0-f21d-4e09-b667-39a6fa01b396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:17.196745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ab4e0-f21d-4e09-b667-39a6fa01b396 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:17.197131 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ab4e0-f21d-4e09-b667-39a6fa01b396 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:17.197418 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ab4e0-f21d-4e09-b667-39a6fa01b396 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:17.204136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:17.206251 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbddef9-438b-479a-b787-e7c1658a73ff None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:17.209392 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ab4e0-f21d-4e09-b667-39a6fa01b396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-689ab4e0-f21d-4e09-b667-39a6fa01b396 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:17.214477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:17.215629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:17.216509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:17.216509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:17.216509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:17.216509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:17.216509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:17.216509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:17.216509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:17.216509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:17.216509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:17.216509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:17.216509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:17.216509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:17.216509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 285/572] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:17.216509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ab4e0-f21d-4e09-b667-39a6fa01b396 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:17.252568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbe527-978e-41c3-ae0a-ab568e9d9fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:17.253180 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbe527-978e-41c3-ae0a-ab568e9d9fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:17.253452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbe527-978e-41c3-ae0a-ab568e9d9fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:17.253750 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbe527-978e-41c3-ae0a-ab568e9d9fd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:17.254969 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbe527-978e-41c3-ae0a-ab568e9d9fd4 None admin] RBAC: Adding query filter params (role.id=bcdb152b51e34826a39fc0f8c3d60664, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=557b8757098e4777965d782d1ce5f97b) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:17.255275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbe527-978e-41c3-ae0a-ab568e9d9fd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:17.256695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbe527-978e-41c3-ae0a-ab568e9d9fd4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:17.262591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 288/573] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:17 2022] GET /identity/v3/role_assignments?user.id=557b8757098e4777965d782d1ce5f97b&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=bcdb152b51e34826a39fc0f8c3d60664 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:17.263569 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbe527-978e-41c3-ae0a-ab568e9d9fd4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:17.333412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ab4e0-f21d-4e09-b667-39a6fa01b396 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:17.371443 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8959a-3f75-4033-a549-6546618a8a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:17.372087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8959a-3f75-4033-a549-6546618a8a4b None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:17.372361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8959a-3f75-4033-a549-6546618a8a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:17.372627 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8959a-3f75-4033-a549-6546618a8a4b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:17.373464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:17.381033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbe527-978e-41c3-ae0a-ab568e9d9fd4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:17.382184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8959a-3f75-4033-a549-6546618a8a4b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:17.383765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8959a-3f75-4033-a549-6546618a8a4b None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-6fa8959a-3f75-4033-a549-6546618a8a4b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:17.395946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:17.397222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:17.398414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:17.398414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:17.398414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:17.398414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:17.398414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:17.398414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:17.398414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:17.398414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:17.398414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:06:17.398414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:17.398414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 286/574] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:06:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:17.403061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73278018-f013-4926-ad76-b48d857c0798 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:17.403334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73278018-f013-4926-ad76-b48d857c0798 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:17.403600 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73278018-f013-4926-ad76-b48d857c0798 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:17.405096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 287/575] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:17.405674 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73278018-f013-4926-ad76-b48d857c0798 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:17.437322 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03661049-ac5a-4c48-beeb-2551a5221b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:17.438312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03661049-ac5a-4c48-beeb-2551a5221b19 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:17.438772 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03661049-ac5a-4c48-beeb-2551a5221b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:17.439191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03661049-ac5a-4c48-beeb-2551a5221b19 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:17.439986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03661049-ac5a-4c48-beeb-2551a5221b19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:17.440427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03661049-ac5a-4c48-beeb-2551a5221b19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:17.442117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03661049-ac5a-4c48-beeb-2551a5221b19 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:17.455071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 289/576] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:17.456158 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03661049-ac5a-4c48-beeb-2551a5221b19 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:17.470939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:17.523061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73278018-f013-4926-ad76-b48d857c0798 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:17.558225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c851d8-fabd-43ef-b7d1-1842a6d71a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:17.558948 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c851d8-fabd-43ef-b7d1-1842a6d71a30 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:17.559285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c851d8-fabd-43ef-b7d1-1842a6d71a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:17.559560 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c851d8-fabd-43ef-b7d1-1842a6d71a30 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:17.560225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c851d8-fabd-43ef-b7d1-1842a6d71a30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:17.560524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c851d8-fabd-43ef-b7d1-1842a6d71a30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:17.561927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c851d8-fabd-43ef-b7d1-1842a6d71a30 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:17.565947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03661049-ac5a-4c48-beeb-2551a5221b19 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:17.571501 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 288/577] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:17.578020 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8a047-9d4b-4ca3-9fa8-24acfae61fe0 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:17.578340 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8a047-9d4b-4ca3-9fa8-24acfae61fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:17.578747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8a047-9d4b-4ca3-9fa8-24acfae61fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:17.600329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-bdf8a047-9d4b-4ca3-9fa8-24acfae61fe0 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:17.601901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-bdf8a047-9d4b-4ca3-9fa8-24acfae61fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:17.609909 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726d1de-d00a-4797-ae7c-cdbf41b7f88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:17.610858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726d1de-d00a-4797-ae7c-cdbf41b7f88b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:17.611321 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726d1de-d00a-4797-ae7c-cdbf41b7f88b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:17.611790 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726d1de-d00a-4797-ae7c-cdbf41b7f88b None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:17.612730 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726d1de-d00a-4797-ae7c-cdbf41b7f88b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:17.613220 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726d1de-d00a-4797-ae7c-cdbf41b7f88b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:17.614904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726d1de-d00a-4797-ae7c-cdbf41b7f88b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:17.634512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 290/578] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Aug 9 11:06:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:17.635723 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726d1de-d00a-4797-ae7c-cdbf41b7f88b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:17.652959 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:17.689076 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 289/579] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:17.690337 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8a047-9d4b-4ca3-9fa8-24acfae61fe0 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:17.751960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726d1de-d00a-4797-ae7c-cdbf41b7f88b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:17.752147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:17.789522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97141351-a1e0-4037-b89d-0c366c0113ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:17.790187 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97141351-a1e0-4037-b89d-0c366c0113ef None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:17.790464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97141351-a1e0-4037-b89d-0c366c0113ef None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:17.790735 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97141351-a1e0-4037-b89d-0c366c0113ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:17.797529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97141351-a1e0-4037-b89d-0c366c0113ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:17.799048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97141351-a1e0-4037-b89d-0c366c0113ef None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:17.809220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8a047-9d4b-4ca3-9fa8-24acfae61fe0 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:17.810967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-97141351-a1e0-4037-b89d-0c366c0113ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:17.810967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:17.810967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:17.810967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:17.810967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:17.810967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:17.810967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:17.810967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:17.810967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:17.810967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:17.810967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:17.810967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:17.810967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:17.810967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:17.810967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:17.812007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:17.812907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:17.812907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:17.812907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:17.812907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:17.812907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:17.812907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:17.812907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:17.812907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:17.812907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 291/580] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:17.812907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97141351-a1e0-4037-b89d-0c366c0113ef None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:17.856039 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435491f-4341-44ae-b4e5-a9ce77e8b468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:17.856765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435491f-4341-44ae-b4e5-a9ce77e8b468 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:17.857112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435491f-4341-44ae-b4e5-a9ce77e8b468 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:17.857392 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435491f-4341-44ae-b4e5-a9ce77e8b468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:17.868028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435491f-4341-44ae-b4e5-a9ce77e8b468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:17.869508 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435491f-4341-44ae-b4e5-a9ce77e8b468 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-7435491f-4341-44ae-b4e5-a9ce77e8b468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:17.885274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:17.886273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:17.887267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:17.887267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:17.887267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:17.887267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 290/581] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:17.887267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435491f-4341-44ae-b4e5-a9ce77e8b468 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:17.898546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:17.925964 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97141351-a1e0-4037-b89d-0c366c0113ef None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:17.963682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790fe82-3931-43f2-ab40-010260876aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:17.964311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790fe82-3931-43f2-ab40-010260876aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:17.964591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790fe82-3931-43f2-ab40-010260876aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:17.964855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790fe82-3931-43f2-ab40-010260876aa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:17.975251 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790fe82-3931-43f2-ab40-010260876aa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:17.976694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790fe82-3931-43f2-ab40-010260876aa1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-8790fe82-3931-43f2-ab40-010260876aa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:17.991512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:17.992762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:17.993718 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:17.993718 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:17.993718 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:17.993718 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 292/582] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:17.993975 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790fe82-3931-43f2-ab40-010260876aa1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:18.002572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435491f-4341-44ae-b4e5-a9ce77e8b468 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:18.004418 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:18.039449 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f7ade-b286-405e-96be-017d2ec97778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:18.040137 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f7ade-b286-405e-96be-017d2ec97778 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:18.040330 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f7ade-b286-405e-96be-017d2ec97778 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:18.040596 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f7ade-b286-405e-96be-017d2ec97778 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:18.051269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f7ade-b286-405e-96be-017d2ec97778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-140f7ade-b286-405e-96be-017d2ec97778 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:18.056569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:18.057539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:18.058499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:18.058499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:18.058499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:18.058499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:18.058499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:18.058499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:18.058499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:18.058499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:18.058499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:18.058499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:18.058499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:18.058499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:18.058499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 291/583] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:18.058499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f7ade-b286-405e-96be-017d2ec97778 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:18.107151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790fe82-3931-43f2-ab40-010260876aa1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:18.135536 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:18.145863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93b703-c32e-469d-99b5-91a14e11645c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:18.146483 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93b703-c32e-469d-99b5-91a14e11645c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:18.146759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93b703-c32e-469d-99b5-91a14e11645c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:18.147029 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93b703-c32e-469d-99b5-91a14e11645c None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:18.147715 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93b703-c32e-469d-99b5-91a14e11645c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:18.148018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93b703-c32e-469d-99b5-91a14e11645c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:18.149495 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93b703-c32e-469d-99b5-91a14e11645c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:18.161778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f7ade-b286-405e-96be-017d2ec97778 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:18.167708 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 293/584] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:18.167708 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93b703-c32e-469d-99b5-91a14e11645c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:18.203522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178f8d-afb9-452f-8d86-42e2f0c95305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:18.204093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178f8d-afb9-452f-8d86-42e2f0c95305 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:18.204366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178f8d-afb9-452f-8d86-42e2f0c95305 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:18.204632 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178f8d-afb9-452f-8d86-42e2f0c95305 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:18.205301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f178f8d-afb9-452f-8d86-42e2f0c95305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:18.205603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f178f8d-afb9-452f-8d86-42e2f0c95305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:18.207017 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f178f8d-afb9-452f-8d86-42e2f0c95305 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:18.219895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 292/585] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:18.220748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178f8d-afb9-452f-8d86-42e2f0c95305 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:18.249001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:18.278851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93b703-c32e-469d-99b5-91a14e11645c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:18.319620 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff815a9-c293-496f-8bde-ac6b158eac28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:18.320243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff815a9-c293-496f-8bde-ac6b158eac28 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:18.320633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff815a9-c293-496f-8bde-ac6b158eac28 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:18.320909 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff815a9-c293-496f-8bde-ac6b158eac28 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:18.321658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff815a9-c293-496f-8bde-ac6b158eac28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:18.321869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff815a9-c293-496f-8bde-ac6b158eac28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:18.323298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff815a9-c293-496f-8bde-ac6b158eac28 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:18.325566 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178f8d-afb9-452f-8d86-42e2f0c95305 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:18.335196 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 294/586] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:18.336475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff815a9-c293-496f-8bde-ac6b158eac28 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:18.365592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7af125-1503-41af-b17d-84cf0cdf000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:18.366209 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7af125-1503-41af-b17d-84cf0cdf000e None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:18.366481 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7af125-1503-41af-b17d-84cf0cdf000e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:18.367127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7af125-1503-41af-b17d-84cf0cdf000e None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:18.367465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7af125-1503-41af-b17d-84cf0cdf000e None admin] RBAC: Adding query filter params (name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:18.367729 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7af125-1503-41af-b17d-84cf0cdf000e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:18.369107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7af125-1503-41af-b17d-84cf0cdf000e None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:18.382643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 293/587] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:18.382643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7af125-1503-41af-b17d-84cf0cdf000e None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:18.405426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:18.465935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff815a9-c293-496f-8bde-ac6b158eac28 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:18.475487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:18.497047 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7af125-1503-41af-b17d-84cf0cdf000e None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:18.504524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba06f4-ffb1-400e-bf63-7423550aec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:18.505297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba06f4-ffb1-400e-bf63-7423550aec3f None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:18.505733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba06f4-ffb1-400e-bf63-7423550aec3f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:18.506103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba06f4-ffb1-400e-bf63-7423550aec3f None admin] PATH_INFO: `/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/5356835ef79c458bbfa7d6adafd0cb36/roles/bcdb152b51e34826a39fc0f8c3d60664` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:18.520871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba06f4-ffb1-400e-bf63-7423550aec3f None admin] RBAC: Authorizing `identity:create_grant(project_id=166e5328bfae434ba19d12be2eaa7a1b, user_id=5356835ef79c458bbfa7d6adafd0cb36, role_id=bcdb152b51e34826a39fc0f8c3d60664)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:18.522337 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba06f4-ffb1-400e-bf63-7423550aec3f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:18.532859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b32bbf-8965-49d5-94f1-21564d9b6fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:18.533551 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b32bbf-8965-49d5-94f1-21564d9b6fee None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:18.533929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b32bbf-8965-49d5-94f1-21564d9b6fee None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:18.534288 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b32bbf-8965-49d5-94f1-21564d9b6fee None admin] PATH_INFO: `/v3/users/nova` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:18.545929 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 295/588] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:06:18 2022] PUT /identity/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/5356835ef79c458bbfa7d6adafd0cb36/roles/bcdb152b51e34826a39fc0f8c3d60664 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:06:18.545929 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba06f4-ffb1-400e-bf63-7423550aec3f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:18.554352 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b32bbf-8965-49d5-94f1-21564d9b6fee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:18.556288 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b32bbf-8965-49d5-94f1-21564d9b6fee None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-e4b32bbf-8965-49d5-94f1-21564d9b6fee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:18.570003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:18.571324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:18.572562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:18.572562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:18.572562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:18.572562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:18.572562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:18.572562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:18.572562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:18.572562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:18.572562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:06:18.572562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:18.572562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 294/589] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Aug 9 11:06:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:18.573402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b32bbf-8965-49d5-94f1-21564d9b6fee None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:18.680019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:18.693019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba06f4-ffb1-400e-bf63-7423550aec3f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:18.698061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b32bbf-8965-49d5-94f1-21564d9b6fee None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:18.744872 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2ea6b-2d39-4f57-8bfd-b11d65709db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:18.745756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2ea6b-2d39-4f57-8bfd-b11d65709db2 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:18.746120 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2ea6b-2d39-4f57-8bfd-b11d65709db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:18.746519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2ea6b-2d39-4f57-8bfd-b11d65709db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:18.748364 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97a710-da7c-4338-abee-763e9f076543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:18.748999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97a710-da7c-4338-abee-763e9f076543 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:18.749274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97a710-da7c-4338-abee-763e9f076543 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:18.749542 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97a710-da7c-4338-abee-763e9f076543 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:18.757022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97a710-da7c-4338-abee-763e9f076543 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:18.758621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97a710-da7c-4338-abee-763e9f076543 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:18.760629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2ea6b-2d39-4f57-8bfd-b11d65709db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:18.762353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2ea6b-2d39-4f57-8bfd-b11d65709db2 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:18.771152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-8b97a710-da7c-4338-abee-763e9f076543 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:18.771152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:18.771152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:18.771152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:18.771152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:18.771152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:18.771152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:18.771152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:18.771152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:18.771152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:18.771152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:18.771152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:18.771152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:18.771152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:18.771152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:18.772236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:18.773365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:18.773365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:18.773365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:18.773365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:18.773365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:18.773365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:18.773365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:18.773365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:18.773365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 296/590] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:18.774132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97a710-da7c-4338-abee-763e9f076543 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:18.774202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-71c2ea6b-2d39-4f57-8bfd-b11d65709db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:18.783960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:18.785144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:18.786302 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:18.786302 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:18.786302 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:18.787130 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 295/591] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:18.788050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2ea6b-2d39-4f57-8bfd-b11d65709db2 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:18.890757 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2ea6b-2d39-4f57-8bfd-b11d65709db2 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:18.913001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97a710-da7c-4338-abee-763e9f076543 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:18.930441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9e844-3848-4771-aca0-91efed61f340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:18.931325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9e844-3848-4771-aca0-91efed61f340 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:18.931954 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9e844-3848-4771-aca0-91efed61f340 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:18.932364 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9e844-3848-4771-aca0-91efed61f340 None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:18.933644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9e844-3848-4771-aca0-91efed61f340 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:18.934116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9e844-3848-4771-aca0-91efed61f340 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:18.936351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9e844-3848-4771-aca0-91efed61f340 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:18.952480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 296/592] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:18.953537 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9e844-3848-4771-aca0-91efed61f340 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:18.953696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483e4f0-f4cd-4998-9361-774deff02911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:18.954556 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483e4f0-f4cd-4998-9361-774deff02911 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:18.954980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483e4f0-f4cd-4998-9361-774deff02911 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:18.955388 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483e4f0-f4cd-4998-9361-774deff02911 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:18.956276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483e4f0-f4cd-4998-9361-774deff02911 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:18.957189 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483e4f0-f4cd-4998-9361-774deff02911 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:18.959704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483e4f0-f4cd-4998-9361-774deff02911 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:18.982335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 297/593] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Aug 9 11:06:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:18.983388 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483e4f0-f4cd-4998-9361-774deff02911 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:19.001899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:19.018597 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:19.067594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9e844-3848-4771-aca0-91efed61f340 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:19.099073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483e4f0-f4cd-4998-9361-774deff02911 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:19.106079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d8cdf-c3a7-47ff-a76b-8bc9aa298383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:19.106871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d8cdf-c3a7-47ff-a76b-8bc9aa298383 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:19.107243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d8cdf-c3a7-47ff-a76b-8bc9aa298383 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:19.107606 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d8cdf-c3a7-47ff-a76b-8bc9aa298383 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:19.108733 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d8cdf-c3a7-47ff-a76b-8bc9aa298383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:19.108733 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d8cdf-c3a7-47ff-a76b-8bc9aa298383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:19.110315 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d8cdf-c3a7-47ff-a76b-8bc9aa298383 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:19.123625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 297/594] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:19.124748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d8cdf-c3a7-47ff-a76b-8bc9aa298383 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:19.137990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb044e6a-6859-4ef1-ae12-bd4f603a566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:19.138909 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb044e6a-6859-4ef1-ae12-bd4f603a566d None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:19.139427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb044e6a-6859-4ef1-ae12-bd4f603a566d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:19.139900 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb044e6a-6859-4ef1-ae12-bd4f603a566d None admin] PATH_INFO: `/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/097822b9d7954dd0b27e9f650b6e36f9/roles/bcdb152b51e34826a39fc0f8c3d60664` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:19.155724 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb044e6a-6859-4ef1-ae12-bd4f603a566d None admin] RBAC: Authorizing `identity:create_grant(project_id=166e5328bfae434ba19d12be2eaa7a1b, user_id=097822b9d7954dd0b27e9f650b6e36f9, role_id=bcdb152b51e34826a39fc0f8c3d60664)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:19.157669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb044e6a-6859-4ef1-ae12-bd4f603a566d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:19.175022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 298/595] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:06:18 2022] PUT /identity/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/097822b9d7954dd0b27e9f650b6e36f9/roles/bcdb152b51e34826a39fc0f8c3d60664 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:06:19.176258 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb044e6a-6859-4ef1-ae12-bd4f603a566d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:19.258467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:19.287893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d8cdf-c3a7-47ff-a76b-8bc9aa298383 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:19.302046 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb044e6a-6859-4ef1-ae12-bd4f603a566d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:19.307781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:19.329128 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76be41-7786-4368-8a4b-4c0ebcd91d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:19.330141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76be41-7786-4368-8a4b-4c0ebcd91d03 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:19.330141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76be41-7786-4368-8a4b-4c0ebcd91d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:19.330344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76be41-7786-4368-8a4b-4c0ebcd91d03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:19.342339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76be41-7786-4368-8a4b-4c0ebcd91d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:19.343836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76be41-7786-4368-8a4b-4c0ebcd91d03 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:19.347128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6cb4a-55fa-4b28-87d8-ff2ded4e3a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:19.348144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6cb4a-55fa-4b28-87d8-ff2ded4e3a0a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:19.348620 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6cb4a-55fa-4b28-87d8-ff2ded4e3a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:19.349090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6cb4a-55fa-4b28-87d8-ff2ded4e3a0a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:19.357929 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6cb4a-55fa-4b28-87d8-ff2ded4e3a0a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:19.359699 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6cb4a-55fa-4b28-87d8-ff2ded4e3a0a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-fe76be41-7786-4368-8a4b-4c0ebcd91d03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:19.360277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:19.361192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:19.362160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:19.362160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:19.362160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:19.366796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 298/596] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:19.367110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfbb77-189a-4e8f-8c1e-c21490cfbd1a None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:19.367588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfbb77-189a-4e8f-8c1e-c21490cfbd1a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:19.367832 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfbb77-189a-4e8f-8c1e-c21490cfbd1a None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:19.369321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 299/597] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:19.372541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfbb77-189a-4e8f-8c1e-c21490cfbd1a None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-46f6cb4a-55fa-4b28-87d8-ff2ded4e3a0a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:19.382263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:19.383313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:19.384286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:19.384286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:19.384286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:19.384286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:19.384286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:19.384286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:19.384286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:19.384286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:19.384286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 11:06:19.384286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:19.384286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 299/598] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:19.384917 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8f836-dea6-4fba-a5e4-3fd3e869f2f2 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:19.384985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8f836-dea6-4fba-a5e4-3fd3e869f2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:19.385776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8f836-dea6-4fba-a5e4-3fd3e869f2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:19.406869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ddd8f836-dea6-4fba-a5e4-3fd3e869f2f2 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:19.408091 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ddd8f836-dea6-4fba-a5e4-3fd3e869f2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:19.494154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 300/599] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:19.495150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8f836-dea6-4fba-a5e4-3fd3e869f2f2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:19.508466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfbb77-189a-4e8f-8c1e-c21490cfbd1a None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:19.549189 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227bf94-fe2c-4d1f-9669-6e0fc64e59b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:19.550091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227bf94-fe2c-4d1f-9669-6e0fc64e59b1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:19.550525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227bf94-fe2c-4d1f-9669-6e0fc64e59b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:19.550930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227bf94-fe2c-4d1f-9669-6e0fc64e59b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:19.551759 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227bf94-fe2c-4d1f-9669-6e0fc64e59b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:19.552205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227bf94-fe2c-4d1f-9669-6e0fc64e59b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:19.553820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227bf94-fe2c-4d1f-9669-6e0fc64e59b1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:19.567398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 300/600] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:19.568483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227bf94-fe2c-4d1f-9669-6e0fc64e59b1 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:19.582814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:19.598213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:19.632988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8f836-dea6-4fba-a5e4-3fd3e869f2f2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:19.675625 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51621858-f251-455d-84b3-b7f52543ad0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:19.676401 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621858-f251-455d-84b3-b7f52543ad0c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:19.676774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621858-f251-455d-84b3-b7f52543ad0c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:19.677219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621858-f251-455d-84b3-b7f52543ad0c None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:19.677989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51621858-f251-455d-84b3-b7f52543ad0c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:19.678394 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51621858-f251-455d-84b3-b7f52543ad0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:19.679807 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227bf94-fe2c-4d1f-9669-6e0fc64e59b1 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:19.680045 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51621858-f251-455d-84b3-b7f52543ad0c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:19.702595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 301/601] 10.222.0.15 () {56 vars in 1139 bytes} [Tue Aug 9 11:06:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:19.704419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51621858-f251-455d-84b3-b7f52543ad0c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:19.717162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15769a0-5ebf-4889-82df-359857d1fcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:19.718133 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15769a0-5ebf-4889-82df-359857d1fcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:19.718541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15769a0-5ebf-4889-82df-359857d1fcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:19.719036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15769a0-5ebf-4889-82df-359857d1fcb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:19.730377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15769a0-5ebf-4889-82df-359857d1fcb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-e15769a0-5ebf-4889-82df-359857d1fcb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:19.735432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:19.736550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:19.737582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:19.737582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:19.737582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:19.737582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:19.737582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:19.737582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:19.737582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:19.737582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:19.737582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:19.737582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:19.737582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:19.737582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:19.739864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 301/602] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:19.740770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15769a0-5ebf-4889-82df-359857d1fcb2 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:19.819133 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51621858-f251-455d-84b3-b7f52543ad0c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:19.833555 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:19.834802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:19.847838 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15769a0-5ebf-4889-82df-359857d1fcb2 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:19.856902 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd59e23-fd8d-407d-90a0-14e9bbbe8eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:19.857544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd59e23-fd8d-407d-90a0-14e9bbbe8eda None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:19.857846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd59e23-fd8d-407d-90a0-14e9bbbe8eda None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:19.858112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd59e23-fd8d-407d-90a0-14e9bbbe8eda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:19.865466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd59e23-fd8d-407d-90a0-14e9bbbe8eda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:19.867001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd59e23-fd8d-407d-90a0-14e9bbbe8eda None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:19.878733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-5dd59e23-fd8d-407d-90a0-14e9bbbe8eda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:19.878733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:19.878733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:19.878733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:19.878733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:19.878733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:19.878733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:19.878733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:19.878733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:19.878733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:19.878733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:19.878733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:19.878733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:19.878733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:19.878733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:19.880286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:19.881272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:19.881272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:19.881272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:19.881272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:19.881272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:19.881272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:19.881272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:19.881272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:19.881272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 302/603] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:19.881948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd59e23-fd8d-407d-90a0-14e9bbbe8eda None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:19.889993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea4435-066f-4629-9654-ddc11548b941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:19.890888 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea4435-066f-4629-9654-ddc11548b941 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:19.891325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea4435-066f-4629-9654-ddc11548b941 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:19.891755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea4435-066f-4629-9654-ddc11548b941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:19.903366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea4435-066f-4629-9654-ddc11548b941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:19.905022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea4435-066f-4629-9654-ddc11548b941 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-67ea4435-066f-4629-9654-ddc11548b941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:19.920085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:19.921296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:19.922324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:19.922324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:19.922324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:19.923986 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 302/604] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:19.925010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea4435-066f-4629-9654-ddc11548b941 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:19.993213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd59e23-fd8d-407d-90a0-14e9bbbe8eda None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:20.030201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90565161-c5e4-4c1c-9027-41df18caa072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:20.030814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90565161-c5e4-4c1c-9027-41df18caa072 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:20.031090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90565161-c5e4-4c1c-9027-41df18caa072 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:20.031362 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90565161-c5e4-4c1c-9027-41df18caa072 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:20.031915 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea4435-066f-4629-9654-ddc11548b941 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:20.032094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90565161-c5e4-4c1c-9027-41df18caa072 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:20.032451 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90565161-c5e4-4c1c-9027-41df18caa072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:20.033847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90565161-c5e4-4c1c-9027-41df18caa072 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:20.042847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 303/605] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:20.043890 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90565161-c5e4-4c1c-9027-41df18caa072 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:20.068272 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac2133-111e-453e-96c4-f30d1347e34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:20.069592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac2133-111e-453e-96c4-f30d1347e34b None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:20.070081 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac2133-111e-453e-96c4-f30d1347e34b None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:20.070586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac2133-111e-453e-96c4-f30d1347e34b None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:20.071645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac2133-111e-453e-96c4-f30d1347e34b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:20.072316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac2133-111e-453e-96c4-f30d1347e34b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:20.073990 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac2133-111e-453e-96c4-f30d1347e34b None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:20.082219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:20.083740 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:20.088280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 303/606] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:20.090071 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac2133-111e-453e-96c4-f30d1347e34b None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:20.165352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90565161-c5e4-4c1c-9027-41df18caa072 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:20.201004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1cf32-7708-47ac-a172-632d403a4adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:20.201611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1cf32-7708-47ac-a172-632d403a4adb None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:20.201928 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1cf32-7708-47ac-a172-632d403a4adb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:20.202200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1cf32-7708-47ac-a172-632d403a4adb None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:20.202840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1cf32-7708-47ac-a172-632d403a4adb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:20.203371 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1cf32-7708-47ac-a172-632d403a4adb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:20.204516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1cf32-7708-47ac-a172-632d403a4adb None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:20.212610 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac2133-111e-453e-96c4-f30d1347e34b None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:20.218401 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 304/607] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:20.219363 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1cf32-7708-47ac-a172-632d403a4adb None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:20.249983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa8f74-a440-4289-b224-4097c21a2289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:20.251163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa8f74-a440-4289-b224-4097c21a2289 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:20.251626 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa8f74-a440-4289-b224-4097c21a2289 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:20.252101 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa8f74-a440-4289-b224-4097c21a2289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:20.263664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa8f74-a440-4289-b224-4097c21a2289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:20.265528 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa8f74-a440-4289-b224-4097c21a2289 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-65fa8f74-a440-4289-b224-4097c21a2289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:20.281026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:20.282067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:20.283065 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:20.283065 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:20.283065 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:20.285254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 304/608] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:20.286323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa8f74-a440-4289-b224-4097c21a2289 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:20.317339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:20.326078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1cf32-7708-47ac-a172-632d403a4adb None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:20.342519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:20.362880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd49e3-07ad-494c-a0ce-fe7e1f36e94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:20.363804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd49e3-07ad-494c-a0ce-fe7e1f36e94f None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:20.364285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd49e3-07ad-494c-a0ce-fe7e1f36e94f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:20.364742 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd49e3-07ad-494c-a0ce-fe7e1f36e94f None admin] PATH_INFO: `/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/881030d7605b40879762d1c199362ee1/roles/bcdb152b51e34826a39fc0f8c3d60664` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:20.383433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd49e3-07ad-494c-a0ce-fe7e1f36e94f None admin] RBAC: Authorizing `identity:create_grant(project_id=166e5328bfae434ba19d12be2eaa7a1b, user_id=881030d7605b40879762d1c199362ee1, role_id=bcdb152b51e34826a39fc0f8c3d60664)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:20.385203 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd49e3-07ad-494c-a0ce-fe7e1f36e94f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:20.398299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa8f74-a440-4289-b224-4097c21a2289 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:20.409934 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 305/609] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:06:20 2022] PUT /identity/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/881030d7605b40879762d1c199362ee1/roles/bcdb152b51e34826a39fc0f8c3d60664 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:06:20.411296 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd49e3-07ad-494c-a0ce-fe7e1f36e94f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:20.439067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e3168-c772-4259-b7df-be2e533645b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:20.440118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e3168-c772-4259-b7df-be2e533645b3 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:20.440609 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e3168-c772-4259-b7df-be2e533645b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:20.441083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e3168-c772-4259-b7df-be2e533645b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:20.449298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e3168-c772-4259-b7df-be2e533645b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:20.451200 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e3168-c772-4259-b7df-be2e533645b3 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:20.463774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-4f6e3168-c772-4259-b7df-be2e533645b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:20.463774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:20.463774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:20.463774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:20.463774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:20.463774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:20.463774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:20.463774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:20.463774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:20.463774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:20.463774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:20.463774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:20.463774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:20.463774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:20.463774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:20.464742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:20.465714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:20.465714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:20.465714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:20.465714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:20.465714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:20.465714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:20.465714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:20.465714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:20.468175 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 305/610] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:20.474064 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e3168-c772-4259-b7df-be2e533645b3 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:20.629987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd49e3-07ad-494c-a0ce-fe7e1f36e94f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:20.671823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e3168-c772-4259-b7df-be2e533645b3 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:20.675370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebab750-ec1f-40f2-a128-56548d6b2e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:20.676096 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebab750-ec1f-40f2-a128-56548d6b2e16 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:20.676470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebab750-ec1f-40f2-a128-56548d6b2e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:20.676861 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebab750-ec1f-40f2-a128-56548d6b2e16 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:20.677598 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebab750-ec1f-40f2-a128-56548d6b2e16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:20.678067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebab750-ec1f-40f2-a128-56548d6b2e16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:20.679720 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebab750-ec1f-40f2-a128-56548d6b2e16 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:20.686388 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:20.695353 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 306/611] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:20.703027 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebab750-ec1f-40f2-a128-56548d6b2e16 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:20.708077 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:20.725495 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65036146-4b50-4ed4-92a1-4ddbfe7d548b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:20.726607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65036146-4b50-4ed4-92a1-4ddbfe7d548b None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:20.727187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65036146-4b50-4ed4-92a1-4ddbfe7d548b None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:20.727858 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65036146-4b50-4ed4-92a1-4ddbfe7d548b None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:20.728687 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65036146-4b50-4ed4-92a1-4ddbfe7d548b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:20.729125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65036146-4b50-4ed4-92a1-4ddbfe7d548b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:20.730867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65036146-4b50-4ed4-92a1-4ddbfe7d548b None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:20.745436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 306/612] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:20.746960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbf0e6-b813-4b31-bea0-004a28007f8f None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:20.747378 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbf0e6-b813-4b31-bea0-004a28007f8f None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:20.747794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbf0e6-b813-4b31-bea0-004a28007f8f None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:20.749387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 307/613] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:20.758694 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbf0e6-b813-4b31-bea0-004a28007f8f None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:20.823428 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebab750-ec1f-40f2-a128-56548d6b2e16 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:20.857779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7066b7-911e-430a-a5ce-d9d1431ee9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:20.858439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7066b7-911e-430a-a5ce-d9d1431ee9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:20.858737 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7066b7-911e-430a-a5ce-d9d1431ee9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:20.859014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7066b7-911e-430a-a5ce-d9d1431ee9f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:20.864031 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbf0e6-b813-4b31-bea0-004a28007f8f None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:20.868024 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7066b7-911e-430a-a5ce-d9d1431ee9f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:20.869731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7066b7-911e-430a-a5ce-d9d1431ee9f8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-6d7066b7-911e-430a-a5ce-d9d1431ee9f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:20.882512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:20.883719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:20.884851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:20.884851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:20.884851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:20.884851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:20.884851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:20.884851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:20.884851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:20.884851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:20.884851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:06:20.884851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:20.888364 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 307/614] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:06:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:20.889719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa4de6-2f34-48a0-b5c4-d4ba370bc625 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:20.889996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa4de6-2f34-48a0-b5c4-d4ba370bc625 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:20.890260 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa4de6-2f34-48a0-b5c4-d4ba370bc625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:20.905695 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775fff3-576a-4a01-abc8-f448563f708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:20.906626 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775fff3-576a-4a01-abc8-f448563f708e None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:20.907045 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775fff3-576a-4a01-abc8-f448563f708e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:20.907465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775fff3-576a-4a01-abc8-f448563f708e None admin] PATH_INFO: `/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/0ee3889add1541418ccda24268831979/roles/bcdb152b51e34826a39fc0f8c3d60664` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:20.911609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-04fa4de6-2f34-48a0-b5c4-d4ba370bc625 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:20.912209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-04fa4de6-2f34-48a0-b5c4-d4ba370bc625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:20.923191 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775fff3-576a-4a01-abc8-f448563f708e None admin] RBAC: Authorizing `identity:create_grant(project_id=166e5328bfae434ba19d12be2eaa7a1b, user_id=0ee3889add1541418ccda24268831979, role_id=bcdb152b51e34826a39fc0f8c3d60664)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:20.924873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775fff3-576a-4a01-abc8-f448563f708e None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:20.940138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 308/615] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:06:20 2022] PUT /identity/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/0ee3889add1541418ccda24268831979/roles/bcdb152b51e34826a39fc0f8c3d60664 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:06:20.947139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775fff3-576a-4a01-abc8-f448563f708e None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:20.976364 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:20.985527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 308/616] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:21.006294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:21.027085 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa4de6-2f34-48a0-b5c4-d4ba370bc625 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:21.078320 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775fff3-576a-4a01-abc8-f448563f708e None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:21.117186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4faf2c-6531-4fee-b1f1-e901a1448b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:21.118367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4faf2c-6531-4fee-b1f1-e901a1448b1a None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:21.118820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4faf2c-6531-4fee-b1f1-e901a1448b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:21.119244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4faf2c-6531-4fee-b1f1-e901a1448b1a None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:21.120246 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4faf2c-6531-4fee-b1f1-e901a1448b1a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:21.120722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4faf2c-6531-4fee-b1f1-e901a1448b1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:21.122469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4faf2c-6531-4fee-b1f1-e901a1448b1a None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:21.143550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 309/617] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Aug 9 11:06:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:21.154728 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4faf2c-6531-4fee-b1f1-e901a1448b1a None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:21.235316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa4de6-2f34-48a0-b5c4-d4ba370bc625 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:21.273274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80eed9-5a8e-4d1d-9e5c-929d256719b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:21.274006 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80eed9-5a8e-4d1d-9e5c-929d256719b9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:21.274280 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80eed9-5a8e-4d1d-9e5c-929d256719b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:21.274547 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80eed9-5a8e-4d1d-9e5c-929d256719b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:21.286788 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80eed9-5a8e-4d1d-9e5c-929d256719b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-1c80eed9-5a8e-4d1d-9e5c-929d256719b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:21.292798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:21.293798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:21.294651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:21.294651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:21.294651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:21.294651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:21.294651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:21.294651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:21.294651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:21.294651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:21.294651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:21.294651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:21.294651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:21.294651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:21.295293 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 309/618] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:21.301698 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80eed9-5a8e-4d1d-9e5c-929d256719b9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:21.313985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:21.335639 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4faf2c-6531-4fee-b1f1-e901a1448b1a None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:21.388254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:21.413175 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcca2a8-883d-41ea-a616-709c2ae606e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:21.413928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcca2a8-883d-41ea-a616-709c2ae606e2 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:21.414365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcca2a8-883d-41ea-a616-709c2ae606e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:21.414736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcca2a8-883d-41ea-a616-709c2ae606e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:21.426633 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcca2a8-883d-41ea-a616-709c2ae606e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:21.428281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcca2a8-883d-41ea-a616-709c2ae606e2 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-dfcca2a8-883d-41ea-a616-709c2ae606e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:21.444688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:21.445984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:21.447049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:21.447049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:21.447049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:21.447235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80eed9-5a8e-4d1d-9e5c-929d256719b9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:21.447311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 310/619] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:21.449054 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51d3c5-de1f-4397-9504-4ba3853f01c9 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:21.449251 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51d3c5-de1f-4397-9504-4ba3853f01c9 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:21.449409 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51d3c5-de1f-4397-9504-4ba3853f01c9 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:21.451236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 311/620] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:21.452021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51d3c5-de1f-4397-9504-4ba3853f01c9 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:21.493642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e141f3c-5423-4909-83ec-182bafccd384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:21.493642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e141f3c-5423-4909-83ec-182bafccd384 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:21.493642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e141f3c-5423-4909-83ec-182bafccd384 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:21.493642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e141f3c-5423-4909-83ec-182bafccd384 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:21.494049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e141f3c-5423-4909-83ec-182bafccd384 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:21.494049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e141f3c-5423-4909-83ec-182bafccd384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:21.494049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e141f3c-5423-4909-83ec-182bafccd384 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:21.500892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 310/621] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:21.502337 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0535c03-4296-4bbf-b0f5-d81712a960bb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:21.502778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0535c03-4296-4bbf-b0f5-d81712a960bb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:21.503157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0535c03-4296-4bbf-b0f5-d81712a960bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:21.522123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d0535c03-4296-4bbf-b0f5-d81712a960bb None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:21.523655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d0535c03-4296-4bbf-b0f5-d81712a960bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:21.579438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51d3c5-de1f-4397-9504-4ba3853f01c9 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:21.599153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 311/622] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:21.600245 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0535c03-4296-4bbf-b0f5-d81712a960bb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:21.627683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:21.636985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66aaf1-b1bc-4567-9a48-a33917459d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:21.638017 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66aaf1-b1bc-4567-9a48-a33917459d03 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:21.638502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66aaf1-b1bc-4567-9a48-a33917459d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:21.638973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66aaf1-b1bc-4567-9a48-a33917459d03 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:21.639823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66aaf1-b1bc-4567-9a48-a33917459d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:21.640387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66aaf1-b1bc-4567-9a48-a33917459d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:21.642109 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66aaf1-b1bc-4567-9a48-a33917459d03 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:21.656627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:21.656807 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 312/623] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:21.657861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66aaf1-b1bc-4567-9a48-a33917459d03 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:21.733543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0535c03-4296-4bbf-b0f5-d81712a960bb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:21.775363 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b232ff-4e21-4255-af30-ea6f3d65f333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:21.776422 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b232ff-4e21-4255-af30-ea6f3d65f333 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:21.776910 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b232ff-4e21-4255-af30-ea6f3d65f333 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:21.777471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b232ff-4e21-4255-af30-ea6f3d65f333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:21.789478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b232ff-4e21-4255-af30-ea6f3d65f333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:21.789738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66aaf1-b1bc-4567-9a48-a33917459d03 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:21.791501 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b232ff-4e21-4255-af30-ea6f3d65f333 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-15b232ff-4e21-4255-af30-ea6f3d65f333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:21.812605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:21.813706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:21.814614 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:21.814614 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:21.814614 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:21.817246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 312/624] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:21.818383 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b232ff-4e21-4255-af30-ea6f3d65f333 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:21.838473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28af73-532c-4d05-8170-df2e6808124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:21.839370 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28af73-532c-4d05-8170-df2e6808124e None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:21.840241 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28af73-532c-4d05-8170-df2e6808124e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:21.840610 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28af73-532c-4d05-8170-df2e6808124e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:21.855642 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28af73-532c-4d05-8170-df2e6808124e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-6e28af73-532c-4d05-8170-df2e6808124e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:21.861698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:21.862822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:21.863912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:21.863912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:21.863912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:21.863912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:21.863912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:21.863912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:21.863912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:21.863912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:21.863912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:21.863912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:21.863912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:21.863912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:21.867363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 313/625] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:21.867363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28af73-532c-4d05-8170-df2e6808124e None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:21.939054 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:21.957061 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:21.965366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b232ff-4e21-4255-af30-ea6f3d65f333 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:22.028348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bf1ca-8ac3-483e-af42-750fe2b4c5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:22.030782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bf1ca-8ac3-483e-af42-750fe2b4c5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:22.031163 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bf1ca-8ac3-483e-af42-750fe2b4c5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:22.031536 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bf1ca-8ac3-483e-af42-750fe2b4c5e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:22.031868 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28af73-532c-4d05-8170-df2e6808124e None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:22.044905 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bf1ca-8ac3-483e-af42-750fe2b4c5e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:22.047421 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bf1ca-8ac3-483e-af42-750fe2b4c5e3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:22.066151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-294bf1ca-8ac3-483e-af42-750fe2b4c5e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:22.066151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:22.066151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:22.066151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:22.066151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:22.066151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:22.066151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:22.066151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:22.066151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:22.066151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:22.066151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:22.066151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:22.066151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:22.066151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:22.066151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:22.067339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:22.068447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:22.068447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:22.068447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:22.068447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:22.068447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:22.068447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:22.068447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:22.068447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:22.082169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 313/626] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:22.083123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bf1ca-8ac3-483e-af42-750fe2b4c5e3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:22.111162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c69bcd-387c-4aa3-ab40-36a3e2706d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:22.111990 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c69bcd-387c-4aa3-ab40-36a3e2706d32 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:22.112353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c69bcd-387c-4aa3-ab40-36a3e2706d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:22.112724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c69bcd-387c-4aa3-ab40-36a3e2706d32 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:22.113464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c69bcd-387c-4aa3-ab40-36a3e2706d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:22.113880 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c69bcd-387c-4aa3-ab40-36a3e2706d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:22.115359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c69bcd-387c-4aa3-ab40-36a3e2706d32 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:22.145420 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 314/627] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:22.147557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c69bcd-387c-4aa3-ab40-36a3e2706d32 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:22.319229 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bf1ca-8ac3-483e-af42-750fe2b4c5e3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:22.329105 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c69bcd-387c-4aa3-ab40-36a3e2706d32 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:22.350063 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:22.390544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41abee-0141-4adb-b5d4-622eab5dbb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:22.391359 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41abee-0141-4adb-b5d4-622eab5dbb2e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:22.391702 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41abee-0141-4adb-b5d4-622eab5dbb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:22.392084 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41abee-0141-4adb-b5d4-622eab5dbb2e None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:22.392844 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41abee-0141-4adb-b5d4-622eab5dbb2e None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:22.393243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41abee-0141-4adb-b5d4-622eab5dbb2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:22.394481 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d2a51-581c-4133-8880-b5d01c1e1ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:22.395627 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d2a51-581c-4133-8880-b5d01c1e1ccd None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:22.396239 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d2a51-581c-4133-8880-b5d01c1e1ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:22.396675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d2a51-581c-4133-8880-b5d01c1e1ccd None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:22.397594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d2a51-581c-4133-8880-b5d01c1e1ccd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:22.399038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41abee-0141-4adb-b5d4-622eab5dbb2e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:22.399911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d2a51-581c-4133-8880-b5d01c1e1ccd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:22.403303 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d2a51-581c-4133-8880-b5d01c1e1ccd None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:22.412804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 314/628] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:22.413924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41abee-0141-4adb-b5d4-622eab5dbb2e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:22.440044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 315/629] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:22.441244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d2a51-581c-4133-8880-b5d01c1e1ccd None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:22.459392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:22.559286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41abee-0141-4adb-b5d4-622eab5dbb2e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:22.569750 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d2a51-581c-4133-8880-b5d01c1e1ccd None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:22.602668 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929608ea-46fb-4555-a5c4-2dcefb0c68ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:22.603487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929608ea-46fb-4555-a5c4-2dcefb0c68ee None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:22.603861 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929608ea-46fb-4555-a5c4-2dcefb0c68ee None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:22.604231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929608ea-46fb-4555-a5c4-2dcefb0c68ee None admin] PATH_INFO: `/v3/users/glance` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:22.606875 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36a507-67b0-4835-95f4-28b1ad7cf745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:22.607718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36a507-67b0-4835-95f4-28b1ad7cf745 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:22.608127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36a507-67b0-4835-95f4-28b1ad7cf745 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:22.608545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36a507-67b0-4835-95f4-28b1ad7cf745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:22.613728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929608ea-46fb-4555-a5c4-2dcefb0c68ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:22.615305 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929608ea-46fb-4555-a5c4-2dcefb0c68ee None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:22.620563 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36a507-67b0-4835-95f4-28b1ad7cf745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:22.622283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36a507-67b0-4835-95f4-28b1ad7cf745 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-929608ea-46fb-4555-a5c4-2dcefb0c68ee None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:22.629554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:22.630819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:22.632032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:22.632032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:22.632032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:22.632032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:22.632032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:22.632032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:22.632032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:22.632032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:22.632032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 11:06:22.632032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:22.633977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 315/630] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:06:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:22.636241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929608ea-46fb-4555-a5c4-2dcefb0c68ee None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-ee36a507-67b0-4835-95f4-28b1ad7cf745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:22.647959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:22.649285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:22.650452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:22.650452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:22.650452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:22.652299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 316/631] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:22.653277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36a507-67b0-4835-95f4-28b1ad7cf745 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:22.681357 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:22.739584 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:22.760093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36a507-67b0-4835-95f4-28b1ad7cf745 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:22.763535 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929608ea-46fb-4555-a5c4-2dcefb0c68ee None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:22.794518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102f130-b0a8-4634-b560-014d45674085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:22.795119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f130-b0a8-4634-b560-014d45674085 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:22.795394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f130-b0a8-4634-b560-014d45674085 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:22.795643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f130-b0a8-4634-b560-014d45674085 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:22.796365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102f130-b0a8-4634-b560-014d45674085 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:22.796658 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102f130-b0a8-4634-b560-014d45674085 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:22.798143 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102f130-b0a8-4634-b560-014d45674085 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:22.801453 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3768c0-b2ca-40ad-8a81-7fbcc124b659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:22.801602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3768c0-b2ca-40ad-8a81-7fbcc124b659 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:22.801869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3768c0-b2ca-40ad-8a81-7fbcc124b659 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:22.802089 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3768c0-b2ca-40ad-8a81-7fbcc124b659 None admin] PATH_INFO: `/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/557b8757098e4777965d782d1ce5f97b/roles/bcdb152b51e34826a39fc0f8c3d60664` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:22.817138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 317/632] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Aug 9 11:06:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:22.817470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3768c0-b2ca-40ad-8a81-7fbcc124b659 None admin] RBAC: Authorizing `identity:create_grant(project_id=166e5328bfae434ba19d12be2eaa7a1b, user_id=557b8757098e4777965d782d1ce5f97b, role_id=bcdb152b51e34826a39fc0f8c3d60664)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:22.818960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3768c0-b2ca-40ad-8a81-7fbcc124b659 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:22.822386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102f130-b0a8-4634-b560-014d45674085 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:22.841862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 316/633] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:06:22 2022] PUT /identity/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/557b8757098e4777965d782d1ce5f97b/roles/bcdb152b51e34826a39fc0f8c3d60664 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:06:22.843849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6a0d0-86b0-43c5-9021-83a634a25273 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:22.844214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6a0d0-86b0-43c5-9021-83a634a25273 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:22.844566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6a0d0-86b0-43c5-9021-83a634a25273 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:22.851046 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 317/634] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:22.851046 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6a0d0-86b0-43c5-9021-83a634a25273 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:22.934036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:22.957527 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102f130-b0a8-4634-b560-014d45674085 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:23.000037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6a0d0-86b0-43c5-9021-83a634a25273 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:23.009863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd33304-8a13-4eb6-9197-201c6d35001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:23.010741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd33304-8a13-4eb6-9197-201c6d35001f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:23.011181 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd33304-8a13-4eb6-9197-201c6d35001f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:23.011590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd33304-8a13-4eb6-9197-201c6d35001f None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:23.012457 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd33304-8a13-4eb6-9197-201c6d35001f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:23.012910 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd33304-8a13-4eb6-9197-201c6d35001f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:23.015204 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd33304-8a13-4eb6-9197-201c6d35001f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:23.029879 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 318/635] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:23.031275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8ee9-34c1-4ae2-8941-b3e20f3b108f None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:23.031605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8ee9-34c1-4ae2-8941-b3e20f3b108f None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:23.031941 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a8ee9-34c1-4ae2-8941-b3e20f3b108f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:23.036007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:23.049020 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee11cb8-6247-4a1b-8edc-562cdbf8fef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:23.049668 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee11cb8-6247-4a1b-8edc-562cdbf8fef1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:23.049952 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee11cb8-6247-4a1b-8edc-562cdbf8fef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:23.050222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee11cb8-6247-4a1b-8edc-562cdbf8fef1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:23.056661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-aa3a8ee9-34c1-4ae2-8941-b3e20f3b108f None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:23.058176 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-aa3a8ee9-34c1-4ae2-8941-b3e20f3b108f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:23.123235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee11cb8-6247-4a1b-8edc-562cdbf8fef1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:23.124713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee11cb8-6247-4a1b-8edc-562cdbf8fef1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:23.149475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 319/636] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:23.150480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a8ee9-34c1-4ae2-8941-b3e20f3b108f None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:23.234438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:23.249175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 318/637] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:06:23.254711 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee11cb8-6247-4a1b-8edc-562cdbf8fef1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:23.266940 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a8ee9-34c1-4ae2-8941-b3e20f3b108f None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:23.283928 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:23.306450 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af330b79-a93c-492e-a63f-a0d6ef66b871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:23.307069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af330b79-a93c-492e-a63f-a0d6ef66b871 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:23.307335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af330b79-a93c-492e-a63f-a0d6ef66b871 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:23.307594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af330b79-a93c-492e-a63f-a0d6ef66b871 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:23.314728 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af330b79-a93c-492e-a63f-a0d6ef66b871 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:23.316187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af330b79-a93c-492e-a63f-a0d6ef66b871 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-af330b79-a93c-492e-a63f-a0d6ef66b871 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:23.327643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:23.328859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:23.330150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:23.330150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:23.330150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:23.330150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:23.330150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:23.330150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:23.330150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:23.330150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:23.330150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:06:23.330150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:23.333933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 320/638] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:06:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:23.335212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011a24a-0b88-4aa5-88b4-e9e19496cb77 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:23.335487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011a24a-0b88-4aa5-88b4-e9e19496cb77 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:23.335753 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011a24a-0b88-4aa5-88b4-e9e19496cb77 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:23.337132 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 321/639] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:23.341834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011a24a-0b88-4aa5-88b4-e9e19496cb77 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:23.366253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee11cb8-6247-4a1b-8edc-562cdbf8fef1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:23.402153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247bfe7-a8d6-4fc4-ad68-0abeb911a21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:23.403161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247bfe7-a8d6-4fc4-ad68-0abeb911a21c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:23.403451 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247bfe7-a8d6-4fc4-ad68-0abeb911a21c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:23.403724 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247bfe7-a8d6-4fc4-ad68-0abeb911a21c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:23.414246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247bfe7-a8d6-4fc4-ad68-0abeb911a21c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-a247bfe7-a8d6-4fc4-ad68-0abeb911a21c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:23.418957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:23.419940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:23.420822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:23.420822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:23.420822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:23.420822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:23.420822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:23.420822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:23.420822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:23.420822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:23.420822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:23.420822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:23.420822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:23.420822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:23.420822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 319/640] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:23.421571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247bfe7-a8d6-4fc4-ad68-0abeb911a21c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:23.458563 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011a24a-0b88-4aa5-88b4-e9e19496cb77 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:23.495604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:23.501193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ca174-80ac-44c6-9812-5f9d2c6c2c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:23.501959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ca174-80ac-44c6-9812-5f9d2c6c2c91 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:23.502242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ca174-80ac-44c6-9812-5f9d2c6c2c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:23.502513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ca174-80ac-44c6-9812-5f9d2c6c2c91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:23.513963 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ca174-80ac-44c6-9812-5f9d2c6c2c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:23.515432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ca174-80ac-44c6-9812-5f9d2c6c2c91 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:23.524843 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-6e8ca174-80ac-44c6-9812-5f9d2c6c2c91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:23.530314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:23.531366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:23.532280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:23.532280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:23.532280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:23.532280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 322/641] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:23.534165 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d1454-5bde-4670-be6c-d89c428791d1 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:23.534165 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d1454-5bde-4670-be6c-d89c428791d1 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:23.534165 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d1454-5bde-4670-be6c-d89c428791d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:23.545229 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247bfe7-a8d6-4fc4-ad68-0abeb911a21c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:23.551111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-0b8d1454-5bde-4670-be6c-d89c428791d1 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:23.552293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0b8d1454-5bde-4670-be6c-d89c428791d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:23.580326 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feea97a-143b-4da2-8b7d-568181f8a4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:23.580936 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feea97a-143b-4da2-8b7d-568181f8a4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:23.581208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feea97a-143b-4da2-8b7d-568181f8a4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:23.581473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feea97a-143b-4da2-8b7d-568181f8a4f9 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:23.582230 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feea97a-143b-4da2-8b7d-568181f8a4f9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:23.582529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feea97a-143b-4da2-8b7d-568181f8a4f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:23.583964 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feea97a-143b-4da2-8b7d-568181f8a4f9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:23.606257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 320/642] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Aug 9 11:06:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:23.606257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feea97a-143b-4da2-8b7d-568181f8a4f9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:23.633664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 323/643] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:23.633664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d1454-5bde-4670-be6c-d89c428791d1 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:23.716910 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feea97a-143b-4da2-8b7d-568181f8a4f9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:23.749325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d1454-5bde-4670-be6c-d89c428791d1 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:23.755501 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22236a56-d8e7-4d6d-a3fd-b5e37d07403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:23.756116 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22236a56-d8e7-4d6d-a3fd-b5e37d07403c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:23.756388 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22236a56-d8e7-4d6d-a3fd-b5e37d07403c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:23.756656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22236a56-d8e7-4d6d-a3fd-b5e37d07403c None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:23.757322 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22236a56-d8e7-4d6d-a3fd-b5e37d07403c None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:23.757647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22236a56-d8e7-4d6d-a3fd-b5e37d07403c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:23.759101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22236a56-d8e7-4d6d-a3fd-b5e37d07403c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:23.766254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:23.772523 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 321/644] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:23.772523 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22236a56-d8e7-4d6d-a3fd-b5e37d07403c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:23.782774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:23.796153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69206a-f590-46fc-9897-104ed214a878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:23.797609 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69206a-f590-46fc-9897-104ed214a878 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:23.798109 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69206a-f590-46fc-9897-104ed214a878 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:23.798695 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69206a-f590-46fc-9897-104ed214a878 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:23.799811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69206a-f590-46fc-9897-104ed214a878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:23.800529 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69206a-f590-46fc-9897-104ed214a878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:23.802546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69206a-f590-46fc-9897-104ed214a878 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:23.819603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 324/645] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:23.820310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69206a-f590-46fc-9897-104ed214a878 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:23.874970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22236a56-d8e7-4d6d-a3fd-b5e37d07403c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:23.910056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93aaaea-6fa9-40bb-8a1d-8935b58e89c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:23.910671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aaaea-6fa9-40bb-8a1d-8935b58e89c4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:23.910945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aaaea-6fa9-40bb-8a1d-8935b58e89c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:23.911210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aaaea-6fa9-40bb-8a1d-8935b58e89c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:23.928771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69206a-f590-46fc-9897-104ed214a878 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:23.965211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8810496-6ac0-4433-8f24-9d49dda384c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:23.965867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8810496-6ac0-4433-8f24-9d49dda384c9 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:23.966144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8810496-6ac0-4433-8f24-9d49dda384c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:23.966413 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8810496-6ac0-4433-8f24-9d49dda384c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:23.977040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8810496-6ac0-4433-8f24-9d49dda384c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:23.982069 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93aaaea-6fa9-40bb-8a1d-8935b58e89c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-a8810496-6ac0-4433-8f24-9d49dda384c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:23.982216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:23.983156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:23.984149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:23.984149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:23.984149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:23.984149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:23.984149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:23.984149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:23.984149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:23.984149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:23.984149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:23.984149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:23.984149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:23.984149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:23.984826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93aaaea-6fa9-40bb-8a1d-8935b58e89c4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:23.988319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 325/646] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:23.989245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8810496-6ac0-4433-8f24-9d49dda384c9 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:23.996658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:24.030362 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:24.101852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 322/647] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:06:24.103299 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93aaaea-6fa9-40bb-8a1d-8935b58e89c4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:24.108613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8810496-6ac0-4433-8f24-9d49dda384c9 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:24.144349 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3208684-84a8-4b50-9461-7353b13aba21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:24.144968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3208684-84a8-4b50-9461-7353b13aba21 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:24.145234 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3208684-84a8-4b50-9461-7353b13aba21 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:24.145492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3208684-84a8-4b50-9461-7353b13aba21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:24.156342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3208684-84a8-4b50-9461-7353b13aba21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:24.158006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3208684-84a8-4b50-9461-7353b13aba21 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-b3208684-84a8-4b50-9461-7353b13aba21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:24.172248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:24.173213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:24.174201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:24.174201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:24.174201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:24.174201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 326/648] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:24.174201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3208684-84a8-4b50-9461-7353b13aba21 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:24.206864 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93aaaea-6fa9-40bb-8a1d-8935b58e89c4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:24.218039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:24.242756 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7267b1-75b4-46b7-a58f-6de73e1e248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:24.243312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7267b1-75b4-46b7-a58f-6de73e1e248e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:24.243584 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7267b1-75b4-46b7-a58f-6de73e1e248e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:24.243855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7267b1-75b4-46b7-a58f-6de73e1e248e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:24.250515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7267b1-75b4-46b7-a58f-6de73e1e248e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:24.252032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7267b1-75b4-46b7-a58f-6de73e1e248e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:24.263380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-cd7267b1-75b4-46b7-a58f-6de73e1e248e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:24.263380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:24.263380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:24.263380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:24.263380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:24.263380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:24.263380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:24.263380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:24.263380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:24.263380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:24.263380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:24.263380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:24.263380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:24.263380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:24.263380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:24.264338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:24.265262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:24.265262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:24.265262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:24.265262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:24.265262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:24.265262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:24.265262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:24.265262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:24.265262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 323/649] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:24.265262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7267b1-75b4-46b7-a58f-6de73e1e248e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:24.272429 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:24.288823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3208684-84a8-4b50-9461-7353b13aba21 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:24.324967 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb63e01-1545-4689-b3fd-ab38e7a42ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:24.325571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb63e01-1545-4689-b3fd-ab38e7a42ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:24.325873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb63e01-1545-4689-b3fd-ab38e7a42ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:24.326144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb63e01-1545-4689-b3fd-ab38e7a42ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:24.326799 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb63e01-1545-4689-b3fd-ab38e7a42ca7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:24.327101 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb63e01-1545-4689-b3fd-ab38e7a42ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:24.328493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb63e01-1545-4689-b3fd-ab38e7a42ca7 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:24.337740 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 327/650] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:24.337740 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb63e01-1545-4689-b3fd-ab38e7a42ca7 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:24.376624 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7267b1-75b4-46b7-a58f-6de73e1e248e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:24.412905 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ef964-b366-47ff-906a-af0eab06c09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:24.413531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ef964-b366-47ff-906a-af0eab06c09e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:24.413829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ef964-b366-47ff-906a-af0eab06c09e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:24.414096 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ef964-b366-47ff-906a-af0eab06c09e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:24.424948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ef964-b366-47ff-906a-af0eab06c09e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:24.426523 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ef964-b366-47ff-906a-af0eab06c09e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-d04ef964-b366-47ff-906a-af0eab06c09e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:24.442759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:24.449285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:24.450215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:24.450215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:24.450215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:24.450215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 324/651] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:24.450215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ef964-b366-47ff-906a-af0eab06c09e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:24.450514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb63e01-1545-4689-b3fd-ab38e7a42ca7 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:24.473416 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:24.489994 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e38c58-167b-482e-9df7-26622ee58140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:24.490711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38c58-167b-482e-9df7-26622ee58140 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:24.491782 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38c58-167b-482e-9df7-26622ee58140 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:24.491782 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38c58-167b-482e-9df7-26622ee58140 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:24.492052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e38c58-167b-482e-9df7-26622ee58140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:24.492289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e38c58-167b-482e-9df7-26622ee58140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:24.493747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e38c58-167b-482e-9df7-26622ee58140 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:24.507826 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 328/652] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:24.509061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e38c58-167b-482e-9df7-26622ee58140 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:24.520656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:24.563037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ef964-b366-47ff-906a-af0eab06c09e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:24.597863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1a8a9-8815-43fb-b79e-b137ed6c1f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:24.598452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1a8a9-8815-43fb-b79e-b137ed6c1f23 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:24.598726 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1a8a9-8815-43fb-b79e-b137ed6c1f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:24.598993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1a8a9-8815-43fb-b79e-b137ed6c1f23 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:24.599677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1a8a9-8815-43fb-b79e-b137ed6c1f23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:24.599980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1a8a9-8815-43fb-b79e-b137ed6c1f23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:24.601407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1a8a9-8815-43fb-b79e-b137ed6c1f23 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:24.613557 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 325/653] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:24.614394 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1a8a9-8815-43fb-b79e-b137ed6c1f23 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:24.623205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e38c58-167b-482e-9df7-26622ee58140 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:24.659417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98210b3-14b7-4b11-90e7-7dfaa6a844fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:24.660074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98210b3-14b7-4b11-90e7-7dfaa6a844fa None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:24.660349 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98210b3-14b7-4b11-90e7-7dfaa6a844fa None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:24.660617 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98210b3-14b7-4b11-90e7-7dfaa6a844fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:24.672819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98210b3-14b7-4b11-90e7-7dfaa6a844fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:24.674333 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98210b3-14b7-4b11-90e7-7dfaa6a844fa None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-a98210b3-14b7-4b11-90e7-7dfaa6a844fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:24.689243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:24.690338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:24.691394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:24.691394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:24.691394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:24.695286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 329/654] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:24.696052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98210b3-14b7-4b11-90e7-7dfaa6a844fa None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:24.707483 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:24.729220 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1a8a9-8815-43fb-b79e-b137ed6c1f23 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:24.757897 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:24.768859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb6397-90e2-4747-a3fa-081312fc931d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:24.769474 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb6397-90e2-4747-a3fa-081312fc931d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:24.769793 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb6397-90e2-4747-a3fa-081312fc931d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:24.770062 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb6397-90e2-4747-a3fa-081312fc931d None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:24.770704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb6397-90e2-4747-a3fa-081312fc931d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:24.771007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb6397-90e2-4747-a3fa-081312fc931d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:24.772382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb6397-90e2-4747-a3fa-081312fc931d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:24.784672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 326/655] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:24.785695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb6397-90e2-4747-a3fa-081312fc931d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:24.808762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98210b3-14b7-4b11-90e7-7dfaa6a844fa None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:24.844993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb603cf-1083-4442-bdb9-9fd3016b4847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:24.845929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb603cf-1083-4442-bdb9-9fd3016b4847 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:24.846369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb603cf-1083-4442-bdb9-9fd3016b4847 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:24.846768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb603cf-1083-4442-bdb9-9fd3016b4847 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:24.854793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb603cf-1083-4442-bdb9-9fd3016b4847 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:24.856270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb603cf-1083-4442-bdb9-9fd3016b4847 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-9fb603cf-1083-4442-bdb9-9fd3016b4847 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:24.867811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:24.868830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:24.869818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:24.869818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:24.869818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:24.869818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:24.869818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:24.869818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:24.869818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:24.869818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:24.869818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:06:24.869818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:24.869818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 330/656] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Aug 9 11:06:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:24.869818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb603cf-1083-4442-bdb9-9fd3016b4847 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:24.895758 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb6397-90e2-4747-a3fa-081312fc931d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:24.929799 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc14f2-bbb7-4b94-887d-630b9ff19304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:24.930402 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc14f2-bbb7-4b94-887d-630b9ff19304 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:24.930671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc14f2-bbb7-4b94-887d-630b9ff19304 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:24.930930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc14f2-bbb7-4b94-887d-630b9ff19304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:24.931666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc14f2-bbb7-4b94-887d-630b9ff19304 None admin] RBAC: Adding query filter params (role.id=bcdb152b51e34826a39fc0f8c3d60664, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=5356835ef79c458bbfa7d6adafd0cb36) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:24.931964 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc14f2-bbb7-4b94-887d-630b9ff19304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:24.933385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc14f2-bbb7-4b94-887d-630b9ff19304 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:24.939148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 327/657] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:24 2022] GET /identity/v3/role_assignments?user.id=5356835ef79c458bbfa7d6adafd0cb36&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=bcdb152b51e34826a39fc0f8c3d60664 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:24.939906 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc14f2-bbb7-4b94-887d-630b9ff19304 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:24.949772 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:24.972918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb603cf-1083-4442-bdb9-9fd3016b4847 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:24.996274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:25.013974 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae061bef-ce39-4faa-a373-9fc926379683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:25.014903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae061bef-ce39-4faa-a373-9fc926379683 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:25.015358 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae061bef-ce39-4faa-a373-9fc926379683 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:25.015798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae061bef-ce39-4faa-a373-9fc926379683 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:25.016666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae061bef-ce39-4faa-a373-9fc926379683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:25.017131 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae061bef-ce39-4faa-a373-9fc926379683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:25.018599 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae061bef-ce39-4faa-a373-9fc926379683 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:25.032351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 331/658] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:25.033224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae061bef-ce39-4faa-a373-9fc926379683 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:25.057640 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc14f2-bbb7-4b94-887d-630b9ff19304 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:25.095171 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acdfe2-691f-40aa-8a45-1855a9e46e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:25.095937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acdfe2-691f-40aa-8a45-1855a9e46e07 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:25.096061 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acdfe2-691f-40aa-8a45-1855a9e46e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:25.096331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acdfe2-691f-40aa-8a45-1855a9e46e07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:25.105270 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acdfe2-691f-40aa-8a45-1855a9e46e07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:25.106778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acdfe2-691f-40aa-8a45-1855a9e46e07 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:25.120044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-d4acdfe2-691f-40aa-8a45-1855a9e46e07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:25.120044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:25.120044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:25.120044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:25.120044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:25.120044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:25.120044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:25.120044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:25.120044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:25.120044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:25.120044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:25.120044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:25.120044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:25.120044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:25.120044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:25.121117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:25.122054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:25.122054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:25.122054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:25.122054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:25.122054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:25.122054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:25.122054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:25.122054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:25.122054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 328/659] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:25.123505 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af1fca-2720-4f73-b761-69185f84ebeb None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:25.123650 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af1fca-2720-4f73-b761-69185f84ebeb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:25.123925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af1fca-2720-4f73-b761-69185f84ebeb None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:25.130151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 329/660] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:25.130647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af1fca-2720-4f73-b761-69185f84ebeb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:25.146750 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae061bef-ce39-4faa-a373-9fc926379683 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:25.189968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a23784-156d-41eb-8bd6-7012f2f16acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:25.191310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a23784-156d-41eb-8bd6-7012f2f16acd None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:25.191590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a23784-156d-41eb-8bd6-7012f2f16acd None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:25.191860 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a23784-156d-41eb-8bd6-7012f2f16acd None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:25.193043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a23784-156d-41eb-8bd6-7012f2f16acd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:25.193359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a23784-156d-41eb-8bd6-7012f2f16acd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:25.194884 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a23784-156d-41eb-8bd6-7012f2f16acd None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:25.205612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:25.213921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 332/661] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Aug 9 11:06:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:25.214604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a23784-156d-41eb-8bd6-7012f2f16acd None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:25.247508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af1fca-2720-4f73-b761-69185f84ebeb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:25.258018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:25.281239 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b642976-99d2-4c72-9a6c-520514206cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:25.281816 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b642976-99d2-4c72-9a6c-520514206cff None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:25.282092 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b642976-99d2-4c72-9a6c-520514206cff None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:25.282356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b642976-99d2-4c72-9a6c-520514206cff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:25.290073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b642976-99d2-4c72-9a6c-520514206cff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:25.291507 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b642976-99d2-4c72-9a6c-520514206cff None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-8b642976-99d2-4c72-9a6c-520514206cff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:25.302528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:25.303516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:25.304541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:25.304541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:25.304541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:25.304541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:25.304541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:25.304541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:25.304541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:25.304541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:25.304541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 11:06:25.304541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:25.304541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 330/662] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:25.305223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba2f4a-83ea-406d-b290-9a878badca8e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:25.305223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba2f4a-83ea-406d-b290-9a878badca8e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:25.305729 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba2f4a-83ea-406d-b290-9a878badca8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:25.323071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5bba2f4a-83ea-406d-b290-9a878badca8e None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:25.324275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5bba2f4a-83ea-406d-b290-9a878badca8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:25.328720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a23784-156d-41eb-8bd6-7012f2f16acd None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:25.365046 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340b483-539c-448c-991b-c46a58521f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:25.365674 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b483-539c-448c-991b-c46a58521f3c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:25.365952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b483-539c-448c-991b-c46a58521f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:25.366217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9340b483-539c-448c-991b-c46a58521f3c None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:25.366915 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340b483-539c-448c-991b-c46a58521f3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:25.367214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340b483-539c-448c-991b-c46a58521f3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:25.368739 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9340b483-539c-448c-991b-c46a58521f3c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:25.380905 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 333/663] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:25.381740 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340b483-539c-448c-991b-c46a58521f3c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:25.399714 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 331/664] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:25.401390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba2f4a-83ea-406d-b290-9a878badca8e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:25.468738 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:25.486480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:25.490356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9340b483-539c-448c-991b-c46a58521f3c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:25.522123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba2f4a-83ea-406d-b290-9a878badca8e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:25.525750 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6a1c3-f910-4ce3-8c05-b7ad872c142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:25.526441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6a1c3-f910-4ce3-8c05-b7ad872c142f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:25.526708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6a1c3-f910-4ce3-8c05-b7ad872c142f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:25.526974 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6a1c3-f910-4ce3-8c05-b7ad872c142f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:25.561023 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4b768-04fa-48eb-8e6f-db6a3e0897e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:25.561653 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4b768-04fa-48eb-8e6f-db6a3e0897e2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:25.561928 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4b768-04fa-48eb-8e6f-db6a3e0897e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:25.562193 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4b768-04fa-48eb-8e6f-db6a3e0897e2 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:25.562912 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4b768-04fa-48eb-8e6f-db6a3e0897e2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:25.563211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4b768-04fa-48eb-8e6f-db6a3e0897e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:25.564636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4b768-04fa-48eb-8e6f-db6a3e0897e2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:25.583742 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 332/665] 10.222.0.15 () {56 vars in 1139 bytes} [Tue Aug 9 11:06:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:25.584577 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4b768-04fa-48eb-8e6f-db6a3e0897e2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:25.606011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6a1c3-f910-4ce3-8c05-b7ad872c142f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:25.608144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6a1c3-f910-4ce3-8c05-b7ad872c142f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:25.690115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4b768-04fa-48eb-8e6f-db6a3e0897e2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:25.705165 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:25.708906 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:25.714767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 334/666] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:06:25.715619 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6a1c3-f910-4ce3-8c05-b7ad872c142f None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:25.733213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827fda4-d707-41a3-9711-df4ad852ae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:25.733853 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827fda4-d707-41a3-9711-df4ad852ae56 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:25.734127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827fda4-d707-41a3-9711-df4ad852ae56 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:25.734396 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827fda4-d707-41a3-9711-df4ad852ae56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:25.735104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827fda4-d707-41a3-9711-df4ad852ae56 None admin] RBAC: Adding query filter params (role.id=bcdb152b51e34826a39fc0f8c3d60664, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=097822b9d7954dd0b27e9f650b6e36f9) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:25.735573 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827fda4-d707-41a3-9711-df4ad852ae56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:25.736814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827fda4-d707-41a3-9711-df4ad852ae56 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:25.742687 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 333/667] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:25 2022] GET /identity/v3/role_assignments?user.id=097822b9d7954dd0b27e9f650b6e36f9&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=bcdb152b51e34826a39fc0f8c3d60664 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:25.750043 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827fda4-d707-41a3-9711-df4ad852ae56 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:25.865402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6a1c3-f910-4ce3-8c05-b7ad872c142f None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:25.882897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827fda4-d707-41a3-9711-df4ad852ae56 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:25.909023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a54d9-24fa-466c-8c92-58e9de0ad282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:25.911005 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a54d9-24fa-466c-8c92-58e9de0ad282 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:25.911005 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a54d9-24fa-466c-8c92-58e9de0ad282 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:25.911005 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a54d9-24fa-466c-8c92-58e9de0ad282 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:25.924008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a54d9-24fa-466c-8c92-58e9de0ad282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:25.926731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6e827-2340-49a0-978d-88352318ca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:25.927336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6e827-2340-49a0-978d-88352318ca19 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:25.927611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6e827-2340-49a0-978d-88352318ca19 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:25.927877 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6e827-2340-49a0-978d-88352318ca19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-6c6a54d9-24fa-466c-8c92-58e9de0ad282 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:25.928933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:25.929969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:25.930823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:25.930823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:25.930823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:25.930823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:25.930823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:25.930823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:25.930823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:25.930823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:25.930823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:25.930823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:25.930823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:25.930823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:25.931480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 335/668] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:25.932024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a54d9-24fa-466c-8c92-58e9de0ad282 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:25.991435 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:26.008958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:26.026754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6e827-2340-49a0-978d-88352318ca19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:26.028223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6e827-2340-49a0-978d-88352318ca19 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:26.060142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a54d9-24fa-466c-8c92-58e9de0ad282 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:26.097262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cbb1f-2f46-4ea5-ab10-77ae0797488c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:26.098008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cbb1f-2f46-4ea5-ab10-77ae0797488c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:26.098284 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cbb1f-2f46-4ea5-ab10-77ae0797488c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:26.098635 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cbb1f-2f46-4ea5-ab10-77ae0797488c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:26.109502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cbb1f-2f46-4ea5-ab10-77ae0797488c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:26.111188 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cbb1f-2f46-4ea5-ab10-77ae0797488c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-ac1cbb1f-2f46-4ea5-ab10-77ae0797488c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:26.127295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:26.128307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:26.129556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:26.129556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:26.129556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:26.133556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 336/670] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:26.134654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cbb1f-2f46-4ea5-ab10-77ae0797488c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:26.136027 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 334/670] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:06:26.137141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6e827-2340-49a0-978d-88352318ca19 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:26.243499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:26.244912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cbb1f-2f46-4ea5-ab10-77ae0797488c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:26.257628 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:26.273680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6e827-2340-49a0-978d-88352318ca19 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:26.283562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7923df-05e1-44f4-b476-e82c13518246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:26.284175 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7923df-05e1-44f4-b476-e82c13518246 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:26.284445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7923df-05e1-44f4-b476-e82c13518246 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:26.284711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7923df-05e1-44f4-b476-e82c13518246 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:26.285638 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7923df-05e1-44f4-b476-e82c13518246 None admin] RBAC: Adding query filter params (name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:26.285951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7923df-05e1-44f4-b476-e82c13518246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:26.287348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7923df-05e1-44f4-b476-e82c13518246 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:26.301302 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 337/671] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:26.302345 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7923df-05e1-44f4-b476-e82c13518246 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:26.316717 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eddbd3-9a22-4013-a10b-62acfe35a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:26.317333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eddbd3-9a22-4013-a10b-62acfe35a57a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:26.317607 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eddbd3-9a22-4013-a10b-62acfe35a57a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:26.317945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eddbd3-9a22-4013-a10b-62acfe35a57a None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:26.318592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eddbd3-9a22-4013-a10b-62acfe35a57a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:26.318892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eddbd3-9a22-4013-a10b-62acfe35a57a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:26.320260 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eddbd3-9a22-4013-a10b-62acfe35a57a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:26.332304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 335/672] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:26.333274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eddbd3-9a22-4013-a10b-62acfe35a57a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:26.427683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7923df-05e1-44f4-b476-e82c13518246 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:26.459268 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eddbd3-9a22-4013-a10b-62acfe35a57a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:26.476077 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67559296-aa1f-4c1b-9b39-e3fb94bfb685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:26.478993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67559296-aa1f-4c1b-9b39-e3fb94bfb685 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:26.479273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67559296-aa1f-4c1b-9b39-e3fb94bfb685 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:26.479543 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67559296-aa1f-4c1b-9b39-e3fb94bfb685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:26.492156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67559296-aa1f-4c1b-9b39-e3fb94bfb685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:26.493957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67559296-aa1f-4c1b-9b39-e3fb94bfb685 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:26.504976 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e418420-0c94-4629-a763-cf9cfb869c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:26.505892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e418420-0c94-4629-a763-cf9cfb869c2c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:26.506328 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e418420-0c94-4629-a763-cf9cfb869c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:26.506741 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e418420-0c94-4629-a763-cf9cfb869c2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-67559296-aa1f-4c1b-9b39-e3fb94bfb685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:26.509976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:26.511202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:26.512360 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:26.512360 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:26.512360 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:26.515776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 338/673] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:26.516638 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67559296-aa1f-4c1b-9b39-e3fb94bfb685 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:26.518596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:26.522746 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e418420-0c94-4629-a763-cf9cfb869c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:26.524453 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e418420-0c94-4629-a763-cf9cfb869c2c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-4e418420-0c94-4629-a763-cf9cfb869c2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:26.540267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:26.541476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:26.542461 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:26.542461 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:26.542461 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:26.546324 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 336/674] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:26.547259 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e418420-0c94-4629-a763-cf9cfb869c2c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:26.549272 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:26.632070 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67559296-aa1f-4c1b-9b39-e3fb94bfb685 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:26.665610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e418420-0c94-4629-a763-cf9cfb869c2c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:26.668991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf883b3-8c56-458d-9af3-1028eebf61e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:26.669970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf883b3-8c56-458d-9af3-1028eebf61e8 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:26.670414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf883b3-8c56-458d-9af3-1028eebf61e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:26.670822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf883b3-8c56-458d-9af3-1028eebf61e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:26.678441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf883b3-8c56-458d-9af3-1028eebf61e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:26.680436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf883b3-8c56-458d-9af3-1028eebf61e8 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:26.692980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-fcf883b3-8c56-458d-9af3-1028eebf61e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:26.692980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:26.692980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:26.692980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:26.692980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:26.692980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:26.692980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:26.692980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:26.692980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:26.692980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:26.692980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:26.692980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:26.692980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:26.692980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:26.692980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:26.694162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:26.695184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:26.695184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:26.695184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:26.695184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:26.695184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:26.695184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:26.695184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:26.695184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:26.701700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d493ee-4afe-4271-a16b-800da367efe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:26.701700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d493ee-4afe-4271-a16b-800da367efe8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:26.701700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d493ee-4afe-4271-a16b-800da367efe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:26.701700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d493ee-4afe-4271-a16b-800da367efe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:26.702159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 339/675] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:26.702266 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d493ee-4afe-4271-a16b-800da367efe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:26.702467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d493ee-4afe-4271-a16b-800da367efe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:26.703445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf883b3-8c56-458d-9af3-1028eebf61e8 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:26.703862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d493ee-4afe-4271-a16b-800da367efe8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:26.722331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 337/676] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:26.722331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d493ee-4afe-4271-a16b-800da367efe8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:26.774110 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:26.810607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:26.828277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d493ee-4afe-4271-a16b-800da367efe8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:26.829909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf883b3-8c56-458d-9af3-1028eebf61e8 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:26.864208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44d7ef-e7a2-4ec8-b21f-2e6f94f02c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:26.864821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44d7ef-e7a2-4ec8-b21f-2e6f94f02c80 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:26.865098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44d7ef-e7a2-4ec8-b21f-2e6f94f02c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:26.865368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44d7ef-e7a2-4ec8-b21f-2e6f94f02c80 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:26.866091 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44d7ef-e7a2-4ec8-b21f-2e6f94f02c80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:26.866395 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44d7ef-e7a2-4ec8-b21f-2e6f94f02c80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:26.868089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974281-4776-4ece-a78f-6391eb8d3a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:26.868238 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44d7ef-e7a2-4ec8-b21f-2e6f94f02c80 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:26.868969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974281-4776-4ece-a78f-6391eb8d3a74 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:26.869382 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974281-4776-4ece-a78f-6391eb8d3a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:26.869913 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974281-4776-4ece-a78f-6391eb8d3a74 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:26.870886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974281-4776-4ece-a78f-6391eb8d3a74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:26.871326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974281-4776-4ece-a78f-6391eb8d3a74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:26.872833 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974281-4776-4ece-a78f-6391eb8d3a74 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:26.889655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 338/678] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:26.889655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44d7ef-e7a2-4ec8-b21f-2e6f94f02c80 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:26.890137 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 340/678] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:26.891196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974281-4776-4ece-a78f-6391eb8d3a74 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:27.002963 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974281-4776-4ece-a78f-6391eb8d3a74 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:27.005403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44d7ef-e7a2-4ec8-b21f-2e6f94f02c80 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:27.016794 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:27.042081 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f3d8b-802e-4c58-9713-dc7424b1bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:27.042349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d578e22-780f-4c5f-b264-83c87fa6f17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:27.042847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d578e22-780f-4c5f-b264-83c87fa6f17a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:27.043125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d578e22-780f-4c5f-b264-83c87fa6f17a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:27.043400 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d578e22-780f-4c5f-b264-83c87fa6f17a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:27.043519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f3d8b-802e-4c58-9713-dc7424b1bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:27.043978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f3d8b-802e-4c58-9713-dc7424b1bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:27.044390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f3d8b-802e-4c58-9713-dc7424b1bdd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:27.045351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f3d8b-802e-4c58-9713-dc7424b1bdd5 None admin] RBAC: Adding query filter params (role.id=bcdb152b51e34826a39fc0f8c3d60664, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=881030d7605b40879762d1c199362ee1) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:27.045827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f3d8b-802e-4c58-9713-dc7424b1bdd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:27.047493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f3d8b-802e-4c58-9713-dc7424b1bdd5 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:27.050946 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d578e22-780f-4c5f-b264-83c87fa6f17a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:27.052203 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d578e22-780f-4c5f-b264-83c87fa6f17a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:27.054801 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 341/679] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:26 2022] GET /identity/v3/role_assignments?user.id=881030d7605b40879762d1c199362ee1&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=bcdb152b51e34826a39fc0f8c3d60664 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:27.055860 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f3d8b-802e-4c58-9713-dc7424b1bdd5 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:27.069446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:27.076429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-5d578e22-780f-4c5f-b264-83c87fa6f17a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:27.076429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:27.076429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:27.076429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:27.076429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:27.076429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:27.076429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:27.076429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:27.076429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:27.076429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:27.076429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:27.076429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:27.076429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:27.076429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:27.076429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:27.077567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:27.078627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:27.078627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:27.078627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:27.078627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:27.078627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:27.078627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:27.078627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:27.078627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:27.078627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 339/680] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:27.083733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7410-94f8-48cf-8a4b-1a0fb00f1a8a None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:27.083733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7410-94f8-48cf-8a4b-1a0fb00f1a8a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:27.083733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7410-94f8-48cf-8a4b-1a0fb00f1a8a None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:27.086603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 340/681] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:27.088009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a7410-94f8-48cf-8a4b-1a0fb00f1a8a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:27.179075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f3d8b-802e-4c58-9713-dc7424b1bdd5 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:27.217015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad771f91-6072-49f8-9d0c-22903d2882bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:27.218229 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad771f91-6072-49f8-9d0c-22903d2882bd None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:27.218652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad771f91-6072-49f8-9d0c-22903d2882bd None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:27.219293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad771f91-6072-49f8-9d0c-22903d2882bd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:27.224717 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a7410-94f8-48cf-8a4b-1a0fb00f1a8a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:27.231666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad771f91-6072-49f8-9d0c-22903d2882bd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:27.235439 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad771f91-6072-49f8-9d0c-22903d2882bd None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-ad771f91-6072-49f8-9d0c-22903d2882bd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:27.253215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:27.255270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:27.256218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:27.256218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:27.256218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:27.256218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:27.256218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:27.256218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:27.256218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:27.256218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:27.256218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:06:27.256218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:27.256218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 342/682] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:06:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:27.256824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae0b27-c093-4d94-b78d-98c23ae63990 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:27.256824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae0b27-c093-4d94-b78d-98c23ae63990 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:27.258896 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae0b27-c093-4d94-b78d-98c23ae63990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:27.277870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71886dc4-faf6-49dd-b976-686ceb8c1f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:27.278497 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71886dc4-faf6-49dd-b976-686ceb8c1f66 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:27.278770 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71886dc4-faf6-49dd-b976-686ceb8c1f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:27.279040 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71886dc4-faf6-49dd-b976-686ceb8c1f66 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:27.279733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71886dc4-faf6-49dd-b976-686ceb8c1f66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:27.280035 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71886dc4-faf6-49dd-b976-686ceb8c1f66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:27.281476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71886dc4-faf6-49dd-b976-686ceb8c1f66 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:27.282133 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-3aae0b27-c093-4d94-b78d-98c23ae63990 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:27.283397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3aae0b27-c093-4d94-b78d-98c23ae63990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:27.296018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 341/683] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:27.297181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71886dc4-faf6-49dd-b976-686ceb8c1f66 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:27.336158 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:27.358463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:27.367621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 343/684] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:27.368712 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae0b27-c093-4d94-b78d-98c23ae63990 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:27.441849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71886dc4-faf6-49dd-b976-686ceb8c1f66 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:27.487875 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9e4e0-a597-456d-b869-3c929ba7d7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:27.488509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9e4e0-a597-456d-b869-3c929ba7d7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:27.488782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9e4e0-a597-456d-b869-3c929ba7d7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:27.489047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9e4e0-a597-456d-b869-3c929ba7d7b9 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:27.489827 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9e4e0-a597-456d-b869-3c929ba7d7b9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:27.490140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9e4e0-a597-456d-b869-3c929ba7d7b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:27.491619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9e4e0-a597-456d-b869-3c929ba7d7b9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:27.504830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae0b27-c093-4d94-b78d-98c23ae63990 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:27.516233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 342/685] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Aug 9 11:06:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:27.516233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9e4e0-a597-456d-b869-3c929ba7d7b9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:27.560109 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da24ee3-0ad3-4aed-a26f-13ba83b2fd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:27.561118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da24ee3-0ad3-4aed-a26f-13ba83b2fd7a None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:27.561597 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da24ee3-0ad3-4aed-a26f-13ba83b2fd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:27.562109 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da24ee3-0ad3-4aed-a26f-13ba83b2fd7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:27.563056 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da24ee3-0ad3-4aed-a26f-13ba83b2fd7a None admin] RBAC: Adding query filter params (role.id=bcdb152b51e34826a39fc0f8c3d60664, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=0ee3889add1541418ccda24268831979) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:27.563598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da24ee3-0ad3-4aed-a26f-13ba83b2fd7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:27.566053 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da24ee3-0ad3-4aed-a26f-13ba83b2fd7a None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:27.576791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 344/686] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:27 2022] GET /identity/v3/role_assignments?user.id=0ee3889add1541418ccda24268831979&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=bcdb152b51e34826a39fc0f8c3d60664 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:27.578205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da24ee3-0ad3-4aed-a26f-13ba83b2fd7a None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:27.621889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:27.650330 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9e4e0-a597-456d-b869-3c929ba7d7b9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:27.704717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:27.706050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cb707-9cb1-4d97-a451-b7f72843820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:27.706961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cb707-9cb1-4d97-a451-b7f72843820f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:27.707468 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cb707-9cb1-4d97-a451-b7f72843820f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:27.708417 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cb707-9cb1-4d97-a451-b7f72843820f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:27.722525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cb707-9cb1-4d97-a451-b7f72843820f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:27.725169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cb707-9cb1-4d97-a451-b7f72843820f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-c12cb707-9cb1-4d97-a451-b7f72843820f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:27.744811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:27.745881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:27.746808 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:27.746808 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:27.746808 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:27.749601 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 343/687] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:27.759566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cb707-9cb1-4d97-a451-b7f72843820f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:27.796361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da24ee3-0ad3-4aed-a26f-13ba83b2fd7a None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:27.840463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef54d5b-4f2a-4030-97a3-0cf88a723685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:27.841549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef54d5b-4f2a-4030-97a3-0cf88a723685 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:27.842151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef54d5b-4f2a-4030-97a3-0cf88a723685 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:27.842672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef54d5b-4f2a-4030-97a3-0cf88a723685 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:27.901165 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cb707-9cb1-4d97-a451-b7f72843820f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:27.914321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef54d5b-4f2a-4030-97a3-0cf88a723685 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:27.916113 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef54d5b-4f2a-4030-97a3-0cf88a723685 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:27.938302 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdc03d-47b0-4e30-80c8-23c36e39448f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:27.938894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdc03d-47b0-4e30-80c8-23c36e39448f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:27.939104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdc03d-47b0-4e30-80c8-23c36e39448f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:27.939368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdc03d-47b0-4e30-80c8-23c36e39448f None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:27.940078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdc03d-47b0-4e30-80c8-23c36e39448f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:27.940377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdc03d-47b0-4e30-80c8-23c36e39448f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:27.942250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdc03d-47b0-4e30-80c8-23c36e39448f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:27.952987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:27.959625 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 344/688] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:27.965397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdc03d-47b0-4e30-80c8-23c36e39448f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:27.988783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:28.020573 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 345/689] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 11:06:28.021786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09e50-e3b4-429b-a5d3-f3eb54f6ebd2 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:28.022063 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09e50-e3b4-429b-a5d3-f3eb54f6ebd2 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:28.022329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09e50-e3b4-429b-a5d3-f3eb54f6ebd2 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:28.023902 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 346/690] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:28.025986 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09e50-e3b4-429b-a5d3-f3eb54f6ebd2 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:28.088263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdc03d-47b0-4e30-80c8-23c36e39448f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:28.124370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b583c-f7bf-4da2-9505-b55aca6ec657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:28.124976 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b583c-f7bf-4da2-9505-b55aca6ec657 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:28.125246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b583c-f7bf-4da2-9505-b55aca6ec657 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:28.125511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b583c-f7bf-4da2-9505-b55aca6ec657 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:28.126252 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b583c-f7bf-4da2-9505-b55aca6ec657 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:28.127792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b583c-f7bf-4da2-9505-b55aca6ec657 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:28.127914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09e50-e3b4-429b-a5d3-f3eb54f6ebd2 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:28.151727 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 345/691] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:06:27 2022] POST /identity/v3/users => generated 254 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:06:28.153286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa9077-c731-468e-bf7b-12aec0ca5673 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:28.153564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa9077-c731-468e-bf7b-12aec0ca5673 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:28.153867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa9077-c731-468e-bf7b-12aec0ca5673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:28.164544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbd007-bb8e-4662-87d3-6caad2f3c6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:28.165343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbd007-bb8e-4662-87d3-6caad2f3c6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:28.165744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbd007-bb8e-4662-87d3-6caad2f3c6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:28.166106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbd007-bb8e-4662-87d3-6caad2f3c6c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:28.174704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4efa9077-c731-468e-bf7b-12aec0ca5673 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:28.176070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4efa9077-c731-468e-bf7b-12aec0ca5673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:28.177354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbd007-bb8e-4662-87d3-6caad2f3c6c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:28.178980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbd007-bb8e-4662-87d3-6caad2f3c6c2 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-d2cbd007-bb8e-4662-87d3-6caad2f3c6c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:28.197028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:28.198092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:28.199605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:28.199605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:28.199605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:28.199605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 347/692] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:28.206800 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbd007-bb8e-4662-87d3-6caad2f3c6c2 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:28.273086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:28.304546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 346/693] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:28.334682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa9077-c731-468e-bf7b-12aec0ca5673 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:28.367208 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:28.485136 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa9077-c731-468e-bf7b-12aec0ca5673 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:28.495634 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbd007-bb8e-4662-87d3-6caad2f3c6c2 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:28.529836 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2c1b9-6ebf-4e2a-a309-234677312f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:28.530948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2c1b9-6ebf-4e2a-a309-234677312f91 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:28.531227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2c1b9-6ebf-4e2a-a309-234677312f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:28.531498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2c1b9-6ebf-4e2a-a309-234677312f91 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:28.532087 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2c1b9-6ebf-4e2a-a309-234677312f91 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:28.533570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2c1b9-6ebf-4e2a-a309-234677312f91 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:28.541348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f61e29-cf50-4691-9999-4b59b9baea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:28.542244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f61e29-cf50-4691-9999-4b59b9baea03 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:28.542708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f61e29-cf50-4691-9999-4b59b9baea03 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:28.543178 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f61e29-cf50-4691-9999-4b59b9baea03 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:28.544086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f61e29-cf50-4691-9999-4b59b9baea03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:28.544573 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f61e29-cf50-4691-9999-4b59b9baea03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:28.546158 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f61e29-cf50-4691-9999-4b59b9baea03 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-65e2c1b9-6ebf-4e2a-a309-234677312f91 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:28.547343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:28.548385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:28.549231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:28.549231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:28.549231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:28.549231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:28.549231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:28.549231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:28.549231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:28.549231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:28.549231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:28.549231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:28.549231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:28.549231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:28.549231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:06:28.549231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:28.549231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 347/694] 10.222.0.15 () {56 vars in 1129 bytes} [Tue Aug 9 11:06:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:28.555567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2c1b9-6ebf-4e2a-a309-234677312f91 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:28.567895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 348/695] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:28.575657 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f61e29-cf50-4691-9999-4b59b9baea03 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:28.627627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:28.680072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:28.700270 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2c1b9-6ebf-4e2a-a309-234677312f91 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:28.721218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f61e29-cf50-4691-9999-4b59b9baea03 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:28.758682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad544e6-e038-49a0-9136-c58dba47e76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:28.759804 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad544e6-e038-49a0-9136-c58dba47e76e None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:28.760080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad544e6-e038-49a0-9136-c58dba47e76e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:28.760348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad544e6-e038-49a0-9136-c58dba47e76e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:28.771196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad544e6-e038-49a0-9136-c58dba47e76e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:28.772658 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad544e6-e038-49a0-9136-c58dba47e76e None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:28.777788 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfdfd9-ba34-4222-a8ea-7fc8ed5f0c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:28.778398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfdfd9-ba34-4222-a8ea-7fc8ed5f0c6e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:28.778670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfdfd9-ba34-4222-a8ea-7fc8ed5f0c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:28.778999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfdfd9-ba34-4222-a8ea-7fc8ed5f0c6e None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:28.779626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfdfd9-ba34-4222-a8ea-7fc8ed5f0c6e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:28.780017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfdfd9-ba34-4222-a8ea-7fc8ed5f0c6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:28.781338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfdfd9-ba34-4222-a8ea-7fc8ed5f0c6e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:28.794675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-8ad544e6-e038-49a0-9136-c58dba47e76e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:28.794675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:28.794675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:28.794675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:28.794675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:28.794675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:28.794675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:28.794675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:28.794675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:28.794675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:28.794675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:28.794675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:28.794675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:28.794675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:28.794675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:28.795588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:28.796503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:28.796503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:28.796503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:28.796503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:28.796503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:28.796503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:28.796503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:28.796503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:28.797693 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 348/696] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Aug 9 11:06:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:28.798857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 349/697] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:28.806915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfdfd9-ba34-4222-a8ea-7fc8ed5f0c6e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:28.810561 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad544e6-e038-49a0-9136-c58dba47e76e None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:28.965970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfdfd9-ba34-4222-a8ea-7fc8ed5f0c6e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:28.980816 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:28.982407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad544e6-e038-49a0-9136-c58dba47e76e None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:29.003449 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006197f-20d0-4560-ae1c-6df49f9f0641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:29.004765 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006197f-20d0-4560-ae1c-6df49f9f0641 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:29.005234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006197f-20d0-4560-ae1c-6df49f9f0641 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:29.005754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006197f-20d0-4560-ae1c-6df49f9f0641 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:29.006614 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006197f-20d0-4560-ae1c-6df49f9f0641 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:29.007100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006197f-20d0-4560-ae1c-6df49f9f0641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:29.008800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006197f-20d0-4560-ae1c-6df49f9f0641 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:29.015290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 349/698] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Aug 9 11:06:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:29.031875 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22da3f0-2254-45b2-94ca-998eb36a226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:29.032381 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22da3f0-2254-45b2-94ca-998eb36a226f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:29.032660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22da3f0-2254-45b2-94ca-998eb36a226f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:29.032931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22da3f0-2254-45b2-94ca-998eb36a226f None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:29.033699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22da3f0-2254-45b2-94ca-998eb36a226f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:29.034010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22da3f0-2254-45b2-94ca-998eb36a226f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:29.035584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22da3f0-2254-45b2-94ca-998eb36a226f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:29.037555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:29.056917 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 350/699] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:29.063265 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006197f-20d0-4560-ae1c-6df49f9f0641 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:29.222352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006197f-20d0-4560-ae1c-6df49f9f0641 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:29.263583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42c47b-ca7e-490f-b283-1dbfd2e5b9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:29.264205 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42c47b-ca7e-490f-b283-1dbfd2e5b9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:29.264482 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42c47b-ca7e-490f-b283-1dbfd2e5b9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:29.264751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42c47b-ca7e-490f-b283-1dbfd2e5b9f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:29.265485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42c47b-ca7e-490f-b283-1dbfd2e5b9f5 None admin] RBAC: Adding query filter params (role.id=bcdb152b51e34826a39fc0f8c3d60664, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=557b8757098e4777965d782d1ce5f97b) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:29.265821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42c47b-ca7e-490f-b283-1dbfd2e5b9f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:29.267292 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42c47b-ca7e-490f-b283-1dbfd2e5b9f5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:29.274321 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 350/700] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:29 2022] GET /identity/v3/role_assignments?user.id=557b8757098e4777965d782d1ce5f97b&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=bcdb152b51e34826a39fc0f8c3d60664 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:29.498905 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36ba71-721e-4679-aa46-307c61677bdc None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:29.499415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36ba71-721e-4679-aa46-307c61677bdc None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:29.499415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36ba71-721e-4679-aa46-307c61677bdc None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:29.501081 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 351/701] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:29.506768 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4af9d9-0dca-4899-8906-0ebf143250a4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:29.507053 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4af9d9-0dca-4899-8906-0ebf143250a4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:29.507328 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4af9d9-0dca-4899-8906-0ebf143250a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:29.526412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9c4af9d9-0dca-4899-8906-0ebf143250a4 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:29.527592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9c4af9d9-0dca-4899-8906-0ebf143250a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:29.562992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:29.595704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 351/702] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:29.618801 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36ba71-721e-4679-aa46-307c61677bdc None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:29.723828 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36ba71-721e-4679-aa46-307c61677bdc None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:29.760044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd25f09-ced3-482e-b24e-90964a023c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:29.760599 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd25f09-ced3-482e-b24e-90964a023c3c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:29.760871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd25f09-ced3-482e-b24e-90964a023c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:29.761136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd25f09-ced3-482e-b24e-90964a023c3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:29.771691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd25f09-ced3-482e-b24e-90964a023c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-8bd25f09-ced3-482e-b24e-90964a023c3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:29.776538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:29.777491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:29.778402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:29.778402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:29.778402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:29.778402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:29.778402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:29.778402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:29.778402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:29.778402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:29.778402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:29.778402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:29.778402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:06:29.778402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:29.778402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 352/703] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:06:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:29.783865 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4af9d9-0dca-4899-8906-0ebf143250a4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:29.887629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4af9d9-0dca-4899-8906-0ebf143250a4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:29.922642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41f401-7754-4af0-b621-f57129187678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:29.923245 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41f401-7754-4af0-b621-f57129187678 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:29.923519 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41f401-7754-4af0-b621-f57129187678 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:29.923828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41f401-7754-4af0-b621-f57129187678 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:29.924557 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41f401-7754-4af0-b621-f57129187678 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:29.924870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41f401-7754-4af0-b621-f57129187678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:29.926318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41f401-7754-4af0-b621-f57129187678 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:29.935052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 352/704] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:06:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:29.940653 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd25f09-ced3-482e-b24e-90964a023c3c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:30.003012 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:30.060324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd25f09-ced3-482e-b24e-90964a023c3c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:30.100765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbe57e-65bd-4ce1-a076-ebc8f3cd0019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:30.101804 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbe57e-65bd-4ce1-a076-ebc8f3cd0019 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:30.102291 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbe57e-65bd-4ce1-a076-ebc8f3cd0019 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:30.102745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbe57e-65bd-4ce1-a076-ebc8f3cd0019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:30.118205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbe57e-65bd-4ce1-a076-ebc8f3cd0019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:30.119942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbe57e-65bd-4ce1-a076-ebc8f3cd0019 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:30.127704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b707144-13e0-4f67-b4f7-796a27858cdd None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:30.127986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b707144-13e0-4f67-b4f7-796a27858cdd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:30.128259 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b707144-13e0-4f67-b4f7-796a27858cdd None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:30.130216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 353/705] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-a1fbe57e-65bd-4ce1-a076-ebc8f3cd0019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:30.142387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:30.143354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:30.144262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:30.144262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:30.144262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:30.146040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 353/706] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:30.148399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73009c8-6f41-4bb7-acff-70bb67ae4060 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:30.148733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73009c8-6f41-4bb7-acff-70bb67ae4060 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:30.149059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73009c8-6f41-4bb7-acff-70bb67ae4060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:30.156740 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbe57e-65bd-4ce1-a076-ebc8f3cd0019 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:30.176140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e73009c8-6f41-4bb7-acff-70bb67ae4060 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:30.177335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e73009c8-6f41-4bb7-acff-70bb67ae4060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:30.217802 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:30.263838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 354/707] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:30.284784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73009c8-6f41-4bb7-acff-70bb67ae4060 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:30.337299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbe57e-65bd-4ce1-a076-ebc8f3cd0019 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:30.344476 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:30.371944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd18b5-e5bc-4f34-a369-4ae64e02ebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:30.372727 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd18b5-e5bc-4f34-a369-4ae64e02ebd3 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:30.373061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd18b5-e5bc-4f34-a369-4ae64e02ebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:30.373392 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd18b5-e5bc-4f34-a369-4ae64e02ebd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:30.374169 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd18b5-e5bc-4f34-a369-4ae64e02ebd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:30.374535 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd18b5-e5bc-4f34-a369-4ae64e02ebd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:30.375985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd18b5-e5bc-4f34-a369-4ae64e02ebd3 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:30.389248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 354/708] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:30.394615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd18b5-e5bc-4f34-a369-4ae64e02ebd3 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:30.474499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73009c8-6f41-4bb7-acff-70bb67ae4060 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:30.508979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd18b5-e5bc-4f34-a369-4ae64e02ebd3 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:30.546348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18c8aa-ded0-4e62-adc3-a3ac996c836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:30.546973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18c8aa-ded0-4e62-adc3-a3ac996c836c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:30.547245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18c8aa-ded0-4e62-adc3-a3ac996c836c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:30.547507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18c8aa-ded0-4e62-adc3-a3ac996c836c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:30.555197 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18c8aa-ded0-4e62-adc3-a3ac996c836c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:30.556672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18c8aa-ded0-4e62-adc3-a3ac996c836c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:30.566391 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d0a0f-11ba-4a1f-ae8a-124a9a3049dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:30.567044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d0a0f-11ba-4a1f-ae8a-124a9a3049dd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:30.567320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d0a0f-11ba-4a1f-ae8a-124a9a3049dd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:30.567593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d0a0f-11ba-4a1f-ae8a-124a9a3049dd None admin] PATH_INFO: `/v3/services/network` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:30.568192 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d0a0f-11ba-4a1f-ae8a-124a9a3049dd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-6f18c8aa-ded0-4e62-adc3-a3ac996c836c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:30.568893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:30.569821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:30.570816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:30.570816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:30.570816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:30.570816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:30.570816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:30.570816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:30.570816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:30.570816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:30.570816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:06:30.570816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:30.571356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d0a0f-11ba-4a1f-ae8a-124a9a3049dd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:30.571426 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 355/709] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Aug 9 11:06:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:30.575816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18c8aa-ded0-4e62-adc3-a3ac996c836c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-dc2d0a0f-11ba-4a1f-ae8a-124a9a3049dd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:30.590611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:30.592835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:30.594781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:30.594781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:30.594781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:30.594781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:30.594781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:30.594781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:30.594781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:30.594781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:30.594781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:30.594781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:30.594781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:30.594781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:30.594781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:06:30.594781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:30.601232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 355/710] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:30 2022] GET /identity/v3/services/network => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:30.602574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d0a0f-11ba-4a1f-ae8a-124a9a3049dd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:30.626016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:30.679351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18c8aa-ded0-4e62-adc3-a3ac996c836c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:30.706841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:30.714792 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b6165-4027-4a12-ae79-11118fdf993b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:30.715480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b6165-4027-4a12-ae79-11118fdf993b None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:30.715818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b6165-4027-4a12-ae79-11118fdf993b None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:30.716149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b6165-4027-4a12-ae79-11118fdf993b None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:30.716951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b6165-4027-4a12-ae79-11118fdf993b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:30.717316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b6165-4027-4a12-ae79-11118fdf993b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:30.718979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b6165-4027-4a12-ae79-11118fdf993b None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:30.737820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 356/711] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Aug 9 11:06:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:30.743507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b6165-4027-4a12-ae79-11118fdf993b None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:30.833916 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d0a0f-11ba-4a1f-ae8a-124a9a3049dd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:30.837106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:30.855264 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b6165-4027-4a12-ae79-11118fdf993b None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:30.869610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da710abd-c442-40ec-923b-312d4f306db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:30.870406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da710abd-c442-40ec-923b-312d4f306db8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:30.870777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da710abd-c442-40ec-923b-312d4f306db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:30.871168 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da710abd-c442-40ec-923b-312d4f306db8 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:30.871901 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da710abd-c442-40ec-923b-312d4f306db8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:30.872297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da710abd-c442-40ec-923b-312d4f306db8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:30.873848 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da710abd-c442-40ec-923b-312d4f306db8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:30.879349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 356/712] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Aug 9 11:06:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:30.880751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a9c6c-f23d-4e5a-81de-dda27d2ce3cb None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:30.881188 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a9c6c-f23d-4e5a-81de-dda27d2ce3cb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:30.881555 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a9c6c-f23d-4e5a-81de-dda27d2ce3cb None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:30.883254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 357/713] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:30.885443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a9c6c-f23d-4e5a-81de-dda27d2ce3cb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:30.900266 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515dfcc-b826-403c-bdfb-a9e8ba3b5f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:30.900882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515dfcc-b826-403c-bdfb-a9e8ba3b5f70 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:30.901155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515dfcc-b826-403c-bdfb-a9e8ba3b5f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:30.901424 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515dfcc-b826-403c-bdfb-a9e8ba3b5f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:30.976751 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515dfcc-b826-403c-bdfb-a9e8ba3b5f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:30.978387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515dfcc-b826-403c-bdfb-a9e8ba3b5f70 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:30.989452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:31.000083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a9c6c-f23d-4e5a-81de-dda27d2ce3cb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:31.039183 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e89b6-9437-4faa-bb91-ca0e1037c327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:31.040214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e89b6-9437-4faa-bb91-ca0e1037c327 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:31.040757 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e89b6-9437-4faa-bb91-ca0e1037c327 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:31.041033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e89b6-9437-4faa-bb91-ca0e1037c327 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:31.041933 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e89b6-9437-4faa-bb91-ca0e1037c327 None admin] RBAC: Adding query filter params (type=network) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:31.042239 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e89b6-9437-4faa-bb91-ca0e1037c327 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:31.044301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e89b6-9437-4faa-bb91-ca0e1037c327 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:31.051254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 358/714] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Aug 9 11:06:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:31.052865 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107b71e-00c2-4998-bbb2-8d8e98626d78 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:31.053389 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107b71e-00c2-4998-bbb2-8d8e98626d78 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:31.053703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107b71e-00c2-4998-bbb2-8d8e98626d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:31.071561 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:31.080411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d107b71e-00c2-4998-bbb2-8d8e98626d78 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:31.081950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d107b71e-00c2-4998-bbb2-8d8e98626d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:31.091144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 357/715] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:06:31.097403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515dfcc-b826-403c-bdfb-a9e8ba3b5f70 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:31.230095 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515dfcc-b826-403c-bdfb-a9e8ba3b5f70 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:31.280500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a48fdb-e590-4131-9578-e289d45e65ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:31.283004 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a48fdb-e590-4131-9578-e289d45e65ac None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:31.283500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a48fdb-e590-4131-9578-e289d45e65ac None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:31.283979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a48fdb-e590-4131-9578-e289d45e65ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:31.299731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 359/716] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:31.305535 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a48fdb-e590-4131-9578-e289d45e65ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:31.307417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a48fdb-e590-4131-9578-e289d45e65ac None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-27a48fdb-e590-4131-9578-e289d45e65ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:31.324485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:31.325572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:31.326559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:31.326559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:31.326559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:31.329052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 358/717] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:31.335487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107b71e-00c2-4998-bbb2-8d8e98626d78 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:31.348648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a48fdb-e590-4131-9578-e289d45e65ac None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:31.402452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:31.456082 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:31.480007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107b71e-00c2-4998-bbb2-8d8e98626d78 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:31.511997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a48fdb-e590-4131-9578-e289d45e65ac None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:31.521504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7449a93-802b-49e7-921c-6b79b94a76bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:31.522303 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7449a93-802b-49e7-921c-6b79b94a76bc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:31.522672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7449a93-802b-49e7-921c-6b79b94a76bc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:31.523154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7449a93-802b-49e7-921c-6b79b94a76bc None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:31.524051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7449a93-802b-49e7-921c-6b79b94a76bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:31.524444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7449a93-802b-49e7-921c-6b79b94a76bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:31.529660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7449a93-802b-49e7-921c-6b79b94a76bc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:31.545069 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 360/718] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:31.551047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7449a93-802b-49e7-921c-6b79b94a76bc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:31.590064 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccdb42-f64a-413b-81dc-e4740f28bbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:31.590769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccdb42-f64a-413b-81dc-e4740f28bbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:31.591047 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccdb42-f64a-413b-81dc-e4740f28bbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:31.591314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccdb42-f64a-413b-81dc-e4740f28bbd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:31.609416 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccdb42-f64a-413b-81dc-e4740f28bbd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-ccccdb42-f64a-413b-81dc-e4740f28bbd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:31.614798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:31.620322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:31.622224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:31.622224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:31.622224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:31.622224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:31.622224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:31.622224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:31.622224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:31.622224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:31.622224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:31.622224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:31.622224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:31.622224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:31.622224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 359/719] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:31.622224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa496a5-3991-44b5-9437-fcc9905e9c0b None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:31.630412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa496a5-3991-44b5-9437-fcc9905e9c0b None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:31.630412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa496a5-3991-44b5-9437-fcc9905e9c0b None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:31.630412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 360/720] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:31.630412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa496a5-3991-44b5-9437-fcc9905e9c0b None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:31.726374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7449a93-802b-49e7-921c-6b79b94a76bc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:31.758898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:31.766199 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa496a5-3991-44b5-9437-fcc9905e9c0b None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:31.775963 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa124b46-47a2-40f5-b9b2-69163a623fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:31.777091 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa124b46-47a2-40f5-b9b2-69163a623fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:31.777745 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa124b46-47a2-40f5-b9b2-69163a623fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:31.778882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa124b46-47a2-40f5-b9b2-69163a623fe8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:31.791174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa124b46-47a2-40f5-b9b2-69163a623fe8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:31.794057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa124b46-47a2-40f5-b9b2-69163a623fe8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:31.806207 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3973d-12a7-4b04-aebc-2d63a7867c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:31.806813 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3973d-12a7-4b04-aebc-2d63a7867c54 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:31.807079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3973d-12a7-4b04-aebc-2d63a7867c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:31.807339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3973d-12a7-4b04-aebc-2d63a7867c54 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:31.807992 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3973d-12a7-4b04-aebc-2d63a7867c54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:31.808286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3973d-12a7-4b04-aebc-2d63a7867c54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:31.809666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3973d-12a7-4b04-aebc-2d63a7867c54 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:31.810811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-aa124b46-47a2-40f5-b9b2-69163a623fe8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:31.810811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:31.810811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:31.810811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:31.810811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:31.810811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:31.810811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:31.810811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:31.810811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:31.810811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:31.810811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:31.810811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:31.810811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:31.810811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:31.810811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:31.811666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:31.812554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:31.812554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:31.812554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:31.812554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:31.812554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:31.812554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:31.812554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:31.812554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:31.815377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 361/721] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:31.816897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874614b-09ec-4e7b-833f-b5db89cdd06a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:31.817312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874614b-09ec-4e7b-833f-b5db89cdd06a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:31.817745 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874614b-09ec-4e7b-833f-b5db89cdd06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:31.821841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 361/722] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:31.829942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3973d-12a7-4b04-aebc-2d63a7867c54 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:31.842579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:31.851176 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6874614b-09ec-4e7b-833f-b5db89cdd06a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:31.853462 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6874614b-09ec-4e7b-833f-b5db89cdd06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:31.957641 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 362/723] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:31.957641 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874614b-09ec-4e7b-833f-b5db89cdd06a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:31.967489 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3973d-12a7-4b04-aebc-2d63a7867c54 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:32.017732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975af5c-0dcd-4184-8e22-104a372f2e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:32.019118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975af5c-0dcd-4184-8e22-104a372f2e22 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:32.019631 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975af5c-0dcd-4184-8e22-104a372f2e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:32.020496 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975af5c-0dcd-4184-8e22-104a372f2e22 None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:32.021669 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975af5c-0dcd-4184-8e22-104a372f2e22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:32.022172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975af5c-0dcd-4184-8e22-104a372f2e22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:32.024803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975af5c-0dcd-4184-8e22-104a372f2e22 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:32.042256 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 362/724] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:32.043468 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975af5c-0dcd-4184-8e22-104a372f2e22 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:32.067788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:32.084884 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874614b-09ec-4e7b-833f-b5db89cdd06a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:32.127375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88c7fc-bfea-4282-987d-5889a80e8f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:32.128389 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88c7fc-bfea-4282-987d-5889a80e8f5d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:32.129318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88c7fc-bfea-4282-987d-5889a80e8f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:32.129936 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88c7fc-bfea-4282-987d-5889a80e8f5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:32.133085 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:32.142957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88c7fc-bfea-4282-987d-5889a80e8f5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:32.144815 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88c7fc-bfea-4282-987d-5889a80e8f5d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-fa88c7fc-bfea-4282-987d-5889a80e8f5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:32.161154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:32.162191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:32.163182 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:32.163182 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:32.163182 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:32.163353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975af5c-0dcd-4184-8e22-104a372f2e22 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:32.169837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 363/725] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:32.171098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88c7fc-bfea-4282-987d-5889a80e8f5d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:32.196308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d54807-bd93-4fde-a407-0e50b03d41bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:32.196879 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d54807-bd93-4fde-a407-0e50b03d41bf None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:32.197149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d54807-bd93-4fde-a407-0e50b03d41bf None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:32.197412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d54807-bd93-4fde-a407-0e50b03d41bf None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:32.198079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d54807-bd93-4fde-a407-0e50b03d41bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:32.199516 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d54807-bd93-4fde-a407-0e50b03d41bf None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:32.225812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 363/726] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Aug 9 11:06:32 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:06:32.226959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d54807-bd93-4fde-a407-0e50b03d41bf None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:32.289143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88c7fc-bfea-4282-987d-5889a80e8f5d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:32.323245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:32.349655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef063b8-467a-48e1-9bd4-71ab6f75a3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:32.350206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d54807-bd93-4fde-a407-0e50b03d41bf None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:32.351111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef063b8-467a-48e1-9bd4-71ab6f75a3bd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:32.351677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef063b8-467a-48e1-9bd4-71ab6f75a3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:32.352151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef063b8-467a-48e1-9bd4-71ab6f75a3bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:32.353161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef063b8-467a-48e1-9bd4-71ab6f75a3bd None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=881030d7605b40879762d1c199362ee1) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:32.353762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef063b8-467a-48e1-9bd4-71ab6f75a3bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:32.355486 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef063b8-467a-48e1-9bd4-71ab6f75a3bd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:32.362827 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 364/727] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:32 2022] GET /identity/v3/role_assignments?user.id=881030d7605b40879762d1c199362ee1&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:32.364558 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f614e-a2b3-4d41-adab-9e9f6c938ca9 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:32.365107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f614e-a2b3-4d41-adab-9e9f6c938ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:32.365570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f614e-a2b3-4d41-adab-9e9f6c938ca9 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:32.367488 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 365/728] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:32.375347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989f8d7-86b2-45ad-b509-1acbf53fa4cf None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:32.375960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989f8d7-86b2-45ad-b509-1acbf53fa4cf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:32.376452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989f8d7-86b2-45ad-b509-1acbf53fa4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:32.387390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a09fa1-8df8-4612-9ba7-7a73d29c3df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:32.388022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a09fa1-8df8-4612-9ba7-7a73d29c3df4 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:32.388283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a09fa1-8df8-4612-9ba7-7a73d29c3df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:32.388546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a09fa1-8df8-4612-9ba7-7a73d29c3df4 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:32.389201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a09fa1-8df8-4612-9ba7-7a73d29c3df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:32.389493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a09fa1-8df8-4612-9ba7-7a73d29c3df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:32.392496 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a09fa1-8df8-4612-9ba7-7a73d29c3df4 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:32.406730 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 364/729] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:32.411848 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a09fa1-8df8-4612-9ba7-7a73d29c3df4 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:32.423849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d989f8d7-86b2-45ad-b509-1acbf53fa4cf None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:32.425735 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d989f8d7-86b2-45ad-b509-1acbf53fa4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:32.520164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:32.540044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a09fa1-8df8-4612-9ba7-7a73d29c3df4 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:32.548855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 366/730] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 11:06:32.580111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13346d57-9c40-42ee-8e09-a940f18df638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:32.580751 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13346d57-9c40-42ee-8e09-a940f18df638 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:32.581019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13346d57-9c40-42ee-8e09-a940f18df638 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:32.581277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13346d57-9c40-42ee-8e09-a940f18df638 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:32.582220 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989f8d7-86b2-45ad-b509-1acbf53fa4cf None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:32.589726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13346d57-9c40-42ee-8e09-a940f18df638 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:32.591033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13346d57-9c40-42ee-8e09-a940f18df638 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:32.593034 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-13346d57-9c40-42ee-8e09-a940f18df638 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:32.603882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:32.605112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:32.606298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:32.606298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:32.606298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:32.606298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:32.606298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:32.606298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:32.606298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:32.606298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:32.606298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:06:32.606298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:32.612142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 365/731] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Aug 9 11:06:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:32.615932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13346d57-9c40-42ee-8e09-a940f18df638 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:32.705959 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989f8d7-86b2-45ad-b509-1acbf53fa4cf None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:32.734758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13346d57-9c40-42ee-8e09-a940f18df638 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:32.748454 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77385c75-39af-4783-a4cb-3e2075bb266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:32.749335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77385c75-39af-4783-a4cb-3e2075bb266f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:32.749697 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77385c75-39af-4783-a4cb-3e2075bb266f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:32.750033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77385c75-39af-4783-a4cb-3e2075bb266f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:32.766048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77385c75-39af-4783-a4cb-3e2075bb266f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-77385c75-39af-4783-a4cb-3e2075bb266f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:32.771227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:32.772164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:32.773017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:32.773017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:32.773017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:32.773017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:32.773017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:32.773017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:32.773017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:32.773017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:32.773017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:32.773017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:32.773017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:06:32.773017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:32.775783 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 367/732] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:06:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:32.787787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e661e5-4b16-458f-b4da-b02881105789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:32.788851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e661e5-4b16-458f-b4da-b02881105789 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:32.789445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e661e5-4b16-458f-b4da-b02881105789 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:32.789600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77385c75-39af-4783-a4cb-3e2075bb266f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:32.789931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e661e5-4b16-458f-b4da-b02881105789 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:32.790929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e661e5-4b16-458f-b4da-b02881105789 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:32.791265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e661e5-4b16-458f-b4da-b02881105789 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:32.792828 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e661e5-4b16-458f-b4da-b02881105789 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:32.815683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 366/733] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Aug 9 11:06:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:32.822218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e661e5-4b16-458f-b4da-b02881105789 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:32.885515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:32.890743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:32.941258 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e661e5-4b16-458f-b4da-b02881105789 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:32.979262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7da32e-3f33-41e6-b30b-25c93f2767a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:32.980069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7da32e-3f33-41e6-b30b-25c93f2767a6 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:32.980440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7da32e-3f33-41e6-b30b-25c93f2767a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:32.980801 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7da32e-3f33-41e6-b30b-25c93f2767a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:33.076845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77385c75-39af-4783-a4cb-3e2075bb266f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:33.087927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7da32e-3f33-41e6-b30b-25c93f2767a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:33.089409 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7da32e-3f33-41e6-b30b-25c93f2767a6 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:33.154924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfac61d-ede6-49b2-978c-9d58c1cdaece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:33.155544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfac61d-ede6-49b2-978c-9d58c1cdaece None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:33.155816 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfac61d-ede6-49b2-978c-9d58c1cdaece None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:33.156082 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfac61d-ede6-49b2-978c-9d58c1cdaece None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:33.156743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfac61d-ede6-49b2-978c-9d58c1cdaece None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:33.157038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfac61d-ede6-49b2-978c-9d58c1cdaece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:33.158427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfac61d-ede6-49b2-978c-9d58c1cdaece None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:33.172156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:33.183541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 368/734] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:06:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:33.191141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfac61d-ede6-49b2-978c-9d58c1cdaece None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:33.247004 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 367/735] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:32 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 11:06:33.267118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7da32e-3f33-41e6-b30b-25c93f2767a6 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:33.384247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:33.392984 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfac61d-ede6-49b2-978c-9d58c1cdaece None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:33.424902 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7da32e-3f33-41e6-b30b-25c93f2767a6 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:33.440842 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87744aea-6ede-4080-99a4-3671830ea724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:33.441490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87744aea-6ede-4080-99a4-3671830ea724 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:33.441790 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87744aea-6ede-4080-99a4-3671830ea724 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:33.442059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87744aea-6ede-4080-99a4-3671830ea724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:33.456610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87744aea-6ede-4080-99a4-3671830ea724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:33.458621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87744aea-6ede-4080-99a4-3671830ea724 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:33.466881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea509f-4f02-4ca6-9489-bd1196de5340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:33.468269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea509f-4f02-4ca6-9489-bd1196de5340 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:33.468944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea509f-4f02-4ca6-9489-bd1196de5340 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:33.469694 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea509f-4f02-4ca6-9489-bd1196de5340 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-87744aea-6ede-4080-99a4-3671830ea724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:33.479829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:33.480967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:33.482285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:33.482285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:33.482285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:33.482285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 369/736] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:33.486875 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676f95d-b86d-4af5-833b-6624f1670ad9 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:33.487160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676f95d-b86d-4af5-833b-6624f1670ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:33.487434 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676f95d-b86d-4af5-833b-6624f1670ad9 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:33.494859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 370/737] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:33.494859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676f95d-b86d-4af5-833b-6624f1670ad9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:33.503235 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea509f-4f02-4ca6-9489-bd1196de5340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:33.505490 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea509f-4f02-4ca6-9489-bd1196de5340 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-8dea509f-4f02-4ca6-9489-bd1196de5340 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:33.526683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:33.527722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:33.528603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:33.528603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:33.528603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:33.530936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 368/738] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:33.532415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0246d-b5dc-4bbf-bf5a-e0522a94c5df None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:33.532910 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0246d-b5dc-4bbf-bf5a-e0522a94c5df None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:33.533343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0246d-b5dc-4bbf-bf5a-e0522a94c5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:33.567549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-d0a0246d-b5dc-4bbf-bf5a-e0522a94c5df None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:33.569646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d0a0246d-b5dc-4bbf-bf5a-e0522a94c5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:33.572289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:33.624432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676f95d-b86d-4af5-833b-6624f1670ad9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:33.665728 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 369/739] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 11:06:33.665728 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0246d-b5dc-4bbf-bf5a-e0522a94c5df None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:33.668067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e31048-2acf-4787-8e52-92bae80085f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:33.669266 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e31048-2acf-4787-8e52-92bae80085f2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:33.670051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e31048-2acf-4787-8e52-92bae80085f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:33.670721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e31048-2acf-4787-8e52-92bae80085f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:33.671681 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e31048-2acf-4787-8e52-92bae80085f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:33.672226 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e31048-2acf-4787-8e52-92bae80085f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:33.673869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e31048-2acf-4787-8e52-92bae80085f2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:33.705714 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 371/740] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:33.706933 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e31048-2acf-4787-8e52-92bae80085f2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:33.725581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:33.777911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0246d-b5dc-4bbf-bf5a-e0522a94c5df None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:33.819819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b750f75-d409-419f-9285-197a4d165d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:33.820352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e31048-2acf-4787-8e52-92bae80085f2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:33.820996 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b750f75-d409-419f-9285-197a4d165d4d None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:33.821493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b750f75-d409-419f-9285-197a4d165d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:33.822023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b750f75-d409-419f-9285-197a4d165d4d None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:33.822928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b750f75-d409-419f-9285-197a4d165d4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:33.823396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b750f75-d409-419f-9285-197a4d165d4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:33.824940 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b750f75-d409-419f-9285-197a4d165d4d None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:33.832236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:33.840418 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 370/741] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:33.841757 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b750f75-d409-419f-9285-197a4d165d4d None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:33.869209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce9f80-1f62-4f37-8c0a-2fa4ec3a981a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:33.869597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce9f80-1f62-4f37-8c0a-2fa4ec3a981a None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:33.869914 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce9f80-1f62-4f37-8c0a-2fa4ec3a981a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:33.870183 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce9f80-1f62-4f37-8c0a-2fa4ec3a981a None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:33.870852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce9f80-1f62-4f37-8c0a-2fa4ec3a981a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:33.872433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce9f80-1f62-4f37-8c0a-2fa4ec3a981a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:33.901662 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 372/742] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Aug 9 11:06:33 2022] POST /identity/v3/services => generated 240 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:06:33.901662 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce9f80-1f62-4f37-8c0a-2fa4ec3a981a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:33.993381 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:34.045642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce9f80-1f62-4f37-8c0a-2fa4ec3a981a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:34.079257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b5a38-c226-47d0-bca4-fbcb71db3e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:34.079902 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b5a38-c226-47d0-bca4-fbcb71db3e06 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:34.080171 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b5a38-c226-47d0-bca4-fbcb71db3e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:34.080439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b5a38-c226-47d0-bca4-fbcb71db3e06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:34.088837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b5a38-c226-47d0-bca4-fbcb71db3e06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:34.090483 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b5a38-c226-47d0-bca4-fbcb71db3e06 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:34.104377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-049b5a38-c226-47d0-bca4-fbcb71db3e06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:34.104377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:34.104377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:34.104377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:34.104377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:34.104377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:34.104377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:34.104377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:34.104377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:34.104377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:34.104377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:34.104377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:34.104377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:34.104377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:34.104377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:34.105355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:34.106315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:34.106315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:34.106315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:34.106315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:34.106315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:34.106315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:34.106315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:34.106315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:34.110649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 373/743] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:34.112491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b5a38-c226-47d0-bca4-fbcb71db3e06 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:34.135709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b750f75-d409-419f-9285-197a4d165d4d None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:34.179142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededc46c-f295-4ba3-80a2-9e430ef92141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:34.180179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededc46c-f295-4ba3-80a2-9e430ef92141 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:34.181499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededc46c-f295-4ba3-80a2-9e430ef92141 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:34.182016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededc46c-f295-4ba3-80a2-9e430ef92141 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:34.194468 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededc46c-f295-4ba3-80a2-9e430ef92141 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:34.196591 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededc46c-f295-4ba3-80a2-9e430ef92141 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-ededc46c-f295-4ba3-80a2-9e430ef92141 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:34.211549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:34.212594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:34.213533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:34.213533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:34.213533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:34.213533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:34.213533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:34.213533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:34.213533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:34.213533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:34.213533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:06:34.213533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:34.217179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 371/744] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:06:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:34.224705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededc46c-f295-4ba3-80a2-9e430ef92141 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:34.237148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b5a38-c226-47d0-bca4-fbcb71db3e06 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:34.266250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:34.278336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa087e-c116-4c4e-b4be-433bdfce17a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:34.279318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa087e-c116-4c4e-b4be-433bdfce17a9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:34.279784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa087e-c116-4c4e-b4be-433bdfce17a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:34.280800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa087e-c116-4c4e-b4be-433bdfce17a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:34.281797 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa087e-c116-4c4e-b4be-433bdfce17a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:34.282333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa087e-c116-4c4e-b4be-433bdfce17a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:34.283979 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa087e-c116-4c4e-b4be-433bdfce17a9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:34.297438 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 374/745] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:34.304450 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa087e-c116-4c4e-b4be-433bdfce17a9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:34.305551 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:34.376314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededc46c-f295-4ba3-80a2-9e430ef92141 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:34.451151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5ad4a-8efd-4772-b644-15ef7d321776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:34.452428 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5ad4a-8efd-4772-b644-15ef7d321776 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:34.455253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5ad4a-8efd-4772-b644-15ef7d321776 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:34.455758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5ad4a-8efd-4772-b644-15ef7d321776 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:34.456685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5ad4a-8efd-4772-b644-15ef7d321776 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:34.457197 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5ad4a-8efd-4772-b644-15ef7d321776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:34.459530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5ad4a-8efd-4772-b644-15ef7d321776 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:34.474947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa087e-c116-4c4e-b4be-433bdfce17a9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:34.484378 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 372/746] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Aug 9 11:06:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:34.490271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5ad4a-8efd-4772-b644-15ef7d321776 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:34.533771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617fadc-3638-4c1f-8c86-6a62759e6237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:34.534373 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617fadc-3638-4c1f-8c86-6a62759e6237 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:34.534648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617fadc-3638-4c1f-8c86-6a62759e6237 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:34.534953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617fadc-3638-4c1f-8c86-6a62759e6237 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:34.535791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617fadc-3638-4c1f-8c86-6a62759e6237 None admin] RBAC: Adding query filter params (role.id=bcdb152b51e34826a39fc0f8c3d60664, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=345ec6b0da4c4f07a6047190f8b2182d) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:34.536097 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617fadc-3638-4c1f-8c86-6a62759e6237 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:34.541782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617fadc-3638-4c1f-8c86-6a62759e6237 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:34.555998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 375/747] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:34 2022] GET /identity/v3/role_assignments?user.id=345ec6b0da4c4f07a6047190f8b2182d&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=bcdb152b51e34826a39fc0f8c3d60664 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:34.649998 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5ad4a-8efd-4772-b644-15ef7d321776 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:34.673253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:34.698969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a0136-1bdd-4c2b-812c-5cae82418ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:34.699664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a0136-1bdd-4c2b-812c-5cae82418ceb None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:34.699938 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a0136-1bdd-4c2b-812c-5cae82418ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:34.700205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a0136-1bdd-4c2b-812c-5cae82418ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:34.734942 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7332ec-2285-4c4f-bfc4-79b2b0132e65 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:34.735336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7332ec-2285-4c4f-bfc4-79b2b0132e65 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:34.735466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7332ec-2285-4c4f-bfc4-79b2b0132e65 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:34.736854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 376/748] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:06:34.752064 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dce551-1c4c-4660-8977-d2e3f9127a95 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:34.752341 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dce551-1c4c-4660-8977-d2e3f9127a95 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:34.752612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dce551-1c4c-4660-8977-d2e3f9127a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:34.786050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-45dce551-1c4c-4660-8977-d2e3f9127a95 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:34.787313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-45dce551-1c4c-4660-8977-d2e3f9127a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:34.800061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a0136-1bdd-4c2b-812c-5cae82418ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:34.801547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a0136-1bdd-4c2b-812c-5cae82418ceb None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:34.862756 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:34.893415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 377/749] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:06:34.895648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b07cd-1a91-467a-b16b-7bbfa7fe329a None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:34.895926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b07cd-1a91-467a-b16b-7bbfa7fe329a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:34.896192 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b07cd-1a91-467a-b16b-7bbfa7fe329a None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:34.898211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 378/750] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:34.903644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aeaa53-0db7-4ff5-ba18-69951d049d3b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:34.904091 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aeaa53-0db7-4ff5-ba18-69951d049d3b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:34.904463 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aeaa53-0db7-4ff5-ba18-69951d049d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:34.932044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 373/751] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 11:06:34.933301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a0136-1bdd-4c2b-812c-5cae82418ceb None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:34.945699 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d5aeaa53-0db7-4ff5-ba18-69951d049d3b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:34.947490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d5aeaa53-0db7-4ff5-ba18-69951d049d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:34.953332 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:35.039295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 379/752] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:06:35.040474 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aeaa53-0db7-4ff5-ba18-69951d049d3b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:35.067013 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a0136-1bdd-4c2b-812c-5cae82418ceb None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:35.110328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a18a1b-f2cc-48c4-aedd-d16dde740af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:35.111436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a18a1b-f2cc-48c4-aedd-d16dde740af5 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:35.111932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a18a1b-f2cc-48c4-aedd-d16dde740af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:35.112332 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a18a1b-f2cc-48c4-aedd-d16dde740af5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:35.113091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a18a1b-f2cc-48c4-aedd-d16dde740af5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:35.114718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a18a1b-f2cc-48c4-aedd-d16dde740af5 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-a2a18a1b-f2cc-48c4-aedd-d16dde740af5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:35.126289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:35.127546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:35.129167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:35.129167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:35.129167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:35.129167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:35.129167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:35.129167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:35.129167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:35.129167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:35.129167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:35.129167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:35.129167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:35.129167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:35.129167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:06:35.129167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:35.131579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 374/753] 10.222.0.15 () {56 vars in 1129 bytes} [Tue Aug 9 11:06:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:35.132551 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a18a1b-f2cc-48c4-aedd-d16dde740af5 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:35.186333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aeaa53-0db7-4ff5-ba18-69951d049d3b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:35.201335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:35.225404 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a52d-5478-440a-8fdc-c1589f61b2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:35.226372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a52d-5478-440a-8fdc-c1589f61b2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:35.226879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a52d-5478-440a-8fdc-c1589f61b2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:35.227317 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a52d-5478-440a-8fdc-c1589f61b2f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:35.238376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411a52d-5478-440a-8fdc-c1589f61b2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:35.240108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411a52d-5478-440a-8fdc-c1589f61b2f4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:35.247537 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-8411a52d-5478-440a-8fdc-c1589f61b2f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:35.258393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:35.259426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:35.260311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:35.260311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:35.260311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:35.262711 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 380/754] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:35.263937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a52d-5478-440a-8fdc-c1589f61b2f4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:35.271793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a18a1b-f2cc-48c4-aedd-d16dde740af5 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:35.315199 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af23d7c-f9be-41ba-a2bf-6b5194b64fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:35.315842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af23d7c-f9be-41ba-a2bf-6b5194b64fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:35.316119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af23d7c-f9be-41ba-a2bf-6b5194b64fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:35.316391 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af23d7c-f9be-41ba-a2bf-6b5194b64fd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:35.330075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af23d7c-f9be-41ba-a2bf-6b5194b64fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-3af23d7c-f9be-41ba-a2bf-6b5194b64fd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:35.336521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:35.337491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:35.338403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:35.338403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:35.338403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:35.338403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:35.338403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:35.338403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:35.338403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:35.338403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:35.338403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:35.338403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:35.338403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:06:35.338403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:35.341698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 375/755] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:06:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:35.342937 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af23d7c-f9be-41ba-a2bf-6b5194b64fd3 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:35.383471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a52d-5478-440a-8fdc-c1589f61b2f4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:35.421710 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8237d-ec93-4990-9bb5-c0120a667de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:35.422884 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8237d-ec93-4990-9bb5-c0120a667de9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:35.423360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8237d-ec93-4990-9bb5-c0120a667de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:35.423877 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8237d-ec93-4990-9bb5-c0120a667de9 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:35.424741 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8237d-ec93-4990-9bb5-c0120a667de9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:35.425305 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8237d-ec93-4990-9bb5-c0120a667de9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:35.427294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8237d-ec93-4990-9bb5-c0120a667de9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:35.439747 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 381/756] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Aug 9 11:06:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:35.441414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8237d-ec93-4990-9bb5-c0120a667de9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:35.476596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:35.488037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af23d7c-f9be-41ba-a2bf-6b5194b64fd3 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:35.532110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce5dbf-bf83-49e7-a1c7-607a729aeb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:35.532723 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce5dbf-bf83-49e7-a1c7-607a729aeb64 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:35.532998 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce5dbf-bf83-49e7-a1c7-607a729aeb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:35.533270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce5dbf-bf83-49e7-a1c7-607a729aeb64 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:35.533985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce5dbf-bf83-49e7-a1c7-607a729aeb64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:35.534287 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce5dbf-bf83-49e7-a1c7-607a729aeb64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:35.536050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce5dbf-bf83-49e7-a1c7-607a729aeb64 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:35.547258 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:35.551430 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 376/757] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:35.552759 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce5dbf-bf83-49e7-a1c7-607a729aeb64 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:35.565560 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8237d-ec93-4990-9bb5-c0120a667de9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:35.602660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79220510-8367-49ff-a93a-071a01ada745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:35.603625 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79220510-8367-49ff-a93a-071a01ada745 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:35.604121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79220510-8367-49ff-a93a-071a01ada745 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:35.604664 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79220510-8367-49ff-a93a-071a01ada745 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:35.605676 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79220510-8367-49ff-a93a-071a01ada745 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:35.606277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79220510-8367-49ff-a93a-071a01ada745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:35.607841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79220510-8367-49ff-a93a-071a01ada745 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:35.618405 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 382/758] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:06:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:35.619675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79220510-8367-49ff-a93a-071a01ada745 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:35.668921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce5dbf-bf83-49e7-a1c7-607a729aeb64 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:35.703742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f44407-c062-4079-a706-b3efdcbedb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:35.704363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f44407-c062-4079-a706-b3efdcbedb81 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:35.704666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f44407-c062-4079-a706-b3efdcbedb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:35.705212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f44407-c062-4079-a706-b3efdcbedb81 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:35.705578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f44407-c062-4079-a706-b3efdcbedb81 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:35.705923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f44407-c062-4079-a706-b3efdcbedb81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:35.707313 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f44407-c062-4079-a706-b3efdcbedb81 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:35.718228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 377/759] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Aug 9 11:06:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:35.718228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f44407-c062-4079-a706-b3efdcbedb81 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:35.726109 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:35.739063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79220510-8367-49ff-a93a-071a01ada745 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:35.778642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb9331-209c-4cc3-98eb-ca2a8ce3c1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:35.780009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:35.780298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb9331-209c-4cc3-98eb-ca2a8ce3c1da None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:35.781401 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb9331-209c-4cc3-98eb-ca2a8ce3c1da None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:35.781961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb9331-209c-4cc3-98eb-ca2a8ce3c1da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:35.791452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb9331-209c-4cc3-98eb-ca2a8ce3c1da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:35.793313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb9331-209c-4cc3-98eb-ca2a8ce3c1da None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:35.806619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-63eb9331-209c-4cc3-98eb-ca2a8ce3c1da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:35.806619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:35.806619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:35.806619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:35.806619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:35.806619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:35.806619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:35.806619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:35.806619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:35.806619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:35.806619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:35.806619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:35.806619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:35.806619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:35.806619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:35.807590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:35.808475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:35.808475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:35.808475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:35.808475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:35.808475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:35.808475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:35.808475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:35.808475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:35.811144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 383/760] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:35.812390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb9331-209c-4cc3-98eb-ca2a8ce3c1da None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:35.826835 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f44407-c062-4079-a706-b3efdcbedb81 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:35.877658 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a4b53-3d61-4bb9-a7cd-62d3a8d24d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:35.879432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a4b53-3d61-4bb9-a7cd-62d3a8d24d2d None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:35.879904 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a4b53-3d61-4bb9-a7cd-62d3a8d24d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:35.880409 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a4b53-3d61-4bb9-a7cd-62d3a8d24d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:35.896062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a4b53-3d61-4bb9-a7cd-62d3a8d24d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:35.898512 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a4b53-3d61-4bb9-a7cd-62d3a8d24d2d None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-a44a4b53-3d61-4bb9-a7cd-62d3a8d24d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:35.916764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:35.918134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:35.919340 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:35.919340 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:35.919340 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:35.922781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 378/761] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:35.923743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a4b53-3d61-4bb9-a7cd-62d3a8d24d2d None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:35.941358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb9331-209c-4cc3-98eb-ca2a8ce3c1da None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:35.979851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d7cdc-2456-42a2-bb1c-72bb363d9db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:35.980849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d7cdc-2456-42a2-bb1c-72bb363d9db1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:35.981346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d7cdc-2456-42a2-bb1c-72bb363d9db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:35.981841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d7cdc-2456-42a2-bb1c-72bb363d9db1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:35.982838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d7cdc-2456-42a2-bb1c-72bb363d9db1 None admin] RBAC: Adding query filter params (interface=public, service_id=68bf0a6704084dcbaa9e7ac252c0de9c, region_id=RegionOne) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:35.983419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d7cdc-2456-42a2-bb1c-72bb363d9db1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:35.985166 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d7cdc-2456-42a2-bb1c-72bb363d9db1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:35.998915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 384/762] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Aug 9 11:06:35 2022] GET /identity/v3/endpoints?service_id=68bf0a6704084dcbaa9e7ac252c0de9c&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:36.000248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d7cdc-2456-42a2-bb1c-72bb363d9db1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:36.018541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:36.029550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a4b53-3d61-4bb9-a7cd-62d3a8d24d2d None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:36.046400 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:36.065308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3fc8b-0b1e-49c4-a07b-6b01fd57ceab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:36.065949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3fc8b-0b1e-49c4-a07b-6b01fd57ceab None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:36.066226 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3fc8b-0b1e-49c4-a07b-6b01fd57ceab None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:36.066531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3fc8b-0b1e-49c4-a07b-6b01fd57ceab None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:36.067181 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3fc8b-0b1e-49c4-a07b-6b01fd57ceab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:36.067484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3fc8b-0b1e-49c4-a07b-6b01fd57ceab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:36.068925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3fc8b-0b1e-49c4-a07b-6b01fd57ceab None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:36.081569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 379/763] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:36.082375 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3fc8b-0b1e-49c4-a07b-6b01fd57ceab None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:36.119108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d7cdc-2456-42a2-bb1c-72bb363d9db1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:36.156657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af7eed-4137-4b65-9835-6c77af327c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:36.157776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af7eed-4137-4b65-9835-6c77af327c64 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:36.158246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af7eed-4137-4b65-9835-6c77af327c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:36.158703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af7eed-4137-4b65-9835-6c77af327c64 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:36.159540 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af7eed-4137-4b65-9835-6c77af327c64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:36.160133 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af7eed-4137-4b65-9835-6c77af327c64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:36.161831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af7eed-4137-4b65-9835-6c77af327c64 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:36.176134 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 385/764] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:36.177421 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af7eed-4137-4b65-9835-6c77af327c64 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:36.192546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3fc8b-0b1e-49c4-a07b-6b01fd57ceab None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:36.228264 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4069f9-9875-4d1c-9d05-33c275594792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:36.228981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4069f9-9875-4d1c-9d05-33c275594792 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:36.229155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4069f9-9875-4d1c-9d05-33c275594792 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:36.229415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4069f9-9875-4d1c-9d05-33c275594792 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:36.230055 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4069f9-9875-4d1c-9d05-33c275594792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:36.231457 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4069f9-9875-4d1c-9d05-33c275594792 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:36.245656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 380/765] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Aug 9 11:06:36 2022] GET /identity/v3/services => generated 772 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:36.245656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4069f9-9875-4d1c-9d05-33c275594792 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:36.288617 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:36.290199 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:36.329436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af7eed-4137-4b65-9835-6c77af327c64 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:36.351366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4069f9-9875-4d1c-9d05-33c275594792 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:36.371211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54f407-3675-4c7f-b54e-1f952713f97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:36.372348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54f407-3675-4c7f-b54e-1f952713f97f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:36.372873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54f407-3675-4c7f-b54e-1f952713f97f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:36.373333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54f407-3675-4c7f-b54e-1f952713f97f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:36.374438 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54f407-3675-4c7f-b54e-1f952713f97f None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=557b8757098e4777965d782d1ce5f97b) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:36.374983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54f407-3675-4c7f-b54e-1f952713f97f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:36.376742 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54f407-3675-4c7f-b54e-1f952713f97f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:36.384688 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 386/766] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:36 2022] GET /identity/v3/role_assignments?user.id=557b8757098e4777965d782d1ce5f97b&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:36.386762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a0483-9656-497b-a629-99952ca0968b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:36.387366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a0483-9656-497b-a629-99952ca0968b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:36.387836 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a0483-9656-497b-a629-99952ca0968b None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:36.390182 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 387/767] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:36.396372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3a113-08f2-4034-b18b-a5b25847254a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:36.397312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3a113-08f2-4034-b18b-a5b25847254a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:36.399451 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3a113-08f2-4034-b18b-a5b25847254a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:36.412474 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d515785-7ad7-49fa-8145-36868edfe7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:36.413582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d515785-7ad7-49fa-8145-36868edfe7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:36.414145 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d515785-7ad7-49fa-8145-36868edfe7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:36.414604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d515785-7ad7-49fa-8145-36868edfe7a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:36.425603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d515785-7ad7-49fa-8145-36868edfe7a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:36.426494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a6c3a113-08f2-4034-b18b-a5b25847254a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:36.427196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d515785-7ad7-49fa-8145-36868edfe7a5 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:36.428298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a6c3a113-08f2-4034-b18b-a5b25847254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-1d515785-7ad7-49fa-8145-36868edfe7a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:36.441107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:36.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:36.443912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:36.443912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:36.443912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:36.443912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:36.443912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:36.443912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:36.443912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:36.443912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:36.443912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:06:36.443912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:36.443912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 381/768] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Aug 9 11:06:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:36.448684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d515785-7ad7-49fa-8145-36868edfe7a5 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:36.519285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 388/769] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:36.545288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3a113-08f2-4034-b18b-a5b25847254a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:36.574684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:36.580110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d515785-7ad7-49fa-8145-36868edfe7a5 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:36.619958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a110f4-c230-464e-ab71-2b280a130d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:36.620912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a110f4-c230-464e-ab71-2b280a130d9e None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:36.621288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:36.622019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a110f4-c230-464e-ab71-2b280a130d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:36.622550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a110f4-c230-464e-ab71-2b280a130d9e None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:36.623517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a110f4-c230-464e-ab71-2b280a130d9e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:36.624041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a110f4-c230-464e-ab71-2b280a130d9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:36.625927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a110f4-c230-464e-ab71-2b280a130d9e None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:36.646718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 382/770] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Aug 9 11:06:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:36.653827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a110f4-c230-464e-ab71-2b280a130d9e None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:36.659944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3a113-08f2-4034-b18b-a5b25847254a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:36.698309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a2041-9a2f-4460-b1e8-e6348dd9c93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:36.698956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a2041-9a2f-4460-b1e8-e6348dd9c93d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:36.699225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a2041-9a2f-4460-b1e8-e6348dd9c93d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:36.699488 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a2041-9a2f-4460-b1e8-e6348dd9c93d None admin] PATH_INFO: `/v3/services/network` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:36.700069 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a2041-9a2f-4460-b1e8-e6348dd9c93d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:36.701748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a2041-9a2f-4460-b1e8-e6348dd9c93d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-ea2a2041-9a2f-4460-b1e8-e6348dd9c93d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:36.711083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:36.712146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:36.712990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:36.712990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:36.712990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:36.712990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:36.712990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:36.712990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:36.712990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:36.712990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:36.712990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:36.712990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:36.712990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:36.712990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:36.712990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:06:36.712990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:36.717768 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 389/771] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:36 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:36.718716 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a2041-9a2f-4460-b1e8-e6348dd9c93d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:36.769604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a110f4-c230-464e-ab71-2b280a130d9e None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:36.807630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782fa01-e129-47f5-af57-48744f40438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:36.808648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782fa01-e129-47f5-af57-48744f40438c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:36.809124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782fa01-e129-47f5-af57-48744f40438c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:36.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782fa01-e129-47f5-af57-48744f40438c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:36.820776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782fa01-e129-47f5-af57-48744f40438c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:36.822623 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782fa01-e129-47f5-af57-48744f40438c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:36.825768 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a2041-9a2f-4460-b1e8-e6348dd9c93d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-7782fa01-e129-47f5-af57-48744f40438c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:36.838452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:36.839473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:36.840390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:36.840390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:36.840390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:36.842584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 383/772] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:36.848745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782fa01-e129-47f5-af57-48744f40438c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:36.857674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:36.864369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130179f8-393f-481f-a4bb-1b2a53195331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:36.865591 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:36.865945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130179f8-393f-481f-a4bb-1b2a53195331 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:36.866238 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130179f8-393f-481f-a4bb-1b2a53195331 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:36.866508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130179f8-393f-481f-a4bb-1b2a53195331 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:36.867202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130179f8-393f-481f-a4bb-1b2a53195331 None admin] RBAC: Adding query filter params (name=network) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:36.867842 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130179f8-393f-481f-a4bb-1b2a53195331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:36.869370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130179f8-393f-481f-a4bb-1b2a53195331 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:36.880762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 390/773] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Aug 9 11:06:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:36.882148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979adf33-ce59-4b46-94dc-4540ca4867f2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:36.882422 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979adf33-ce59-4b46-94dc-4540ca4867f2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:36.882710 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979adf33-ce59-4b46-94dc-4540ca4867f2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:36.884820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 391/774] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:36.886014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979adf33-ce59-4b46-94dc-4540ca4867f2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:36.963278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782fa01-e129-47f5-af57-48744f40438c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:36.999065 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea987ec-2a0b-479f-a353-3e76d6067f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:37.000035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea987ec-2a0b-479f-a353-3e76d6067f29 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:37.000511 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea987ec-2a0b-479f-a353-3e76d6067f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:37.001002 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea987ec-2a0b-479f-a353-3e76d6067f29 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:37.002069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea987ec-2a0b-479f-a353-3e76d6067f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:37.002638 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea987ec-2a0b-479f-a353-3e76d6067f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:37.003018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979adf33-ce59-4b46-94dc-4540ca4867f2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:37.004789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea987ec-2a0b-479f-a353-3e76d6067f29 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:37.021762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 384/775] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:37.023480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32942a7c-f37c-445d-a4ec-4598f29aee69 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:37.023947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32942a7c-f37c-445d-a4ec-4598f29aee69 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:37.024390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32942a7c-f37c-445d-a4ec-4598f29aee69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:37.041251 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32901e50-7b6c-49f9-b581-35e86bb93981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:37.042038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32901e50-7b6c-49f9-b581-35e86bb93981 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:37.042415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32901e50-7b6c-49f9-b581-35e86bb93981 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:37.042765 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32901e50-7b6c-49f9-b581-35e86bb93981 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:37.043508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32901e50-7b6c-49f9-b581-35e86bb93981 None admin] RBAC: Adding query filter params (type=network) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:37.043868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32901e50-7b6c-49f9-b581-35e86bb93981 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:37.045094 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-32942a7c-f37c-445d-a4ec-4598f29aee69 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:37.045553 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32901e50-7b6c-49f9-b581-35e86bb93981 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:37.046735 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-32942a7c-f37c-445d-a4ec-4598f29aee69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:37.056724 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 392/776] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Aug 9 11:06:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:37.058168 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32901e50-7b6c-49f9-b581-35e86bb93981 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:37.116583 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:37.122586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 385/777] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:37.123426 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32942a7c-f37c-445d-a4ec-4598f29aee69 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:37.127142 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:37.174987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32901e50-7b6c-49f9-b581-35e86bb93981 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:37.214073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf033f-6f6a-45ae-8853-73a33fd9366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:37.215090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf033f-6f6a-45ae-8853-73a33fd9366c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:37.215552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf033f-6f6a-45ae-8853-73a33fd9366c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:37.216052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf033f-6f6a-45ae-8853-73a33fd9366c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:37.224127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf033f-6f6a-45ae-8853-73a33fd9366c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:37.226123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf033f-6f6a-45ae-8853-73a33fd9366c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:37.231602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32942a7c-f37c-445d-a4ec-4598f29aee69 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:37.239068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-1baf033f-6f6a-45ae-8853-73a33fd9366c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:37.239068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:37.239068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:37.239068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:37.239068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:37.239068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:37.239068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:37.239068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:37.239068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:37.239068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:37.239068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:37.239068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:37.239068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:37.239068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:37.239068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:37.239986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:37.240873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:37.240873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:37.240873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:37.240873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:37.240873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:37.240873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:37.240873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:37.240873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:37.243661 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 393/778] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:37.244725 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf033f-6f6a-45ae-8853-73a33fd9366c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:37.279318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ade2e6-32b3-4765-a953-148d2b50f3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:37.279940 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ade2e6-32b3-4765-a953-148d2b50f3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:37.280215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ade2e6-32b3-4765-a953-148d2b50f3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:37.280499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ade2e6-32b3-4765-a953-148d2b50f3f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:37.281197 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ade2e6-32b3-4765-a953-148d2b50f3f1 None admin] RBAC: Adding query filter params (interface=public, service_id=0b8c960a87254edfa68e382c0e04bd42, region_id=RegionOne) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:37.281505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ade2e6-32b3-4765-a953-148d2b50f3f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:37.282932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ade2e6-32b3-4765-a953-148d2b50f3f1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:37.295674 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 386/779] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Aug 9 11:06:37 2022] GET /identity/v3/endpoints?service_id=0b8c960a87254edfa68e382c0e04bd42&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:37.295674 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ade2e6-32b3-4765-a953-148d2b50f3f1 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:37.357394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:37.372340 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf033f-6f6a-45ae-8853-73a33fd9366c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:37.395286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:37.401230 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ade2e6-32b3-4765-a953-148d2b50f3f1 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:37.412728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a8671-a901-4ba2-b18f-f7e80d31c868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:37.413734 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a8671-a901-4ba2-b18f-f7e80d31c868 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:37.414284 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a8671-a901-4ba2-b18f-f7e80d31c868 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:37.414764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a8671-a901-4ba2-b18f-f7e80d31c868 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:37.426544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a8671-a901-4ba2-b18f-f7e80d31c868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-de2a8671-a901-4ba2-b18f-f7e80d31c868 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:37.432436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:37.433368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:37.434548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:37.434548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:37.434548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:37.434548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:37.434548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:37.434548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:37.434548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:37.434548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:37.434548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:37.434548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:37.434548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:37.434548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:37.437007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6f983-0568-42a3-928f-ed8cf5f5e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:37.437135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 394/780] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:37.437650 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6f983-0568-42a3-928f-ed8cf5f5e4fc None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:37.437904 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6f983-0568-42a3-928f-ed8cf5f5e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:37.438174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6f983-0568-42a3-928f-ed8cf5f5e4fc None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:37.438815 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a8671-a901-4ba2-b18f-f7e80d31c868 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:37.438918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6f983-0568-42a3-928f-ed8cf5f5e4fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:37.439157 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6f983-0568-42a3-928f-ed8cf5f5e4fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:37.440713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6f983-0568-42a3-928f-ed8cf5f5e4fc None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:37.460771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 387/781] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:37.461999 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6f983-0568-42a3-928f-ed8cf5f5e4fc None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:37.554182 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a8671-a901-4ba2-b18f-f7e80d31c868 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:37.563331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6f983-0568-42a3-928f-ed8cf5f5e4fc None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:37.588223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:37.598389 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad993d-504f-4711-b43e-f210ed598931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:37.599370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad993d-504f-4711-b43e-f210ed598931 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:37.599834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad993d-504f-4711-b43e-f210ed598931 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:37.600310 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad993d-504f-4711-b43e-f210ed598931 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:37.600540 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e0934-1dd2-4e3d-b667-2428b993e358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:37.601153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e0934-1dd2-4e3d-b667-2428b993e358 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:37.601455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e0934-1dd2-4e3d-b667-2428b993e358 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:37.601754 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e0934-1dd2-4e3d-b667-2428b993e358 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:37.601993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad993d-504f-4711-b43e-f210ed598931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:37.602421 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e0934-1dd2-4e3d-b667-2428b993e358 None admin] RBAC: Adding query filter params (name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:37.602721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e0934-1dd2-4e3d-b667-2428b993e358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:37.603965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad993d-504f-4711-b43e-f210ed598931 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:37.604138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e0934-1dd2-4e3d-b667-2428b993e358 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:37.616492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 388/783] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:37.616492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e0934-1dd2-4e3d-b667-2428b993e358 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:37.617116 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 395/783] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Aug 9 11:06:37 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:37.618612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad993d-504f-4711-b43e-f210ed598931 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:37.684932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:37.754495 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad993d-504f-4711-b43e-f210ed598931 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:37.792643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e0934-1dd2-4e3d-b667-2428b993e358 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:37.796396 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41fd22-b825-42da-8377-3ea857e3dccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:37.797475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41fd22-b825-42da-8377-3ea857e3dccc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:37.797475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41fd22-b825-42da-8377-3ea857e3dccc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:37.797921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41fd22-b825-42da-8377-3ea857e3dccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:37.810476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41fd22-b825-42da-8377-3ea857e3dccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:37.812097 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41fd22-b825-42da-8377-3ea857e3dccc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-9f41fd22-b825-42da-8377-3ea857e3dccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:37.828311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:37.829529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:37.830671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:37.830671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:37.830671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:37.831872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 396/784] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:37.840758 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41fd22-b825-42da-8377-3ea857e3dccc None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:37.851187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38e881-2064-4199-95b5-c05e179cc356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:37.852324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38e881-2064-4199-95b5-c05e179cc356 None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:37.852822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38e881-2064-4199-95b5-c05e179cc356 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:37.853326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38e881-2064-4199-95b5-c05e179cc356 None admin] PATH_INFO: `/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/881030d7605b40879762d1c199362ee1/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:37.855623 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38e881-2064-4199-95b5-c05e179cc356 None admin] RBAC: Authorizing `identity:create_grant(project_id=166e5328bfae434ba19d12be2eaa7a1b, user_id=881030d7605b40879762d1c199362ee1, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:37.857345 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38e881-2064-4199-95b5-c05e179cc356 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:37.880853 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 389/785] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:06:37 2022] PUT /identity/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/881030d7605b40879762d1c199362ee1/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:06:38.019139 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:38.026740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41fd22-b825-42da-8377-3ea857e3dccc None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:38.076113 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfdf24-0f12-4500-b1c9-84c722663916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:38.076751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfdf24-0f12-4500-b1c9-84c722663916 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:38.077022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfdf24-0f12-4500-b1c9-84c722663916 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:38.077286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfdf24-0f12-4500-b1c9-84c722663916 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:38.077973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfdf24-0f12-4500-b1c9-84c722663916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:38.078269 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfdf24-0f12-4500-b1c9-84c722663916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:38.079670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfdf24-0f12-4500-b1c9-84c722663916 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:38.101903 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 397/786] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:38.107242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38e881-2064-4199-95b5-c05e179cc356 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:38.158674 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:38.219125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38e881-2064-4199-95b5-c05e179cc356 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:38.255412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0327-0488-456d-904f-eae3ec0ea5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:38.256059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0327-0488-456d-904f-eae3ec0ea5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:38.256335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0327-0488-456d-904f-eae3ec0ea5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:38.256604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0327-0488-456d-904f-eae3ec0ea5c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:38.265120 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b0327-0488-456d-904f-eae3ec0ea5c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:38.266647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b0327-0488-456d-904f-eae3ec0ea5c4 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-9c7b0327-0488-456d-904f-eae3ec0ea5c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:38.278651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:38.279614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:38.281066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:38.281066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:38.281066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:38.281066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:38.281066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:38.281066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:38.281066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:38.281066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:38.281066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:06:38.281066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:38.281066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 390/787] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Aug 9 11:06:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:38.285780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfdf24-0f12-4500-b1c9-84c722663916 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:38.421181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfdf24-0f12-4500-b1c9-84c722663916 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:38.471897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44fa65-9393-4ffe-ab95-eba6873c7237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:38.472857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44fa65-9393-4ffe-ab95-eba6873c7237 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:38.473316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44fa65-9393-4ffe-ab95-eba6873c7237 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:38.473778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44fa65-9393-4ffe-ab95-eba6873c7237 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:38.474672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44fa65-9393-4ffe-ab95-eba6873c7237 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:38.475143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44fa65-9393-4ffe-ab95-eba6873c7237 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:38.476854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44fa65-9393-4ffe-ab95-eba6873c7237 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:38.505277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 398/788] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Aug 9 11:06:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:38.511191 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0327-0488-456d-904f-eae3ec0ea5c4 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:38.633968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0327-0488-456d-904f-eae3ec0ea5c4 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:38.643652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:38.670087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635e1b9-cd60-4f35-9e0c-1c2a67edadbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:38.670720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635e1b9-cd60-4f35-9e0c-1c2a67edadbe None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:38.670992 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635e1b9-cd60-4f35-9e0c-1c2a67edadbe None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:38.671261 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635e1b9-cd60-4f35-9e0c-1c2a67edadbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:38.683603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635e1b9-cd60-4f35-9e0c-1c2a67edadbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:38.685225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635e1b9-cd60-4f35-9e0c-1c2a67edadbe None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-5635e1b9-cd60-4f35-9e0c-1c2a67edadbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:38.700111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:38.701192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:38.702698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:38.702698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:38.702698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:38.702698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 391/789] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:38.706875 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44fa65-9393-4ffe-ab95-eba6873c7237 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:38.727354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b3338-f39c-49e1-a5fe-7f9e4a1865fd None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:38.728323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b3338-f39c-49e1-a5fe-7f9e4a1865fd None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:38.728605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b3338-f39c-49e1-a5fe-7f9e4a1865fd None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:38.730973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 392/790] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:38.734218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:38.737167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448934e-b0ea-4cf1-a2a7-42f6a4d769ae None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:38.738502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448934e-b0ea-4cf1-a2a7-42f6a4d769ae None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:38.738502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448934e-b0ea-4cf1-a2a7-42f6a4d769ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:38.763557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-4448934e-b0ea-4cf1-a2a7-42f6a4d769ae None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:38.765142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-4448934e-b0ea-4cf1-a2a7-42f6a4d769ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:38.842584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 393/791] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Aug 09 11:06:38.866613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448934e-b0ea-4cf1-a2a7-42f6a4d769ae None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:38.898929 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44fa65-9393-4ffe-ab95-eba6873c7237 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:38.933791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b937a6-eb7b-43d1-bb9a-22504de49f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:38.934429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b937a6-eb7b-43d1-bb9a-22504de49f02 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:38.934680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b937a6-eb7b-43d1-bb9a-22504de49f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:38.934981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b937a6-eb7b-43d1-bb9a-22504de49f02 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:38.935608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b937a6-eb7b-43d1-bb9a-22504de49f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:38.935907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b937a6-eb7b-43d1-bb9a-22504de49f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:38.937301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b937a6-eb7b-43d1-bb9a-22504de49f02 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:38.949525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 399/792] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:38.950813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866be61-9a61-4c42-ad80-c1fbd5c733cc None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:38.951097 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866be61-9a61-4c42-ad80-c1fbd5c733cc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:38.951384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866be61-9a61-4c42-ad80-c1fbd5c733cc None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:38.952863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 400/793] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:38.957865 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866be61-9a61-4c42-ad80-c1fbd5c733cc None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:38.968067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:38.978373 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448934e-b0ea-4cf1-a2a7-42f6a4d769ae None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:39.015739 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e886c-a9d1-43aa-ad92-a49321301dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:39.016830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e886c-a9d1-43aa-ad92-a49321301dee None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:39.017439 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e886c-a9d1-43aa-ad92-a49321301dee None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:39.017931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e886c-a9d1-43aa-ad92-a49321301dee None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:39.018720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e886c-a9d1-43aa-ad92-a49321301dee None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:39.020519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e886c-a9d1-43aa-ad92-a49321301dee None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-fc5e886c-a9d1-43aa-ad92-a49321301dee None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:39.030322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:39.031367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:39.032259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:39.032259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:39.032259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:39.032259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:39.032259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:39.032259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:39.032259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:39.032259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:39.032259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:39.032259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:39.032259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:39.032259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:39.032259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 11:06:39.032259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:39.039916 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 394/794] 10.222.0.15 () {56 vars in 1129 bytes} [Tue Aug 9 11:06:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:39.040522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:39.043016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf62428-8e32-4794-9e79-7f4dae19f57c None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:39.046027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf62428-8e32-4794-9e79-7f4dae19f57c None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:39.046027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf62428-8e32-4794-9e79-7f4dae19f57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:39.064314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866be61-9a61-4c42-ad80-c1fbd5c733cc None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:39.065194 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-5cf62428-8e32-4794-9e79-7f4dae19f57c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:39.066830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5cf62428-8e32-4794-9e79-7f4dae19f57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:39.100589 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024ef8b-1a0e-4597-8f50-04097f9bfd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:39.101231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024ef8b-1a0e-4597-8f50-04097f9bfd2f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:39.101572 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024ef8b-1a0e-4597-8f50-04097f9bfd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:39.101882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024ef8b-1a0e-4597-8f50-04097f9bfd2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:39.109074 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024ef8b-1a0e-4597-8f50-04097f9bfd2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:39.110572 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024ef8b-1a0e-4597-8f50-04097f9bfd2f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:39.122977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-9024ef8b-1a0e-4597-8f50-04097f9bfd2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:39.122977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:39.122977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:39.122977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:39.122977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:39.122977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:39.122977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:39.122977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:39.122977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:39.122977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:39.122977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:39.122977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:39.122977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:39.122977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:39.122977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:39.123945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:39.124880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:39.124880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:39.124880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:39.124880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:39.124880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:39.124880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:39.124880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:39.124880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:39.124880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 401/795] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:39.125387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024ef8b-1a0e-4597-8f50-04097f9bfd2f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:39.144244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 395/796] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:39.145526 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf62428-8e32-4794-9e79-7f4dae19f57c None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:39.237583 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:39.260150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf62428-8e32-4794-9e79-7f4dae19f57c None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:39.263654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024ef8b-1a0e-4597-8f50-04097f9bfd2f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:39.298117 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffdbd6-2ee5-4567-82fe-ae3d02649cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:39.298879 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffdbd6-2ee5-4567-82fe-ae3d02649cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:39.299254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffdbd6-2ee5-4567-82fe-ae3d02649cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:39.299639 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffdbd6-2ee5-4567-82fe-ae3d02649cc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:39.300434 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffdbd6-2ee5-4567-82fe-ae3d02649cc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:39.300669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efe7b9-9228-46cd-98cd-056b453f6e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:39.300919 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffdbd6-2ee5-4567-82fe-ae3d02649cc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:39.301586 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efe7b9-9228-46cd-98cd-056b453f6e00 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:39.302015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efe7b9-9228-46cd-98cd-056b453f6e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:39.302426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efe7b9-9228-46cd-98cd-056b453f6e00 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:39.302749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffdbd6-2ee5-4567-82fe-ae3d02649cc0 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:39.303335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efe7b9-9228-46cd-98cd-056b453f6e00 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:39.303794 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efe7b9-9228-46cd-98cd-056b453f6e00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:39.305456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efe7b9-9228-46cd-98cd-056b453f6e00 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:39.306899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:39.311547 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 402/797] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Aug 9 11:06:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:39.312580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efe7b9-9228-46cd-98cd-056b453f6e00 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:39.323419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 396/798] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:39.324442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffdbd6-2ee5-4567-82fe-ae3d02649cc0 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:39.419869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efe7b9-9228-46cd-98cd-056b453f6e00 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:39.431076 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffdbd6-2ee5-4567-82fe-ae3d02649cc0 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:39.456106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c01d66-bf6a-4c24-bee3-978aedc3d9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:39.457089 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c01d66-bf6a-4c24-bee3-978aedc3d9af None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:39.457574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c01d66-bf6a-4c24-bee3-978aedc3d9af None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:39.458041 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c01d66-bf6a-4c24-bee3-978aedc3d9af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:39.469259 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c01d66-bf6a-4c24-bee3-978aedc3d9af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:39.470431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429b99d-b261-450b-bc8b-dc906d089cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:39.471044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429b99d-b261-450b-bc8b-dc906d089cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:39.471317 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429b99d-b261-450b-bc8b-dc906d089cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:39.471587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429b99d-b261-450b-bc8b-dc906d089cf1 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:39.472224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429b99d-b261-450b-bc8b-dc906d089cf1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:39.472655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429b99d-b261-450b-bc8b-dc906d089cf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:39.474078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429b99d-b261-450b-bc8b-dc906d089cf1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-37c01d66-bf6a-4c24-bee3-978aedc3d9af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:39.477420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:39.478414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:39.479369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:39.479369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:39.479369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:39.479369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:39.479369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:39.479369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:39.479369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:39.479369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:39.479369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:39.479369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:39.479369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:06:39.479369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:39.486628 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 397/800] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Aug 9 11:06:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:39.486628 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429b99d-b261-450b-bc8b-dc906d089cf1 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:39.486998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 403/800] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:06:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:39.488127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c01d66-bf6a-4c24-bee3-978aedc3d9af None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:39.495652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:39.553298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:39.598984 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c01d66-bf6a-4c24-bee3-978aedc3d9af None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:39.601222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429b99d-b261-450b-bc8b-dc906d089cf1 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:39.639419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca473350-ab7b-4e81-aae5-f40cdb988248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:39.639795 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970ea32-0945-4ecc-9a5e-b07c3b181278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:39.640470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970ea32-0945-4ecc-9a5e-b07c3b181278 None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:39.640746 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970ea32-0945-4ecc-9a5e-b07c3b181278 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:39.641051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca473350-ab7b-4e81-aae5-f40cdb988248 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:39.641163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970ea32-0945-4ecc-9a5e-b07c3b181278 None admin] PATH_INFO: `/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/345ec6b0da4c4f07a6047190f8b2182d/roles/bcdb152b51e34826a39fc0f8c3d60664` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:39.641657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca473350-ab7b-4e81-aae5-f40cdb988248 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:39.642126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca473350-ab7b-4e81-aae5-f40cdb988248 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:39.642988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca473350-ab7b-4e81-aae5-f40cdb988248 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:39.644809 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca473350-ab7b-4e81-aae5-f40cdb988248 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:39.658805 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970ea32-0945-4ecc-9a5e-b07c3b181278 None admin] RBAC: Authorizing `identity:create_grant(project_id=166e5328bfae434ba19d12be2eaa7a1b, user_id=345ec6b0da4c4f07a6047190f8b2182d, role_id=bcdb152b51e34826a39fc0f8c3d60664)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:39.660926 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970ea32-0945-4ecc-9a5e-b07c3b181278 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:39.673133 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 404/801] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:06:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:06:39.674364 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca473350-ab7b-4e81-aae5-f40cdb988248 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:39.683547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 398/802] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:06:39 2022] PUT /identity/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/345ec6b0da4c4f07a6047190f8b2182d/roles/bcdb152b51e34826a39fc0f8c3d60664 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:06:39.804279 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca473350-ab7b-4e81-aae5-f40cdb988248 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:39.822766 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:39.845080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184024f-dffd-4538-8cf2-de89c1ee7de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:39.845741 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184024f-dffd-4538-8cf2-de89c1ee7de7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:39.846118 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184024f-dffd-4538-8cf2-de89c1ee7de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:39.846400 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184024f-dffd-4538-8cf2-de89c1ee7de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:39.847087 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184024f-dffd-4538-8cf2-de89c1ee7de7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:39.847390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184024f-dffd-4538-8cf2-de89c1ee7de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:39.848811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184024f-dffd-4538-8cf2-de89c1ee7de7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:39.860440 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 405/803] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:06:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:39.866332 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970ea32-0945-4ecc-9a5e-b07c3b181278 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:39.941396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:39.994229 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970ea32-0945-4ecc-9a5e-b07c3b181278 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:40.034353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ccb9d-76c7-48d7-b3dc-7dfe03ea895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:40.035049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ccb9d-76c7-48d7-b3dc-7dfe03ea895d None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:40.035324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ccb9d-76c7-48d7-b3dc-7dfe03ea895d None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:40.035590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ccb9d-76c7-48d7-b3dc-7dfe03ea895d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:40.048126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ccb9d-76c7-48d7-b3dc-7dfe03ea895d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:40.049700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ccb9d-76c7-48d7-b3dc-7dfe03ea895d None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-451ccb9d-76c7-48d7-b3dc-7dfe03ea895d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:40.065335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:40.066405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:40.067326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:40.067326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:40.067326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:40.067326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 399/804] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:40.072988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184024f-dffd-4538-8cf2-de89c1ee7de7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:40.173550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60093c7f-695a-4738-b17a-d8eb67a30423 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:40.174215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60093c7f-695a-4738-b17a-d8eb67a30423 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:40.174713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60093c7f-695a-4738-b17a-d8eb67a30423 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:40.176552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 400/805] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:40.180837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184024f-dffd-4538-8cf2-de89c1ee7de7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:40.183383 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb5376-bece-4da2-805c-11f618548151 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:40.184202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb5376-bece-4da2-805c-11f618548151 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:40.184806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb5376-bece-4da2-805c-11f618548151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:40.205139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-a7cb5376-bece-4da2-805c-11f618548151 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:40.206863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a7cb5376-bece-4da2-805c-11f618548151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:40.220449 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901824e9-813f-4dfe-acd6-0b75fe660dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:40.221082 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901824e9-813f-4dfe-acd6-0b75fe660dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:40.221281 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901824e9-813f-4dfe-acd6-0b75fe660dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:40.221605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901824e9-813f-4dfe-acd6-0b75fe660dc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:40.222278 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901824e9-813f-4dfe-acd6-0b75fe660dc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:40.222713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901824e9-813f-4dfe-acd6-0b75fe660dc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:40.224116 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901824e9-813f-4dfe-acd6-0b75fe660dc1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:40.241841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 406/806] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:40.243374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a1659-90be-4dcc-91f0-f28ee9befa71 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:40.243662 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a1659-90be-4dcc-91f0-f28ee9befa71 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:40.243940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a1659-90be-4dcc-91f0-f28ee9befa71 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:40.245946 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 407/807] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:40.247526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a1659-90be-4dcc-91f0-f28ee9befa71 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:40.283393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:40.289879 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 401/808] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:40.292457 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffc4f7-e5d2-4669-94cb-ab75dace13ef None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:40.292947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffc4f7-e5d2-4669-94cb-ab75dace13ef None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:40.293414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffc4f7-e5d2-4669-94cb-ab75dace13ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:40.331434 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-a5ffc4f7-e5d2-4669-94cb-ab75dace13ef None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:40.333116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a5ffc4f7-e5d2-4669-94cb-ab75dace13ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:40.361789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a1659-90be-4dcc-91f0-f28ee9befa71 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:40.368070 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:40.402730 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e198c6-50fe-4c8a-8be2-0bd096ccea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:40.403281 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e198c6-50fe-4c8a-8be2-0bd096ccea5e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:40.403562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e198c6-50fe-4c8a-8be2-0bd096ccea5e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:40.403834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e198c6-50fe-4c8a-8be2-0bd096ccea5e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:40.411303 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 402/809] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:40.412505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffc4f7-e5d2-4669-94cb-ab75dace13ef None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:40.412776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e198c6-50fe-4c8a-8be2-0bd096ccea5e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:40.414454 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e198c6-50fe-4c8a-8be2-0bd096ccea5e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-20e198c6-50fe-4c8a-8be2-0bd096ccea5e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:40.426774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:40.427791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:40.428743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:40.428743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:40.428743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:40.428743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:40.428743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:40.428743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:40.428743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:40.428743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:40.428743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:06:40.428743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:40.428743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 408/810] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:06:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:40.434172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e198c6-50fe-4c8a-8be2-0bd096ccea5e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:40.525164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffc4f7-e5d2-4669-94cb-ab75dace13ef None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:40.538012 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:40.547689 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e198c6-50fe-4c8a-8be2-0bd096ccea5e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:40.567192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb67452-33ce-473e-9e55-9075e5a67023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:40.568330 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb67452-33ce-473e-9e55-9075e5a67023 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:40.568825 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb67452-33ce-473e-9e55-9075e5a67023 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:40.569294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb67452-33ce-473e-9e55-9075e5a67023 None admin] PATH_INFO: `/v3/services/network` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:40.572279 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb67452-33ce-473e-9e55-9075e5a67023 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:40.574100 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb67452-33ce-473e-9e55-9075e5a67023 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-deb67452-33ce-473e-9e55-9075e5a67023 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:40.584579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:40.586007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:40.587259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:40.587259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:40.587259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:40.587259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:40.587259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:40.587259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:40.587259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:40.587259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:40.587259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:40.587259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:40.587259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:40.587259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:40.587259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 11:06:40.587259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:40.588174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8d179-9329-4d71-9fc7-05708772cd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:40.588786 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8d179-9329-4d71-9fc7-05708772cd37 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:40.589066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8d179-9329-4d71-9fc7-05708772cd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:40.589550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8d179-9329-4d71-9fc7-05708772cd37 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:40.590649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8d179-9329-4d71-9fc7-05708772cd37 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:40.595619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8d179-9329-4d71-9fc7-05708772cd37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:40.595619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8d179-9329-4d71-9fc7-05708772cd37 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:40.596191 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 403/811] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:40 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:40.597284 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb67452-33ce-473e-9e55-9075e5a67023 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:40.617175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 409/812] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Aug 9 11:06:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:40.618229 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8d179-9329-4d71-9fc7-05708772cd37 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:40.632917 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:40.711313 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb67452-33ce-473e-9e55-9075e5a67023 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:40.728933 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8d179-9329-4d71-9fc7-05708772cd37 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:40.749217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3de8e-aa80-468a-9878-bf977dc0a630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:40.750356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3de8e-aa80-468a-9878-bf977dc0a630 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:40.750831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3de8e-aa80-468a-9878-bf977dc0a630 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:40.751290 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3de8e-aa80-468a-9878-bf977dc0a630 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:40.763254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3de8e-aa80-468a-9878-bf977dc0a630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:40.766576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45361a37-aba4-4c05-a919-ff535c2d63fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:40.767194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45361a37-aba4-4c05-a919-ff535c2d63fe None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:40.767471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45361a37-aba4-4c05-a919-ff535c2d63fe None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:40.767743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45361a37-aba4-4c05-a919-ff535c2d63fe None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:40.768376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45361a37-aba4-4c05-a919-ff535c2d63fe None admin] RBAC: Adding query filter params (name=network) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:40.768677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45361a37-aba4-4c05-a919-ff535c2d63fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:40.770083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45361a37-aba4-4c05-a919-ff535c2d63fe None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-faf3de8e-aa80-468a-9878-bf977dc0a630 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:40.770314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:40.771265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:40.772135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:40.772135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:40.772135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:40.772135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:40.772135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:40.772135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:40.772135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:40.772135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:40.772135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:40.772135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:40.772135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:06:40.772135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:40.774947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 404/813] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:06:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:40.776021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3de8e-aa80-468a-9878-bf977dc0a630 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:40.777775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 410/814] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Aug 9 11:06:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:40.780553 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45361a37-aba4-4c05-a919-ff535c2d63fe None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:40.800127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:40.895508 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:40.906585 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3de8e-aa80-468a-9878-bf977dc0a630 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:40.922022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45361a37-aba4-4c05-a919-ff535c2d63fe None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:40.953068 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2c4c0-8728-4094-b477-858647b8fc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:40.954296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2c4c0-8728-4094-b477-858647b8fc28 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:40.955121 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2c4c0-8728-4094-b477-858647b8fc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:40.955826 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2c4c0-8728-4094-b477-858647b8fc28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:40.959665 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191e5ac-f704-4097-bc66-77ce41936c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:40.960371 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191e5ac-f704-4097-bc66-77ce41936c3a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:40.960767 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191e5ac-f704-4097-bc66-77ce41936c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:40.961110 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191e5ac-f704-4097-bc66-77ce41936c3a None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:40.961829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191e5ac-f704-4097-bc66-77ce41936c3a None admin] RBAC: Adding query filter params (type=network) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:40.962195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191e5ac-f704-4097-bc66-77ce41936c3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:40.963701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191e5ac-f704-4097-bc66-77ce41936c3a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:40.969524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2c4c0-8728-4094-b477-858647b8fc28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:40.971255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2c4c0-8728-4094-b477-858647b8fc28 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:40.974149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 411/815] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Aug 9 11:06:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:40.975129 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191e5ac-f704-4097-bc66-77ce41936c3a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-0bc2c4c0-8728-4094-b477-858647b8fc28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:40.992806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:40.993870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:40.994788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:40.994788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:40.994788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:40.997228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 405/816] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:40.998209 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2c4c0-8728-4094-b477-858647b8fc28 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:41.120028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2c4c0-8728-4094-b477-858647b8fc28 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:41.158932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a9253-e25e-4fc2-bd95-f5c7e3574f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:41.159788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a9253-e25e-4fc2-bd95-f5c7e3574f15 None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:41.160222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a9253-e25e-4fc2-bd95-f5c7e3574f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:41.160633 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a9253-e25e-4fc2-bd95-f5c7e3574f15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:41.161456 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a9253-e25e-4fc2-bd95-f5c7e3574f15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:41.163015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a9253-e25e-4fc2-bd95-f5c7e3574f15 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:41.185824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:41.195395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 406/817] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:06:40 2022] POST /identity/v3/endpoints => generated 337 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:06:41.196473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a9253-e25e-4fc2-bd95-f5c7e3574f15 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:41.236750 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:41.295241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191e5ac-f704-4097-bc66-77ce41936c3a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:41.383243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3999031-e3db-4094-a937-44fa4dd38f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:41.384023 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3999031-e3db-4094-a937-44fa4dd38f35 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:41.384374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3999031-e3db-4094-a937-44fa4dd38f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:41.384700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3999031-e3db-4094-a937-44fa4dd38f35 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:41.385754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3999031-e3db-4094-a937-44fa4dd38f35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:41.386123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3999031-e3db-4094-a937-44fa4dd38f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:41.387680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3999031-e3db-4094-a937-44fa4dd38f35 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:41.399806 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 412/818] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:06:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:41.409331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3999031-e3db-4094-a937-44fa4dd38f35 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:41.423748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a9253-e25e-4fc2-bd95-f5c7e3574f15 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:41.486193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa993ec3-6a58-468d-be73-f42eabc91469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:41.487198 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa993ec3-6a58-468d-be73-f42eabc91469 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:41.487619 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa993ec3-6a58-468d-be73-f42eabc91469 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:41.488065 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa993ec3-6a58-468d-be73-f42eabc91469 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:41.488884 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa993ec3-6a58-468d-be73-f42eabc91469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:41.489507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa993ec3-6a58-468d-be73-f42eabc91469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:41.491744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa993ec3-6a58-468d-be73-f42eabc91469 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:41.510786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 407/819] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:41.515594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa993ec3-6a58-468d-be73-f42eabc91469 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:41.604448 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:41.637464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3999031-e3db-4094-a937-44fa4dd38f35 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:41.652999 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa993ec3-6a58-468d-be73-f42eabc91469 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:41.694711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582aad1c-b563-4907-8592-8fe63cfa0a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:41.695988 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582aad1c-b563-4907-8592-8fe63cfa0a86 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:41.696443 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582aad1c-b563-4907-8592-8fe63cfa0a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:41.696884 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582aad1c-b563-4907-8592-8fe63cfa0a86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:41.706351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582aad1c-b563-4907-8592-8fe63cfa0a86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:41.708349 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582aad1c-b563-4907-8592-8fe63cfa0a86 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:41.712107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b2ce5-3671-4d38-8ef5-2b983cc9b95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:41.713267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b2ce5-3671-4d38-8ef5-2b983cc9b95b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:41.713939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b2ce5-3671-4d38-8ef5-2b983cc9b95b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:41.714552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b2ce5-3671-4d38-8ef5-2b983cc9b95b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:41.720120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:41.724214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-582aad1c-b563-4907-8592-8fe63cfa0a86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:41.724214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:41.724214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:41.724214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:41.724214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:41.724214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:41.724214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:41.724214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:41.724214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:41.724214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:41.724214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:41.724214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:41.724214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:41.724214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:41.724214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:41.725196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:41.726353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:41.726353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:41.726353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:41.726353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:41.726353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:41.726353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:41.726353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:41.726353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:41.730406 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 408/820] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:41.739755 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b2ce5-3671-4d38-8ef5-2b983cc9b95b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:41.741229 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b2ce5-3671-4d38-8ef5-2b983cc9b95b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:41.743347 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582aad1c-b563-4907-8592-8fe63cfa0a86 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-705b2ce5-3671-4d38-8ef5-2b983cc9b95b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:41.758147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:41.759209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:41.760121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:41.760121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:41.760121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:41.760121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 413/821] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:41.768252 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b2ce5-3671-4d38-8ef5-2b983cc9b95b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:41.873020 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b2ce5-3671-4d38-8ef5-2b983cc9b95b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:41.909882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05352bb0-aad7-408c-a5da-19a02c40773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:41.910855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05352bb0-aad7-408c-a5da-19a02c40773c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:41.911312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05352bb0-aad7-408c-a5da-19a02c40773c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:41.911757 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05352bb0-aad7-408c-a5da-19a02c40773c None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:41.912585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05352bb0-aad7-408c-a5da-19a02c40773c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:41.913078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05352bb0-aad7-408c-a5da-19a02c40773c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:41.914718 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05352bb0-aad7-408c-a5da-19a02c40773c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:41.922494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582aad1c-b563-4907-8592-8fe63cfa0a86 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:41.928279 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 414/822] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:41.937672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05352bb0-aad7-408c-a5da-19a02c40773c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:41.959661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:41.985345 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c9853-7432-46ce-bb14-c2b9563a2300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:41.986135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c9853-7432-46ce-bb14-c2b9563a2300 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:41.986608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c9853-7432-46ce-bb14-c2b9563a2300 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:41.987060 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c9853-7432-46ce-bb14-c2b9563a2300 None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:41.988313 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c9853-7432-46ce-bb14-c2b9563a2300 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:41.988872 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c9853-7432-46ce-bb14-c2b9563a2300 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:41.991617 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c9853-7432-46ce-bb14-c2b9563a2300 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:41.995251 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:42.014873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 409/823] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:42.022630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c9853-7432-46ce-bb14-c2b9563a2300 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:42.053096 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05352bb0-aad7-408c-a5da-19a02c40773c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:42.090629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5878c-0c6c-4e63-a89e-d7c33a2b901f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:42.091624 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5878c-0c6c-4e63-a89e-d7c33a2b901f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:42.092098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5878c-0c6c-4e63-a89e-d7c33a2b901f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:42.092541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5878c-0c6c-4e63-a89e-d7c33a2b901f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:42.100861 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5878c-0c6c-4e63-a89e-d7c33a2b901f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:42.102652 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5878c-0c6c-4e63-a89e-d7c33a2b901f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-99b5878c-0c6c-4e63-a89e-d7c33a2b901f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:42.114748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:42.115762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:42.116754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:42.116754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:42.116754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:42.116754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:42.116754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:42.116754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:42.116754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:42.116754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:42.116754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:06:42.116754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:42.119481 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 415/824] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Aug 9 11:06:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:42.125171 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5878c-0c6c-4e63-a89e-d7c33a2b901f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:42.145367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c9853-7432-46ce-bb14-c2b9563a2300 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:42.185043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8a77a-f48e-4f96-836b-349aab30f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:42.185980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8a77a-f48e-4f96-836b-349aab30f581 None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:42.186381 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8a77a-f48e-4f96-836b-349aab30f581 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:42.186752 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8a77a-f48e-4f96-836b-349aab30f581 None admin] PATH_INFO: `/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/557b8757098e4777965d782d1ce5f97b/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:42.189045 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8a77a-f48e-4f96-836b-349aab30f581 None admin] RBAC: Authorizing `identity:create_grant(project_id=166e5328bfae434ba19d12be2eaa7a1b, user_id=557b8757098e4777965d782d1ce5f97b, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:42.190732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8a77a-f48e-4f96-836b-349aab30f581 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:42.214005 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 410/825] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:06:42 2022] PUT /identity/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/557b8757098e4777965d782d1ce5f97b/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:06:42.258248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5878c-0c6c-4e63-a89e-d7c33a2b901f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:42.270641 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:42.302160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073dd60-00da-42f1-883c-38bef090e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:42.303210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073dd60-00da-42f1-883c-38bef090e59e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:42.303712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073dd60-00da-42f1-883c-38bef090e59e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:42.304187 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073dd60-00da-42f1-883c-38bef090e59e None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:42.305462 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073dd60-00da-42f1-883c-38bef090e59e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:42.305896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073dd60-00da-42f1-883c-38bef090e59e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:42.307468 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073dd60-00da-42f1-883c-38bef090e59e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:42.329256 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 416/826] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Aug 9 11:06:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:42.334890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8a77a-f48e-4f96-836b-349aab30f581 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:42.402379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:42.475274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8a77a-f48e-4f96-836b-349aab30f581 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:42.502242 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970a553-0bf2-4749-a7ef-dc821f6f51c7 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:42.502883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970a553-0bf2-4749-a7ef-dc821f6f51c7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:42.503355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970a553-0bf2-4749-a7ef-dc821f6f51c7 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:42.505505 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 417/827] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:42.510914 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28679d3-4722-4344-9f7c-15ad646cc64d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:42.511459 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28679d3-4722-4344-9f7c-15ad646cc64d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:42.511928 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28679d3-4722-4344-9f7c-15ad646cc64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:42.530429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d28679d3-4722-4344-9f7c-15ad646cc64d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:42.531964 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d28679d3-4722-4344-9f7c-15ad646cc64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:42.537162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca1b9e-5c27-4a26-983f-90e5385a6219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:42.538193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca1b9e-5c27-4a26-983f-90e5385a6219 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:42.538662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca1b9e-5c27-4a26-983f-90e5385a6219 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:42.539272 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca1b9e-5c27-4a26-983f-90e5385a6219 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:42.613655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 418/828] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:06:42.614332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af906b-f58e-4dc2-83b2-4f0678af32ab None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:42.614614 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af906b-f58e-4dc2-83b2-4f0678af32ab None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:42.614883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af906b-f58e-4dc2-83b2-4f0678af32ab None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:42.616666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 419/829] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:42.621899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5da83-3c5f-457f-99ab-4c6f9f673222 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:42.622181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5da83-3c5f-457f-99ab-4c6f9f673222 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:42.622457 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5da83-3c5f-457f-99ab-4c6f9f673222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:42.641240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-89d5da83-3c5f-457f-99ab-4c6f9f673222 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:42.642448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-89d5da83-3c5f-457f-99ab-4c6f9f673222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:42.658426 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca1b9e-5c27-4a26-983f-90e5385a6219 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:42.659903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca1b9e-5c27-4a26-983f-90e5385a6219 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:42.709908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:42.745447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 420/830] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:06:42.746597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5da83-3c5f-457f-99ab-4c6f9f673222 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:42.786188 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:42.790078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 411/831] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:42 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:06:42.791017 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca1b9e-5c27-4a26-983f-90e5385a6219 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:42.866638 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5da83-3c5f-457f-99ab-4c6f9f673222 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:42.899940 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca1b9e-5c27-4a26-983f-90e5385a6219 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:42.903706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c3485-b2de-4dc3-9e8a-5a7338d45a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:42.904610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c3485-b2de-4dc3-9e8a-5a7338d45a23 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:42.905115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c3485-b2de-4dc3-9e8a-5a7338d45a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:42.905580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c3485-b2de-4dc3-9e8a-5a7338d45a23 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:42.906392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c3485-b2de-4dc3-9e8a-5a7338d45a23 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:42.908004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c3485-b2de-4dc3-9e8a-5a7338d45a23 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-dc7c3485-b2de-4dc3-9e8a-5a7338d45a23 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:42.917490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:42.918585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:42.919448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:42.919448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:42.919448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:42.919448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:42.919448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:42.919448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:42.919448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:42.919448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:42.919448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:42.919448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:42.919448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:42.919448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:42.919448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:06:42.919448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:42.919448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 421/832] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:06:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:42.920243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c3485-b2de-4dc3-9e8a-5a7338d45a23 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:42.940446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd52eba-3d0e-4c7b-bc75-3bb2d7bb64f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:42.941536 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd52eba-3d0e-4c7b-bc75-3bb2d7bb64f0 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:42.942116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd52eba-3d0e-4c7b-bc75-3bb2d7bb64f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:42.942407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd52eba-3d0e-4c7b-bc75-3bb2d7bb64f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:42.952009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:42.956680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd52eba-3d0e-4c7b-bc75-3bb2d7bb64f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-8dd52eba-3d0e-4c7b-bc75-3bb2d7bb64f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:42.961997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:42.962979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:42.963871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:42.963871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:42.963871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:42.963871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:42.963871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:42.963871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:42.963871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:42.963871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:42.963871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:42.963871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:42.963871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:06:42.963871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:42.963871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 412/833] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:06:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:42.964645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd52eba-3d0e-4c7b-bc75-3bb2d7bb64f0 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:43.026649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:43.039056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c3485-b2de-4dc3-9e8a-5a7338d45a23 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:43.075614 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41648b5-e2f3-41c0-9155-1156a456f677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:43.076246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41648b5-e2f3-41c0-9155-1156a456f677 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:43.076565 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41648b5-e2f3-41c0-9155-1156a456f677 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:43.076807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41648b5-e2f3-41c0-9155-1156a456f677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:43.085787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd52eba-3d0e-4c7b-bc75-3bb2d7bb64f0 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:43.089105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41648b5-e2f3-41c0-9155-1156a456f677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:43.090600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41648b5-e2f3-41c0-9155-1156a456f677 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-b41648b5-e2f3-41c0-9155-1156a456f677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:43.106581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:43.107592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:43.108509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:43.108509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:43.108509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:43.108509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 422/834] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:43.108509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41648b5-e2f3-41c0-9155-1156a456f677 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:43.125796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed97369-23fe-4f54-9510-c33b98a6c828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:43.126409 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed97369-23fe-4f54-9510-c33b98a6c828 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:43.126681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed97369-23fe-4f54-9510-c33b98a6c828 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:43.126946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed97369-23fe-4f54-9510-c33b98a6c828 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:43.127580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed97369-23fe-4f54-9510-c33b98a6c828 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:43.127877 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed97369-23fe-4f54-9510-c33b98a6c828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:43.129642 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed97369-23fe-4f54-9510-c33b98a6c828 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:43.139183 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 413/835] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:06:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:43.140307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed97369-23fe-4f54-9510-c33b98a6c828 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:43.210833 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:43.219070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41648b5-e2f3-41c0-9155-1156a456f677 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:43.250671 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed97369-23fe-4f54-9510-c33b98a6c828 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:43.254782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b00be5-6884-4953-840f-cd2c1bc8f46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:43.255396 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b00be5-6884-4953-840f-cd2c1bc8f46c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:43.255664 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b00be5-6884-4953-840f-cd2c1bc8f46c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:43.255930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b00be5-6884-4953-840f-cd2c1bc8f46c None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:43.256586 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b00be5-6884-4953-840f-cd2c1bc8f46c None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:43.256885 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b00be5-6884-4953-840f-cd2c1bc8f46c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:43.258595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b00be5-6884-4953-840f-cd2c1bc8f46c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:43.267436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 423/836] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:06:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:43.268265 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b00be5-6884-4953-840f-cd2c1bc8f46c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:43.274202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:43.293250 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea49b74-5f1b-4650-8edc-787d576de10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:43.294159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea49b74-5f1b-4650-8edc-787d576de10a None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:43.294627 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea49b74-5f1b-4650-8edc-787d576de10a None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:43.294901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea49b74-5f1b-4650-8edc-787d576de10a None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:43.295547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea49b74-5f1b-4650-8edc-787d576de10a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:43.295865 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea49b74-5f1b-4650-8edc-787d576de10a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:43.297298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea49b74-5f1b-4650-8edc-787d576de10a None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:43.314087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 414/837] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:43.314087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea49b74-5f1b-4650-8edc-787d576de10a None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:43.396934 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b00be5-6884-4953-840f-cd2c1bc8f46c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:43.429364 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea49b74-5f1b-4650-8edc-787d576de10a None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:43.435731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f501ba7-7c18-4051-af1c-dca462ced555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:43.436347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f501ba7-7c18-4051-af1c-dca462ced555 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:43.436623 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f501ba7-7c18-4051-af1c-dca462ced555 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:43.436891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f501ba7-7c18-4051-af1c-dca462ced555 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:43.437525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f501ba7-7c18-4051-af1c-dca462ced555 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:43.437851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f501ba7-7c18-4051-af1c-dca462ced555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:43.439216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f501ba7-7c18-4051-af1c-dca462ced555 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:43.443996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 424/838] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:06:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:43.450737 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f501ba7-7c18-4051-af1c-dca462ced555 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:43.457991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:43.472720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf40d4a-603d-43d7-b273-90d26ecba064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:43.476358 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf40d4a-603d-43d7-b273-90d26ecba064 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:43.476358 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf40d4a-603d-43d7-b273-90d26ecba064 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:43.476358 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf40d4a-603d-43d7-b273-90d26ecba064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:43.491966 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf40d4a-603d-43d7-b273-90d26ecba064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:43.493554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf40d4a-603d-43d7-b273-90d26ecba064 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-fcf40d4a-603d-43d7-b273-90d26ecba064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:43.511719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:43.512942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:43.514083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:43.514083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:43.514083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:43.515533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 415/839] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:43.520893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf40d4a-603d-43d7-b273-90d26ecba064 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:43.552995 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:43.601491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f501ba7-7c18-4051-af1c-dca462ced555 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:43.650510 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ace35-4dd9-4028-9c7b-15855775edbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:43.651346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ace35-4dd9-4028-9c7b-15855775edbd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:43.651617 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ace35-4dd9-4028-9c7b-15855775edbd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:43.651915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ace35-4dd9-4028-9c7b-15855775edbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:43.659232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ace35-4dd9-4028-9c7b-15855775edbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:43.660788 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ace35-4dd9-4028-9c7b-15855775edbd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:43.661394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf40d4a-603d-43d7-b273-90d26ecba064 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:43.673301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-129ace35-4dd9-4028-9c7b-15855775edbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:43.673301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:43.673301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:43.673301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:43.673301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:43.673301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:43.673301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:43.673301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:43.673301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:43.673301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:43.673301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:43.673301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:43.673301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:43.673301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:43.673301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:43.674439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:43.675576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:43.675576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:43.675576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:43.675576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:43.675576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:43.675576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:43.675576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:43.675576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:43.677761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 425/840] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:43.684355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ace35-4dd9-4028-9c7b-15855775edbd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:43.710953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8db35-c65e-455d-b17c-68b76f3b9be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:43.711941 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8db35-c65e-455d-b17c-68b76f3b9be5 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:43.712438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8db35-c65e-455d-b17c-68b76f3b9be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:43.713143 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8db35-c65e-455d-b17c-68b76f3b9be5 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:43.714027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8db35-c65e-455d-b17c-68b76f3b9be5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:43.714511 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8db35-c65e-455d-b17c-68b76f3b9be5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:43.716148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8db35-c65e-455d-b17c-68b76f3b9be5 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:43.730535 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 416/841] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:43.736854 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8db35-c65e-455d-b17c-68b76f3b9be5 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:43.780006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:43.822263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ace35-4dd9-4028-9c7b-15855775edbd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:43.853903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8db35-c65e-455d-b17c-68b76f3b9be5 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:43.856274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:43.866832 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fded526-1930-4d9b-9672-8a08df3e55d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:43.867503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fded526-1930-4d9b-9672-8a08df3e55d4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:43.867781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fded526-1930-4d9b-9672-8a08df3e55d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:43.868052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fded526-1930-4d9b-9672-8a08df3e55d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:43.868756 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fded526-1930-4d9b-9672-8a08df3e55d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:43.869077 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fded526-1930-4d9b-9672-8a08df3e55d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:43.871127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fded526-1930-4d9b-9672-8a08df3e55d4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:43.892549 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 426/842] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:43.894211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fded526-1930-4d9b-9672-8a08df3e55d4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:43.898531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0959b0-4596-4e13-80f6-73bee521bc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:43.900127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0959b0-4596-4e13-80f6-73bee521bc2f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:43.900406 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0959b0-4596-4e13-80f6-73bee521bc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:43.900676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0959b0-4596-4e13-80f6-73bee521bc2f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:43.909819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0959b0-4596-4e13-80f6-73bee521bc2f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:43.911640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0959b0-4596-4e13-80f6-73bee521bc2f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-1a0959b0-4596-4e13-80f6-73bee521bc2f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:43.930193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:43.931414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:43.932614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:43.932614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:43.932614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:43.932614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:43.932614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:43.932614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:43.932614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:43.932614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:43.932614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:06:43.932614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:43.936502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 417/843] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Aug 9 11:06:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:43.938232 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0959b0-4596-4e13-80f6-73bee521bc2f None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:44.028804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fded526-1930-4d9b-9672-8a08df3e55d4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:44.040499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:44.049475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0959b0-4596-4e13-80f6-73bee521bc2f None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:44.069593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c806d1-a56b-44a6-b0b7-df1e930a3194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:44.070506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c806d1-a56b-44a6-b0b7-df1e930a3194 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:44.071012 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c806d1-a56b-44a6-b0b7-df1e930a3194 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:44.071427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c806d1-a56b-44a6-b0b7-df1e930a3194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:44.072536 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c806d1-a56b-44a6-b0b7-df1e930a3194 None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=881030d7605b40879762d1c199362ee1) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:44.072998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c806d1-a56b-44a6-b0b7-df1e930a3194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:44.074739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c806d1-a56b-44a6-b0b7-df1e930a3194 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:44.086186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 427/844] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:43 2022] GET /identity/v3/role_assignments?user.id=881030d7605b40879762d1c199362ee1&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:44.091769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523a578-9e9c-40e0-847a-1216fc89e250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:44.092544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523a578-9e9c-40e0-847a-1216fc89e250 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:44.092918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523a578-9e9c-40e0-847a-1216fc89e250 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:44.093283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523a578-9e9c-40e0-847a-1216fc89e250 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:44.094185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523a578-9e9c-40e0-847a-1216fc89e250 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:44.094586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523a578-9e9c-40e0-847a-1216fc89e250 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:44.096230 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523a578-9e9c-40e0-847a-1216fc89e250 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:44.122575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 418/845] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Aug 9 11:06:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:44.124165 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c806d1-a56b-44a6-b0b7-df1e930a3194 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:44.187773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:44.242458 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c806d1-a56b-44a6-b0b7-df1e930a3194 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:44.283108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a89a8b-55db-4816-bb3e-f294f4fee797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:44.283108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a89a8b-55db-4816-bb3e-f294f4fee797 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:44.283108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a89a8b-55db-4816-bb3e-f294f4fee797 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:44.283108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a89a8b-55db-4816-bb3e-f294f4fee797 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:44.333202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc090b1-420f-41c1-b276-d23b60678b4d None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:44.333411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc090b1-420f-41c1-b276-d23b60678b4d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:44.333692 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc090b1-420f-41c1-b276-d23b60678b4d None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:44.335405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 419/846] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:44.341066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14b12c-a509-4adf-8021-245a36823d0d None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:44.341349 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14b12c-a509-4adf-8021-245a36823d0d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:44.341608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14b12c-a509-4adf-8021-245a36823d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:44.361565 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-9b14b12c-a509-4adf-8021-245a36823d0d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:44.363278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9b14b12c-a509-4adf-8021-245a36823d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:44.370863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a89a8b-55db-4816-bb3e-f294f4fee797 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:44.372768 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a89a8b-55db-4816-bb3e-f294f4fee797 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:44.432265 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:44.457878 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 420/847] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:06:44.490858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 428/848] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:06:44.492367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14b12c-a509-4adf-8021-245a36823d0d None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:44.496005 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a89a8b-55db-4816-bb3e-f294f4fee797 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:44.583949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:44.605141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14b12c-a509-4adf-8021-245a36823d0d None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:44.627703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a89a8b-55db-4816-bb3e-f294f4fee797 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:44.650025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf061d-25c7-414d-87b2-ee84120d07ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:44.650661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf061d-25c7-414d-87b2-ee84120d07ae None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:44.650935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf061d-25c7-414d-87b2-ee84120d07ae None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:44.651206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf061d-25c7-414d-87b2-ee84120d07ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:44.665906 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf061d-25c7-414d-87b2-ee84120d07ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:44.667327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797f83d-0fec-4eeb-ae99-107d0f426a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:44.667533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf061d-25c7-414d-87b2-ee84120d07ae None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:44.668376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797f83d-0fec-4eeb-ae99-107d0f426a6d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:44.668862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797f83d-0fec-4eeb-ae99-107d0f426a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:44.669412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797f83d-0fec-4eeb-ae99-107d0f426a6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:44.681068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797f83d-0fec-4eeb-ae99-107d0f426a6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-6ecf061d-25c7-414d-87b2-ee84120d07ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:44.684881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:44.686049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:44.686978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:44.686978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:44.686978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:44.686978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 421/849] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-d797f83d-0fec-4eeb-ae99-107d0f426a6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:44.689019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:44.690155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:44.691008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:44.691008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:44.691008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:44.691008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:44.691008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:44.691008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:44.691008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:44.691008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:44.691008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:44.691008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:44.691008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:06:44.691008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:44.691645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf061d-25c7-414d-87b2-ee84120d07ae None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:44.697175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 429/850] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:06:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:44.699262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797f83d-0fec-4eeb-ae99-107d0f426a6d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:44.718030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:44.803187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf061d-25c7-414d-87b2-ee84120d07ae None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:44.819588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797f83d-0fec-4eeb-ae99-107d0f426a6d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:44.843601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb42cf-21a5-42b4-a9bd-3da3dc8b3ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:44.844052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb42cf-21a5-42b4-a9bd-3da3dc8b3ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:44.844326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb42cf-21a5-42b4-a9bd-3da3dc8b3ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:44.844596 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb42cf-21a5-42b4-a9bd-3da3dc8b3ce1 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:44.845262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb42cf-21a5-42b4-a9bd-3da3dc8b3ce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:44.845749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb42cf-21a5-42b4-a9bd-3da3dc8b3ce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:44.846962 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb42cf-21a5-42b4-a9bd-3da3dc8b3ce1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:44.849960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:44.857479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ff13a-2167-46bf-9742-ce1513f75b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:44.858537 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff13a-2167-46bf-9742-ce1513f75b29 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:44.859111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff13a-2167-46bf-9742-ce1513f75b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:44.859596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff13a-2167-46bf-9742-ce1513f75b29 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:44.860454 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ff13a-2167-46bf-9742-ce1513f75b29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:44.860951 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ff13a-2167-46bf-9742-ce1513f75b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:44.862654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ff13a-2167-46bf-9742-ce1513f75b29 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:44.867554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 422/851] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:44.869096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb42cf-21a5-42b4-a9bd-3da3dc8b3ce1 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:44.877524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 430/852] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:06:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:44.883259 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ff13a-2167-46bf-9742-ce1513f75b29 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:44.964024 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:44.989792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ff13a-2167-46bf-9742-ce1513f75b29 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:44.990950 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb42cf-21a5-42b4-a9bd-3da3dc8b3ce1 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:45.025196 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb508d3-4032-4d4b-be20-2b94fd56f02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:45.025950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb508d3-4032-4d4b-be20-2b94fd56f02a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:45.026230 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb508d3-4032-4d4b-be20-2b94fd56f02a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:45.026497 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb508d3-4032-4d4b-be20-2b94fd56f02a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:45.029840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b425c4e-2f79-4b4e-b1e7-bd31e3a14495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:45.030818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b425c4e-2f79-4b4e-b1e7-bd31e3a14495 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:45.031305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b425c4e-2f79-4b4e-b1e7-bd31e3a14495 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:45.031770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b425c4e-2f79-4b4e-b1e7-bd31e3a14495 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:45.038471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb508d3-4032-4d4b-be20-2b94fd56f02a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:45.039998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb508d3-4032-4d4b-be20-2b94fd56f02a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:45.040346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b425c4e-2f79-4b4e-b1e7-bd31e3a14495 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:45.042112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b425c4e-2f79-4b4e-b1e7-bd31e3a14495 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-8bb508d3-4032-4d4b-be20-2b94fd56f02a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:45.054368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:45.055399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:45.056290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:45.056290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:45.056290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:45.057024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-1b425c4e-2f79-4b4e-b1e7-bd31e3a14495 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:45.057024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:45.057024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:45.057024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:45.057024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:45.057024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:45.057024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:45.057024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:45.057024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:45.057024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:45.057024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:45.057024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:45.057024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:45.057024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:45.057024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:45.057895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:45.058817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:45.058817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:45.058817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:45.058817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:45.058817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:45.058817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:45.058817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:45.058817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:45.060336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 431/853] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:45.061417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 423/854] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:45.065730 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb508d3-4032-4d4b-be20-2b94fd56f02a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:45.067197 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b425c4e-2f79-4b4e-b1e7-bd31e3a14495 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:45.128236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:45.167957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb508d3-4032-4d4b-be20-2b94fd56f02a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:45.176486 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b425c4e-2f79-4b4e-b1e7-bd31e3a14495 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:45.194642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:45.204059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23d975-a0a2-43de-8991-ab0a04cd67b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:45.204896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23d975-a0a2-43de-8991-ab0a04cd67b8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:45.205307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23d975-a0a2-43de-8991-ab0a04cd67b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:45.205761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23d975-a0a2-43de-8991-ab0a04cd67b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:45.206532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23d975-a0a2-43de-8991-ab0a04cd67b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:45.206975 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23d975-a0a2-43de-8991-ab0a04cd67b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:45.208495 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23d975-a0a2-43de-8991-ab0a04cd67b8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:45.216894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85375738-e52b-4226-8e40-bf6c766a63ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:45.217463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85375738-e52b-4226-8e40-bf6c766a63ee None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:45.217872 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85375738-e52b-4226-8e40-bf6c766a63ee None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:45.218228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85375738-e52b-4226-8e40-bf6c766a63ee None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:45.219014 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85375738-e52b-4226-8e40-bf6c766a63ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:45.219684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85375738-e52b-4226-8e40-bf6c766a63ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:45.221043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85375738-e52b-4226-8e40-bf6c766a63ee None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:45.227667 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 432/855] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:45.229190 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23d975-a0a2-43de-8991-ab0a04cd67b8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:45.239195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 424/856] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:45.240347 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85375738-e52b-4226-8e40-bf6c766a63ee None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:45.339611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23d975-a0a2-43de-8991-ab0a04cd67b8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:45.351435 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85375738-e52b-4226-8e40-bf6c766a63ee None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:45.370645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:45.380794 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b86c3-5473-4f1d-a91e-b1da684199b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:45.381684 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b86c3-5473-4f1d-a91e-b1da684199b7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:45.382107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b86c3-5473-4f1d-a91e-b1da684199b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:45.382676 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b86c3-5473-4f1d-a91e-b1da684199b7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:45.390727 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549c23-1daf-454e-8199-e9e537e3a63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:45.391418 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549c23-1daf-454e-8199-e9e537e3a63c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:45.391776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549c23-1daf-454e-8199-e9e537e3a63c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:45.391994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b86c3-5473-4f1d-a91e-b1da684199b7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:45.392096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549c23-1daf-454e-8199-e9e537e3a63c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:45.392969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c549c23-1daf-454e-8199-e9e537e3a63c None admin] RBAC: Adding query filter params (role.id=bcdb152b51e34826a39fc0f8c3d60664, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=345ec6b0da4c4f07a6047190f8b2182d) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:45.393338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c549c23-1daf-454e-8199-e9e537e3a63c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:45.394135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b86c3-5473-4f1d-a91e-b1da684199b7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:45.395162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c549c23-1daf-454e-8199-e9e537e3a63c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-af2b86c3-5473-4f1d-a91e-b1da684199b7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:45.406828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:45.407870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:45.409298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:45.409298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:45.409298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:45.409298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:45.409298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:45.409298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:45.409298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:45.409298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:45.409298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 11:06:45.409298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:45.409896 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 425/857] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:45 2022] GET /identity/v3/role_assignments?user.id=345ec6b0da4c4f07a6047190f8b2182d&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=bcdb152b51e34826a39fc0f8c3d60664 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:45.416779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 433/858] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:06:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:45.418621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549c23-1daf-454e-8199-e9e537e3a63c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:45.487042 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931538b-9d01-4de2-b098-b93743896e42 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:45.487287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931538b-9d01-4de2-b098-b93743896e42 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:45.487658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931538b-9d01-4de2-b098-b93743896e42 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:45.493366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 434/859] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:06:45.495379 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f98d-3e23-4cbf-8cca-d7760af6e0e8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:45.495733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f98d-3e23-4cbf-8cca-d7760af6e0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:45.496065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814f98d-3e23-4cbf-8cca-d7760af6e0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:45.515442 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b814f98d-3e23-4cbf-8cca-d7760af6e0e8 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:45.516814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b814f98d-3e23-4cbf-8cca-d7760af6e0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:45.546015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549c23-1daf-454e-8199-e9e537e3a63c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:45.566993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:45.590649 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54b45b-0a27-43c9-af93-c2dea2284774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:45.591270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54b45b-0a27-43c9-af93-c2dea2284774 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:45.591547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54b45b-0a27-43c9-af93-c2dea2284774 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:45.591818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54b45b-0a27-43c9-af93-c2dea2284774 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:45.593937 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54b45b-0a27-43c9-af93-c2dea2284774 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:45.593937 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54b45b-0a27-43c9-af93-c2dea2284774 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:45.594502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54b45b-0a27-43c9-af93-c2dea2284774 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:45.601994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 435/860] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:45.614376 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 426/861] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Aug 9 11:06:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:45.620185 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814f98d-3e23-4cbf-8cca-d7760af6e0e8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:45.620954 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54b45b-0a27-43c9-af93-c2dea2284774 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:45.665661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:45.747280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54b45b-0a27-43c9-af93-c2dea2284774 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:45.748968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814f98d-3e23-4cbf-8cca-d7760af6e0e8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:45.788654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561f264-4c02-4ef3-bc22-97cc17814576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:45.789304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561f264-4c02-4ef3-bc22-97cc17814576 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:45.789683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561f264-4c02-4ef3-bc22-97cc17814576 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:45.789956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561f264-4c02-4ef3-bc22-97cc17814576 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:45.791725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84345bba-f9f8-4754-a26c-6843f952ce13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:45.792586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84345bba-f9f8-4754-a26c-6843f952ce13 None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:45.793247 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84345bba-f9f8-4754-a26c-6843f952ce13 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:45.794600 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84345bba-f9f8-4754-a26c-6843f952ce13 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:45.795572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84345bba-f9f8-4754-a26c-6843f952ce13 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:45.797159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84345bba-f9f8-4754-a26c-6843f952ce13 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:45.818788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 427/862] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Aug 9 11:06:45 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:06:45.846911 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:45.873392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561f264-4c02-4ef3-bc22-97cc17814576 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:45.874962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561f264-4c02-4ef3-bc22-97cc17814576 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:45.990638 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 436/863] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:45 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:06:45.995766 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84345bba-f9f8-4754-a26c-6843f952ce13 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:46.098830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:46.112338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84345bba-f9f8-4754-a26c-6843f952ce13 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:46.150448 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705ce4e-2c14-4f42-9731-504b6051207e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:46.151432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705ce4e-2c14-4f42-9731-504b6051207e None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:46.151883 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705ce4e-2c14-4f42-9731-504b6051207e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:46.152339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705ce4e-2c14-4f42-9731-504b6051207e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:46.163912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705ce4e-2c14-4f42-9731-504b6051207e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:46.165384 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705ce4e-2c14-4f42-9731-504b6051207e None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-c705ce4e-2c14-4f42-9731-504b6051207e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:46.179991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:46.180970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:46.182350 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:46.182350 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:46.182350 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:46.182350 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 428/864] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:46.188994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561f264-4c02-4ef3-bc22-97cc17814576 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:46.273198 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:46.275465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5433c-06c9-46ba-bc88-b8d30ab0c05a None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:46.275760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5433c-06c9-46ba-bc88-b8d30ab0c05a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:46.276083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5433c-06c9-46ba-bc88-b8d30ab0c05a None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:46.278176 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 429/865] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:46.283884 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a4cdd-beef-422e-9101-8ab38c1462ad None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:46.284170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a4cdd-beef-422e-9101-8ab38c1462ad None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:46.284422 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a4cdd-beef-422e-9101-8ab38c1462ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:46.295004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561f264-4c02-4ef3-bc22-97cc17814576 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:46.303824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-271a4cdd-beef-422e-9101-8ab38c1462ad None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:46.305096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-271a4cdd-beef-422e-9101-8ab38c1462ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:46.331707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153183c5-f14f-43a2-9250-71437dcc856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:46.332327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153183c5-f14f-43a2-9250-71437dcc856d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:46.332600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153183c5-f14f-43a2-9250-71437dcc856d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:46.332868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153183c5-f14f-43a2-9250-71437dcc856d None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:46.333507 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153183c5-f14f-43a2-9250-71437dcc856d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:46.333927 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153183c5-f14f-43a2-9250-71437dcc856d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:46.335384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153183c5-f14f-43a2-9250-71437dcc856d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:46.348076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 437/866] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:46.354793 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153183c5-f14f-43a2-9250-71437dcc856d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:46.385822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 430/867] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:06:46.403352 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a4cdd-beef-422e-9101-8ab38c1462ad None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:46.460185 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153183c5-f14f-43a2-9250-71437dcc856d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:46.494541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:46.494688 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27428209-4d83-4d80-8a63-23ea51c74be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:46.495207 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27428209-4d83-4d80-8a63-23ea51c74be4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:46.495462 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27428209-4d83-4d80-8a63-23ea51c74be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:46.495941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27428209-4d83-4d80-8a63-23ea51c74be4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:46.498799 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:46.503961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27428209-4d83-4d80-8a63-23ea51c74be4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:46.505522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27428209-4d83-4d80-8a63-23ea51c74be4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:46.518398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-27428209-4d83-4d80-8a63-23ea51c74be4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:46.518398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:46.518398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:46.518398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:46.518398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:46.518398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:46.518398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:46.518398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:46.518398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:46.518398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:46.518398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:46.518398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:46.518398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:46.518398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:46.518398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:46.519372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:46.520287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:46.520287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:46.520287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:46.520287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:46.520287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:46.520287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:46.520287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:46.520287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:46.520287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 438/868] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:46.525551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27428209-4d83-4d80-8a63-23ea51c74be4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:46.526355 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a4cdd-beef-422e-9101-8ab38c1462ad None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:46.564443 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9c4ba-634d-4dcd-b03a-b02f9a39bf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:46.565177 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9c4ba-634d-4dcd-b03a-b02f9a39bf66 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:46.565457 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9c4ba-634d-4dcd-b03a-b02f9a39bf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:46.565770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9c4ba-634d-4dcd-b03a-b02f9a39bf66 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:46.566414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9c4ba-634d-4dcd-b03a-b02f9a39bf66 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:46.568015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9c4ba-634d-4dcd-b03a-b02f9a39bf66 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-e9b9c4ba-634d-4dcd-b03a-b02f9a39bf66 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:46.577442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:46.578473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:46.579386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:46.579386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:46.579386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:46.579386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:46.579386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:46.579386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:46.579386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:46.579386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:46.579386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:46.579386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:46.579386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:46.579386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:46.579386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:06:46.579386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:46.579386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 431/869] 10.222.0.15 () {56 vars in 1132 bytes} [Tue Aug 9 11:06:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:46.585299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9c4ba-634d-4dcd-b03a-b02f9a39bf66 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:46.660168 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27428209-4d83-4d80-8a63-23ea51c74be4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:46.703783 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d16397-5968-4643-8a84-13d7847d256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:46.704398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d16397-5968-4643-8a84-13d7847d256c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:46.704675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d16397-5968-4643-8a84-13d7847d256c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:46.704945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d16397-5968-4643-8a84-13d7847d256c None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:46.705782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d16397-5968-4643-8a84-13d7847d256c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:46.706084 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d16397-5968-4643-8a84-13d7847d256c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:46.707530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d16397-5968-4643-8a84-13d7847d256c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:46.709113 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9c4ba-634d-4dcd-b03a-b02f9a39bf66 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:46.720892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 439/870] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:46.726805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d16397-5968-4643-8a84-13d7847d256c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:46.746580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821f98c-fac2-4f70-bf81-2a6a74ec25e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:46.747540 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821f98c-fac2-4f70-bf81-2a6a74ec25e9 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:46.747988 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821f98c-fac2-4f70-bf81-2a6a74ec25e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:46.748523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821f98c-fac2-4f70-bf81-2a6a74ec25e9 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:46.749473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821f98c-fac2-4f70-bf81-2a6a74ec25e9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:46.749861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821f98c-fac2-4f70-bf81-2a6a74ec25e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:46.751254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821f98c-fac2-4f70-bf81-2a6a74ec25e9 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:46.757121 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 432/871] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Aug 9 11:06:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:46.766876 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821f98c-fac2-4f70-bf81-2a6a74ec25e9 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:46.772819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:46.801829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:46.856779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d16397-5968-4643-8a84-13d7847d256c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:46.895350 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b2797-a51e-4ada-99de-fa4fa14599bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:46.895959 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b2797-a51e-4ada-99de-fa4fa14599bd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:46.896237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b2797-a51e-4ada-99de-fa4fa14599bd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:46.896509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b2797-a51e-4ada-99de-fa4fa14599bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:46.897233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b2797-a51e-4ada-99de-fa4fa14599bd None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=557b8757098e4777965d782d1ce5f97b) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:46.897537 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b2797-a51e-4ada-99de-fa4fa14599bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:46.897804 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821f98c-fac2-4f70-bf81-2a6a74ec25e9 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:46.899036 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b2797-a51e-4ada-99de-fa4fa14599bd None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:46.909658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 440/872] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:46 2022] GET /identity/v3/role_assignments?user.id=557b8757098e4777965d782d1ce5f97b&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:46.958154 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6e13e-0412-475a-b240-f91e871343ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:46.958790 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6e13e-0412-475a-b240-f91e871343ec None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:46.959069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6e13e-0412-475a-b240-f91e871343ec None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:46.959337 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6e13e-0412-475a-b240-f91e871343ec None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:46.959983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6e13e-0412-475a-b240-f91e871343ec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:46.960275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6e13e-0412-475a-b240-f91e871343ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:46.961816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db6e13e-0412-475a-b240-f91e871343ec None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:46.967803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 433/873] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Aug 9 11:06:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:47.687522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daeb52-c4ef-40da-898a-cc6ec6e55663 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:47.688052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daeb52-c4ef-40da-898a-cc6ec6e55663 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:47.688052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daeb52-c4ef-40da-898a-cc6ec6e55663 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:47.689697 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 441/874] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:47.695691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6e4ef-3a92-4378-966c-f2ce448839da None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:47.696214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6e4ef-3a92-4378-966c-f2ce448839da None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:47.696214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6e4ef-3a92-4378-966c-f2ce448839da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:47.716404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-ccb6e4ef-3a92-4378-966c-f2ce448839da None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:47.717643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ccb6e4ef-3a92-4378-966c-f2ce448839da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:47.789399 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:47.798291 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 434/875] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:47 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:47.824226 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daeb52-c4ef-40da-898a-cc6ec6e55663 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:47.934548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daeb52-c4ef-40da-898a-cc6ec6e55663 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:47.955836 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:47.972115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3365ba-16ae-49bf-9709-a45fefbf46ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:47.972750 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3365ba-16ae-49bf-9709-a45fefbf46ff None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:47.973027 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3365ba-16ae-49bf-9709-a45fefbf46ff None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:47.973297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3365ba-16ae-49bf-9709-a45fefbf46ff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:47.984719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3365ba-16ae-49bf-9709-a45fefbf46ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-8d3365ba-16ae-49bf-9709-a45fefbf46ff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:47.989466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:47.990412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:47.991241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:47.991241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:47.991241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:47.991241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:47.991241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:47.991241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:47.991241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:47.991241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:47.991241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:47.991241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:47.991241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:06:47.991241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:47.991241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 442/876] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Aug 9 11:06:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:47.998358 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6e4ef-3a92-4378-966c-f2ce448839da None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:48.020196 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb734d29-86a8-432d-bde6-43b158f8e1f3 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:48.020504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb734d29-86a8-432d-bde6-43b158f8e1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:48.020753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb734d29-86a8-432d-bde6-43b158f8e1f3 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:48.024203 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 443/877] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:06:48.028814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6332db-341b-468b-9269-c010b9873f61 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:48.029349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6332db-341b-468b-9269-c010b9873f61 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:48.029639 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6332db-341b-468b-9269-c010b9873f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:48.051874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bd6332db-341b-468b-9269-c010b9873f61 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:48.053227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bd6332db-341b-468b-9269-c010b9873f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:48.108851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6e4ef-3a92-4378-966c-f2ce448839da None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:48.135176 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 444/878] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:48 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:48.151739 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ec89d-f9c8-4b5e-b1cb-14e8a586aa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:48.152420 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ec89d-f9c8-4b5e-b1cb-14e8a586aa82 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:48.152699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ec89d-f9c8-4b5e-b1cb-14e8a586aa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:48.152980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ec89d-f9c8-4b5e-b1cb-14e8a586aa82 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:48.153657 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ec89d-f9c8-4b5e-b1cb-14e8a586aa82 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:48.153974 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ec89d-f9c8-4b5e-b1cb-14e8a586aa82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:48.155435 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ec89d-f9c8-4b5e-b1cb-14e8a586aa82 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:48.158506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6332db-341b-468b-9269-c010b9873f61 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:48.165721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 435/879] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Aug 9 11:06:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:48.171242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ec89d-f9c8-4b5e-b1cb-14e8a586aa82 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:48.256145 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:48.286466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6332db-341b-468b-9269-c010b9873f61 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:48.299854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:48.318991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ec89d-f9c8-4b5e-b1cb-14e8a586aa82 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:48.329326 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b454da7-2fa1-4292-865c-430c1ec419ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:48.330009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b454da7-2fa1-4292-865c-430c1ec419ee None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:48.330278 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b454da7-2fa1-4292-865c-430c1ec419ee None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:48.330540 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b454da7-2fa1-4292-865c-430c1ec419ee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:48.331120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b454da7-2fa1-4292-865c-430c1ec419ee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:48.332902 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b454da7-2fa1-4292-865c-430c1ec419ee None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-3b454da7-2fa1-4292-865c-430c1ec419ee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:48.344247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:48.345494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:48.346587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:48.346587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:48.346587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:48.346587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:48.346587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:48.346587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:48.346587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:48.346587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:48.346587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:48.346587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:48.346587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:48.346587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:48.346587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:06:48.346587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:48.349700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 445/880] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:06:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:48.352024 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b454da7-2fa1-4292-865c-430c1ec419ee None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:48.366356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5496846-4f22-4402-b453-01233ed79c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:48.367035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5496846-4f22-4402-b453-01233ed79c20 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:48.367313 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5496846-4f22-4402-b453-01233ed79c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:48.367590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5496846-4f22-4402-b453-01233ed79c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:48.385245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5496846-4f22-4402-b453-01233ed79c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:48.387381 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5496846-4f22-4402-b453-01233ed79c20 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-e5496846-4f22-4402-b453-01233ed79c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:48.406192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:48.407216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:48.408112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:48.408112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:48.408112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:48.412356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 436/881] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:48.414089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5496846-4f22-4402-b453-01233ed79c20 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:48.481317 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b454da7-2fa1-4292-865c-430c1ec419ee None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:48.528612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62aa447-8e55-4f6f-a7e3-45f8ba3670e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:48.529237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62aa447-8e55-4f6f-a7e3-45f8ba3670e8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:48.529515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62aa447-8e55-4f6f-a7e3-45f8ba3670e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:48.529816 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62aa447-8e55-4f6f-a7e3-45f8ba3670e8 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:48.530740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62aa447-8e55-4f6f-a7e3-45f8ba3670e8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:48.531047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62aa447-8e55-4f6f-a7e3-45f8ba3670e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:48.533204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62aa447-8e55-4f6f-a7e3-45f8ba3670e8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:48.545479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 446/882] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:06:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:48.547397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5496846-4f22-4402-b453-01233ed79c20 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:48.548943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62aa447-8e55-4f6f-a7e3-45f8ba3670e8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:48.562985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:48.593288 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb1378-06f5-48e6-b1f9-21ea9289f7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:48.595166 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb1378-06f5-48e6-b1f9-21ea9289f7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:48.595648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb1378-06f5-48e6-b1f9-21ea9289f7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:48.596091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb1378-06f5-48e6-b1f9-21ea9289f7e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:48.596937 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb1378-06f5-48e6-b1f9-21ea9289f7e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:48.597462 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb1378-06f5-48e6-b1f9-21ea9289f7e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:48.599050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb1378-06f5-48e6-b1f9-21ea9289f7e2 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:48.600213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:48.622136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 437/883] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:48.623387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb1378-06f5-48e6-b1f9-21ea9289f7e2 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:48.671093 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62aa447-8e55-4f6f-a7e3-45f8ba3670e8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:48.706695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4c4bb-d505-44d3-9640-27f19f87503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:48.707364 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4c4bb-d505-44d3-9640-27f19f87503e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:48.707555 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4c4bb-d505-44d3-9640-27f19f87503e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:48.707908 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4c4bb-d505-44d3-9640-27f19f87503e None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:48.708599 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4c4bb-d505-44d3-9640-27f19f87503e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:48.708980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4c4bb-d505-44d3-9640-27f19f87503e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:48.710451 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4c4bb-d505-44d3-9640-27f19f87503e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:48.721073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 447/884] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:06:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:48.725447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4c4bb-d505-44d3-9640-27f19f87503e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:48.739886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb1378-06f5-48e6-b1f9-21ea9289f7e2 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:48.781263 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6a1b1-d7dc-4ac6-8719-786adbd65154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:48.782351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6a1b1-d7dc-4ac6-8719-786adbd65154 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:48.782861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6a1b1-d7dc-4ac6-8719-786adbd65154 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:48.783536 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6a1b1-d7dc-4ac6-8719-786adbd65154 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:48.792384 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6a1b1-d7dc-4ac6-8719-786adbd65154 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:48.794488 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6a1b1-d7dc-4ac6-8719-786adbd65154 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-28a6a1b1-d7dc-4ac6-8719-786adbd65154 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:48.808796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:48.809873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:48.810881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:48.810881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:48.810881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:48.810881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:48.810881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:48.810881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:48.810881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:48.810881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:48.810881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:06:48.810881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:48.818112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 438/885] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Aug 9 11:06:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:48.819427 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6a1b1-d7dc-4ac6-8719-786adbd65154 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:48.834773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4c4bb-d505-44d3-9640-27f19f87503e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:48.836435 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:48.856150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:48.873492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8defd83-ba85-4bf4-9289-0e537e0ef806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:48.874137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8defd83-ba85-4bf4-9289-0e537e0ef806 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:48.874407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8defd83-ba85-4bf4-9289-0e537e0ef806 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:48.874669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8defd83-ba85-4bf4-9289-0e537e0ef806 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:48.875442 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8defd83-ba85-4bf4-9289-0e537e0ef806 None admin] RBAC: Adding query filter params (interface=public, service_id=18dddc0604e140de8f979b2bb8477bdc, region_id=RegionOne) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:48.875915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8defd83-ba85-4bf4-9289-0e537e0ef806 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:48.877327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8defd83-ba85-4bf4-9289-0e537e0ef806 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:48.888230 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 448/886] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Aug 9 11:06:48 2022] GET /identity/v3/endpoints?service_id=18dddc0604e140de8f979b2bb8477bdc&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:48.889329 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8defd83-ba85-4bf4-9289-0e537e0ef806 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:48.943074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6a1b1-d7dc-4ac6-8719-786adbd65154 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:48.981808 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c223471-950e-4861-97b5-93668e15ffa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:48.982824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c223471-950e-4861-97b5-93668e15ffa9 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:48.983298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c223471-950e-4861-97b5-93668e15ffa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:48.983854 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c223471-950e-4861-97b5-93668e15ffa9 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:48.984876 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c223471-950e-4861-97b5-93668e15ffa9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:48.985379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c223471-950e-4861-97b5-93668e15ffa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:48.987214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c223471-950e-4861-97b5-93668e15ffa9 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:48.991055 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8defd83-ba85-4bf4-9289-0e537e0ef806 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:49.008229 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 439/887] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Aug 9 11:06:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:49.014717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c223471-950e-4861-97b5-93668e15ffa9 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:49.031673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e121ea9-e2b5-4996-a04d-e4b4aaf6bb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:49.032285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e121ea9-e2b5-4996-a04d-e4b4aaf6bb0f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:49.032555 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e121ea9-e2b5-4996-a04d-e4b4aaf6bb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:49.032818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e121ea9-e2b5-4996-a04d-e4b4aaf6bb0f None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:49.033842 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e121ea9-e2b5-4996-a04d-e4b4aaf6bb0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:49.035481 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e121ea9-e2b5-4996-a04d-e4b4aaf6bb0f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:49.044207 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 449/888] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Aug 9 11:06:48 2022] GET /identity/v3/services => generated 1011 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:06:49.045846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1c8c5-953e-41a6-b865-7ae8295b2443 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:49.046245 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1c8c5-953e-41a6-b865-7ae8295b2443 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:49.046635 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1c8c5-953e-41a6-b865-7ae8295b2443 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:49.047993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 450/889] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:49.051747 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f0d75-4846-44fe-8f7c-7d591e73fe4b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:49.052270 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f0d75-4846-44fe-8f7c-7d591e73fe4b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:49.052541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f0d75-4846-44fe-8f7c-7d591e73fe4b None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:49.054122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 451/890] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:49.056983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eca49-c337-4178-aeaa-6dff9800d7aa None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:49.056983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eca49-c337-4178-aeaa-6dff9800d7aa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:49.056983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eca49-c337-4178-aeaa-6dff9800d7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:49.075849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-443eca49-c337-4178-aeaa-6dff9800d7aa None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:49.077234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-443eca49-c337-4178-aeaa-6dff9800d7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:49.105413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:49.129969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:49.140804 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c223471-950e-4861-97b5-93668e15ffa9 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:49.161674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 452/891] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:49 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:49.161674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73c62f-9a45-4f2b-96b4-c422945a7f22 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:49.161674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73c62f-9a45-4f2b-96b4-c422945a7f22 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:49.161674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73c62f-9a45-4f2b-96b4-c422945a7f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:49.186067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fe73c62f-9a45-4f2b-96b4-c422945a7f22 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:49.187334 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fe73c62f-9a45-4f2b-96b4-c422945a7f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:49.196817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168f42c-6a9d-4243-9170-1416c1f7c20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:49.197445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168f42c-6a9d-4243-9170-1416c1f7c20a None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:49.197757 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168f42c-6a9d-4243-9170-1416c1f7c20a None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:49.198019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168f42c-6a9d-4243-9170-1416c1f7c20a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:49.274856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168f42c-6a9d-4243-9170-1416c1f7c20a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:49.278173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168f42c-6a9d-4243-9170-1416c1f7c20a None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:49.288234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 453/892] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:49 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:49.288234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73c62f-9a45-4f2b-96b4-c422945a7f22 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:49.385587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:49.402875 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 440/893] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:49 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 11:06:49.403079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:49.403177 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168f42c-6a9d-4243-9170-1416c1f7c20a None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:49.414559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73c62f-9a45-4f2b-96b4-c422945a7f22 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:49.452774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d96daa-af6a-4008-b48f-b3e6f106471a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:49.453470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d96daa-af6a-4008-b48f-b3e6f106471a None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:49.453831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d96daa-af6a-4008-b48f-b3e6f106471a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:49.454165 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d96daa-af6a-4008-b48f-b3e6f106471a None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:49.454875 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d96daa-af6a-4008-b48f-b3e6f106471a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:49.456355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d96daa-af6a-4008-b48f-b3e6f106471a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:49.474302 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 454/894] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Aug 9 11:06:49 2022] POST /identity/v3/services => generated 269 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:06:49.475306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d96daa-af6a-4008-b48f-b3e6f106471a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:49.515414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168f42c-6a9d-4243-9170-1416c1f7c20a None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:49.561366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44f15f-fd88-49d6-837f-ba8a6f70fc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:49.562477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f15f-fd88-49d6-837f-ba8a6f70fc75 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:49.563045 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f15f-fd88-49d6-837f-ba8a6f70fc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:49.563526 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f15f-fd88-49d6-837f-ba8a6f70fc75 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:49.564358 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44f15f-fd88-49d6-837f-ba8a6f70fc75 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:49.566058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44f15f-fd88-49d6-837f-ba8a6f70fc75 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-9e44f15f-fd88-49d6-837f-ba8a6f70fc75 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:49.576464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:49.577546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:49.578470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:49.578470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:49.578470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:49.578470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:49.578470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:49.578470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:49.578470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:49.578470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:49.578470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:49.578470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:49.578470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:49.578470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:49.578470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:06:49.578470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:49.586786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 441/895] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Aug 9 11:06:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:49.588218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44f15f-fd88-49d6-837f-ba8a6f70fc75 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:49.599511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d96daa-af6a-4008-b48f-b3e6f106471a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:49.639001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a014bac-266b-4387-a07f-0ac1a6d128f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:49.639741 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a014bac-266b-4387-a07f-0ac1a6d128f9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:49.639918 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a014bac-266b-4387-a07f-0ac1a6d128f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:49.640144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a014bac-266b-4387-a07f-0ac1a6d128f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:49.652234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a014bac-266b-4387-a07f-0ac1a6d128f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:49.653670 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:49.653872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a014bac-266b-4387-a07f-0ac1a6d128f9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-7a014bac-266b-4387-a07f-0ac1a6d128f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:49.669101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:49.670210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:49.671120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:49.671120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:49.671120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:49.674921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 455/896] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:49.676150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a014bac-266b-4387-a07f-0ac1a6d128f9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:49.679054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:49.721697 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44f15f-fd88-49d6-837f-ba8a6f70fc75 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:49.771099 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d6024-cbf6-4c18-b174-aa7ed3dd94ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:49.771844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d6024-cbf6-4c18-b174-aa7ed3dd94ec None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:49.772329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d6024-cbf6-4c18-b174-aa7ed3dd94ec None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:49.772658 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d6024-cbf6-4c18-b174-aa7ed3dd94ec None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:49.773682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d6024-cbf6-4c18-b174-aa7ed3dd94ec None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:49.774409 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d6024-cbf6-4c18-b174-aa7ed3dd94ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:49.775861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d6024-cbf6-4c18-b174-aa7ed3dd94ec None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:49.783012 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 442/897] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Aug 9 11:06:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:49.788528 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d6024-cbf6-4c18-b174-aa7ed3dd94ec None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:49.789796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a014bac-266b-4387-a07f-0ac1a6d128f9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:49.838469 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ad151-da33-4f93-b628-2c1b450a4443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:49.839795 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ad151-da33-4f93-b628-2c1b450a4443 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:49.840258 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ad151-da33-4f93-b628-2c1b450a4443 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:49.840640 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ad151-da33-4f93-b628-2c1b450a4443 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:49.841630 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ad151-da33-4f93-b628-2c1b450a4443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:49.842058 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ad151-da33-4f93-b628-2c1b450a4443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:49.844224 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ad151-da33-4f93-b628-2c1b450a4443 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:49.861818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 456/898] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:49.868282 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ad151-da33-4f93-b628-2c1b450a4443 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:49.903812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d6024-cbf6-4c18-b174-aa7ed3dd94ec None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:49.918229 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:49.945247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:49.947644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1424f-ca52-4a43-b868-65a668961393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:49.949128 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1424f-ca52-4a43-b868-65a668961393 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:49.949583 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1424f-ca52-4a43-b868-65a668961393 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:49.949973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1424f-ca52-4a43-b868-65a668961393 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:49.953041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1424f-ca52-4a43-b868-65a668961393 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:49.953439 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1424f-ca52-4a43-b868-65a668961393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:49.955116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1424f-ca52-4a43-b868-65a668961393 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:49.960412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 443/899] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Aug 9 11:06:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:49.994285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ad151-da33-4f93-b628-2c1b450a4443 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:50.034298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea568f-4538-4aa4-98aa-87e2ded9d94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:50.035246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea568f-4538-4aa4-98aa-87e2ded9d94b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:50.035660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea568f-4538-4aa4-98aa-87e2ded9d94b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:50.036073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea568f-4538-4aa4-98aa-87e2ded9d94b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:50.044476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea568f-4538-4aa4-98aa-87e2ded9d94b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:50.046273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea568f-4538-4aa4-98aa-87e2ded9d94b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:50.059100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-11ea568f-4538-4aa4-98aa-87e2ded9d94b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:50.059100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:50.059100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:50.059100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:50.059100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:50.059100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:50.059100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:50.059100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:50.059100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:50.059100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:50.059100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:50.059100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:50.059100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:50.059100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:50.059100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:50.060233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:50.061323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:50.061323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:50.061323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:50.061323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:50.061323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:50.061323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:50.061323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:50.061323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:50.068064 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 457/900] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:50.070838 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1424f-ca52-4a43-b868-65a668961393 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:50.185889 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1424f-ca52-4a43-b868-65a668961393 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:50.222569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5b2fd-458a-4e00-b16f-d04be9adc354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:50.223569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5b2fd-458a-4e00-b16f-d04be9adc354 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:50.223979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5b2fd-458a-4e00-b16f-d04be9adc354 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:50.224379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5b2fd-458a-4e00-b16f-d04be9adc354 None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:50.225219 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5b2fd-458a-4e00-b16f-d04be9adc354 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:50.225704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5b2fd-458a-4e00-b16f-d04be9adc354 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:50.227435 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5b2fd-458a-4e00-b16f-d04be9adc354 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:50.245676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 444/901] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:50.247284 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea568f-4538-4aa4-98aa-87e2ded9d94b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:50.352550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea568f-4538-4aa4-98aa-87e2ded9d94b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:50.375591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:50.388310 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2c816-4958-48f0-903a-de3d9af8e893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:50.388912 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2c816-4958-48f0-903a-de3d9af8e893 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:50.389184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2c816-4958-48f0-903a-de3d9af8e893 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:50.389452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2c816-4958-48f0-903a-de3d9af8e893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:50.390202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2c816-4958-48f0-903a-de3d9af8e893 None admin] RBAC: Adding query filter params (role.id=f8b621041fe241a586be5bf0799ff298, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=345ec6b0da4c4f07a6047190f8b2182d) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:50.390502 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2c816-4958-48f0-903a-de3d9af8e893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:50.391920 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2c816-4958-48f0-903a-de3d9af8e893 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:50.397958 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 458/902] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:50 2022] GET /identity/v3/role_assignments?user.id=345ec6b0da4c4f07a6047190f8b2182d&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=f8b621041fe241a586be5bf0799ff298 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:51.109948 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd2d41-3a51-414a-ac54-c9d1b470dc72 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:51.110613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd2d41-3a51-414a-ac54-c9d1b470dc72 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:51.110921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd2d41-3a51-414a-ac54-c9d1b470dc72 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:51.112466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 445/903] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:51.118095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cf2e8-fe40-495a-bf26-cbc92ab8f1f0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:51.118944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cf2e8-fe40-495a-bf26-cbc92ab8f1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:51.119414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cf2e8-fe40-495a-bf26-cbc92ab8f1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:51.138870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-291cf2e8-fe40-495a-bf26-cbc92ab8f1f0 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:51.140432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-291cf2e8-fe40-495a-bf26-cbc92ab8f1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:51.211986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 459/904] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:51.234688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd2d41-3a51-414a-ac54-c9d1b470dc72 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:51.282194 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:51.351295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd2d41-3a51-414a-ac54-c9d1b470dc72 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:51.386966 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ab382-d585-4388-831a-5b5a13646895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:51.387516 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ab382-d585-4388-831a-5b5a13646895 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:51.387790 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ab382-d585-4388-831a-5b5a13646895 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:51.388055 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ab382-d585-4388-831a-5b5a13646895 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:51.388637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ab382-d585-4388-831a-5b5a13646895 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:51.390057 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ab382-d585-4388-831a-5b5a13646895 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-751ab382-d585-4388-831a-5b5a13646895 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:51.399394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:51.400419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:51.401260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:51.401260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:51.401260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:51.401260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:51.401260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:51.401260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:51.401260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:51.401260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:51.401260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:51.401260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:51.401260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:51.401260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:51.401260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 11:06:51.401260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:51.401260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 446/905] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:06:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:51.408713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cf2e8-fe40-495a-bf26-cbc92ab8f1f0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:51.519121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cf2e8-fe40-495a-bf26-cbc92ab8f1f0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:51.537333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:51.558437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ad1b2-5bbd-4674-95eb-81658bbb569e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:51.559086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ad1b2-5bbd-4674-95eb-81658bbb569e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:51.559362 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ad1b2-5bbd-4674-95eb-81658bbb569e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:51.559631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ad1b2-5bbd-4674-95eb-81658bbb569e None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:51.560289 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ad1b2-5bbd-4674-95eb-81658bbb569e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:51.560591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ad1b2-5bbd-4674-95eb-81658bbb569e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:51.562063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ad1b2-5bbd-4674-95eb-81658bbb569e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:51.568432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 460/906] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:06:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:51.574819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ab382-d585-4388-831a-5b5a13646895 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:51.595721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdb30f-2e51-4a7d-ad86-165955fb1e92 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:51.596046 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdb30f-2e51-4a7d-ad86-165955fb1e92 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:51.596260 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdb30f-2e51-4a7d-ad86-165955fb1e92 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:51.598335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 461/907] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:06:51.604223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef0a67-a100-46b6-a084-56cd1ad6cad9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:51.604486 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef0a67-a100-46b6-a084-56cd1ad6cad9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:51.604751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef0a67-a100-46b6-a084-56cd1ad6cad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:51.627076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f2ef0a67-a100-46b6-a084-56cd1ad6cad9 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:51.628271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f2ef0a67-a100-46b6-a084-56cd1ad6cad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:51.699947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ab382-d585-4388-831a-5b5a13646895 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:51.701342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:51.713670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 462/908] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:06:51.732545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef0a67-a100-46b6-a084-56cd1ad6cad9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:51.742815 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001afbb-5fd3-4704-80af-3a857e07b54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:51.743769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001afbb-5fd3-4704-80af-3a857e07b54f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:51.744365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001afbb-5fd3-4704-80af-3a857e07b54f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:51.744820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001afbb-5fd3-4704-80af-3a857e07b54f None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:51.745774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001afbb-5fd3-4704-80af-3a857e07b54f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:51.746268 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001afbb-5fd3-4704-80af-3a857e07b54f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:51.747881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001afbb-5fd3-4704-80af-3a857e07b54f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:51.754348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 447/909] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Aug 9 11:06:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:51.765373 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001afbb-5fd3-4704-80af-3a857e07b54f None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:51.851860 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef0a67-a100-46b6-a084-56cd1ad6cad9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:51.865040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001afbb-5fd3-4704-80af-3a857e07b54f None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:51.866031 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:51.899475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16fa43-766c-41f3-a143-d7727d2f77c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:51.900516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16fa43-766c-41f3-a143-d7727d2f77c7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:51.901236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16fa43-766c-41f3-a143-d7727d2f77c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:51.902044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16fa43-766c-41f3-a143-d7727d2f77c7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:51.902787 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16fa43-766c-41f3-a143-d7727d2f77c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:51.904296 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16fa43-766c-41f3-a143-d7727d2f77c7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:51.905654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9d444-20d3-4ba9-b51f-cfe7e660e95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:51.906351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9d444-20d3-4ba9-b51f-cfe7e660e95e None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:51.906918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9d444-20d3-4ba9-b51f-cfe7e660e95e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:51.907205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9d444-20d3-4ba9-b51f-cfe7e660e95e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:51.908258 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9d444-20d3-4ba9-b51f-cfe7e660e95e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:51.909980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9d444-20d3-4ba9-b51f-cfe7e660e95e None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-db16fa43-766c-41f3-a143-d7727d2f77c7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:51.914562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:51.915692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:51.916804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:51.916804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:51.916804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:51.916804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:51.916804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:51.916804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:51.916804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:51.916804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:51.916804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:51.916804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:51.916804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:51.916804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:51.916804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:06:51.916804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:51.924162 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 463/910] 10.222.0.15 () {56 vars in 1132 bytes} [Tue Aug 9 11:06:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:51.924887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16fa43-766c-41f3-a143-d7727d2f77c7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:51.953739 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 448/911] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:06:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:06:52.059472 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16fa43-766c-41f3-a143-d7727d2f77c7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:52.106502 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df8741-9efb-4d1f-a6a2-6144277e3c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:52.106857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df8741-9efb-4d1f-a6a2-6144277e3c71 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:52.107057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df8741-9efb-4d1f-a6a2-6144277e3c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:52.107342 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df8741-9efb-4d1f-a6a2-6144277e3c71 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:52.107965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df8741-9efb-4d1f-a6a2-6144277e3c71 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:52.108275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df8741-9efb-4d1f-a6a2-6144277e3c71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:52.109739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df8741-9efb-4d1f-a6a2-6144277e3c71 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:52.113100 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46ee9-9a00-42b9-a7cf-aa17831fd310 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:52.113680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46ee9-9a00-42b9-a7cf-aa17831fd310 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:52.113680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46ee9-9a00-42b9-a7cf-aa17831fd310 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:52.115213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 449/912] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:06:52.115781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 464/913] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Aug 9 11:06:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:52.121000 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1ee37-bba8-4ddd-85de-a2e2d2928255 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:52.121446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1ee37-bba8-4ddd-85de-a2e2d2928255 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:52.121573 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1ee37-bba8-4ddd-85de-a2e2d2928255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:52.122816 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df8741-9efb-4d1f-a6a2-6144277e3c71 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:52.145880 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-0ae1ee37-bba8-4ddd-85de-a2e2d2928255 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:52.147547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0ae1ee37-bba8-4ddd-85de-a2e2d2928255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:52.171580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:52.173132 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:52.259033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df8741-9efb-4d1f-a6a2-6144277e3c71 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:52.262292 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 450/914] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:52.283127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1ee37-bba8-4ddd-85de-a2e2d2928255 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:52.302896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852937c-d33d-4633-9275-d5fce06666df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:52.303946 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852937c-d33d-4633-9275-d5fce06666df None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:52.304580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852937c-d33d-4633-9275-d5fce06666df None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:52.305116 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852937c-d33d-4633-9275-d5fce06666df None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:52.305981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852937c-d33d-4633-9275-d5fce06666df None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:52.306498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852937c-d33d-4633-9275-d5fce06666df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:52.308383 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852937c-d33d-4633-9275-d5fce06666df None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:52.314827 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 465/915] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Aug 9 11:06:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:52.321770 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852937c-d33d-4633-9275-d5fce06666df None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:52.387956 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1ee37-bba8-4ddd-85de-a2e2d2928255 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:52.433910 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f841a-9e1b-4f3d-a201-7fbd01c312b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:52.434525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f841a-9e1b-4f3d-a201-7fbd01c312b9 None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:52.434794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f841a-9e1b-4f3d-a201-7fbd01c312b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:52.435056 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f841a-9e1b-4f3d-a201-7fbd01c312b9 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:52.435703 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f841a-9e1b-4f3d-a201-7fbd01c312b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:52.437686 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f841a-9e1b-4f3d-a201-7fbd01c312b9 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:52.448010 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:52.452985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852937c-d33d-4633-9275-d5fce06666df None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:52.461803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 451/916] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Aug 9 11:06:52 2022] POST /identity/v3/services => generated 241 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:06:52.474524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f777ae0-dd17-435c-82c1-d0466d392d5b None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:52.475101 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f777ae0-dd17-435c-82c1-d0466d392d5b None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:52.475546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f777ae0-dd17-435c-82c1-d0466d392d5b None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:52.477775 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 452/917] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:52.488120 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6265b31-5443-48a9-acaf-a926bfbc3ce9 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:52.488700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6265b31-5443-48a9-acaf-a926bfbc3ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:52.489253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6265b31-5443-48a9-acaf-a926bfbc3ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:52.509972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-b6265b31-5443-48a9-acaf-a926bfbc3ce9 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:52.511509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b6265b31-5443-48a9-acaf-a926bfbc3ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:52.513774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ed11b-0a7a-47a2-83cc-c9e8b80c7d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:52.514395 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ed11b-0a7a-47a2-83cc-c9e8b80c7d75 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:52.514665 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ed11b-0a7a-47a2-83cc-c9e8b80c7d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:52.514932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ed11b-0a7a-47a2-83cc-c9e8b80c7d75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:52.515624 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ed11b-0a7a-47a2-83cc-c9e8b80c7d75 None admin] RBAC: Adding query filter params (interface=public, service_id=968e18df9c204bb88b1d279714bdd669, region_id=RegionOne) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:52.516055 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ed11b-0a7a-47a2-83cc-c9e8b80c7d75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:52.517470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ed11b-0a7a-47a2-83cc-c9e8b80c7d75 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:52.521930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:52.528196 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 466/918] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Aug 9 11:06:52 2022] GET /identity/v3/endpoints?service_id=968e18df9c204bb88b1d279714bdd669&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:52.530370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ed11b-0a7a-47a2-83cc-c9e8b80c7d75 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:52.595946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 453/919] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:52.618108 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6265b31-5443-48a9-acaf-a926bfbc3ce9 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:52.671650 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ed11b-0a7a-47a2-83cc-c9e8b80c7d75 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:52.713071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0469a1-a331-4951-a3dc-f7952837665e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:52.714049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0469a1-a331-4951-a3dc-f7952837665e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:52.714515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0469a1-a331-4951-a3dc-f7952837665e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:52.714881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0469a1-a331-4951-a3dc-f7952837665e None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:52.715594 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0469a1-a331-4951-a3dc-f7952837665e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:52.717057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0469a1-a331-4951-a3dc-f7952837665e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:52.723961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 467/920] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Aug 9 11:06:52 2022] GET /identity/v3/services => generated 1497 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:06:52.730285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6265b31-5443-48a9-acaf-a926bfbc3ce9 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:52.774913 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c5cba-e460-4131-afa7-2d844c69f8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:52.775471 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c5cba-e460-4131-afa7-2d844c69f8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:52.775739 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c5cba-e460-4131-afa7-2d844c69f8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:52.775998 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c5cba-e460-4131-afa7-2d844c69f8e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:52.788851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c5cba-e460-4131-afa7-2d844c69f8e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-7b0c5cba-e460-4131-afa7-2d844c69f8e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:52.793851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:52.794931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:52.796050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:52.796050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:52.796050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:52.796050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:52.796050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:52.796050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:52.796050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:52.796050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:52.796050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:52.796050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:52.796050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:06:52.796050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:52.796050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 454/921] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Aug 9 11:06:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:52.803237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0469a1-a331-4951-a3dc-f7952837665e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:52.832369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:52.916598 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0469a1-a331-4951-a3dc-f7952837665e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:52.952344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d45ca-91be-4261-bff5-c1fa7fe3e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:52.953323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d45ca-91be-4261-bff5-c1fa7fe3e454 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:52.953867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d45ca-91be-4261-bff5-c1fa7fe3e454 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:52.954343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d45ca-91be-4261-bff5-c1fa7fe3e454 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:52.955205 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d45ca-91be-4261-bff5-c1fa7fe3e454 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:52.955699 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d45ca-91be-4261-bff5-c1fa7fe3e454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:52.957438 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d45ca-91be-4261-bff5-c1fa7fe3e454 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:52.967039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 468/922] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Aug 9 11:06:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:52.974780 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c5cba-e460-4131-afa7-2d844c69f8e5 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:52.980848 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:53.082580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c5cba-e460-4131-afa7-2d844c69f8e5 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:53.121274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4eabaa-7ed2-4bcb-b0b8-72ebc0d109b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:53.122128 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eabaa-7ed2-4bcb-b0b8-72ebc0d109b7 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:53.122216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eabaa-7ed2-4bcb-b0b8-72ebc0d109b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:53.122450 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eabaa-7ed2-4bcb-b0b8-72ebc0d109b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:53.134253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4eabaa-7ed2-4bcb-b0b8-72ebc0d109b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:53.135733 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4eabaa-7ed2-4bcb-b0b8-72ebc0d109b7 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-3c4eabaa-7ed2-4bcb-b0b8-72ebc0d109b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:53.156346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:53.157507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:53.158517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:53.158517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:53.158517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:53.159344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 455/923] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:53.165333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d45ca-91be-4261-bff5-c1fa7fe3e454 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:53.257243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:53.273934 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d45ca-91be-4261-bff5-c1fa7fe3e454 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:53.307704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf862d8-62ef-4606-a6bc-7638307b543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:53.308313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf862d8-62ef-4606-a6bc-7638307b543e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:53.308585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf862d8-62ef-4606-a6bc-7638307b543e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:53.308848 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf862d8-62ef-4606-a6bc-7638307b543e None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:53.309482 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf862d8-62ef-4606-a6bc-7638307b543e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:53.309879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf862d8-62ef-4606-a6bc-7638307b543e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:53.311240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf862d8-62ef-4606-a6bc-7638307b543e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:53.323780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 469/924] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:53.329720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4eabaa-7ed2-4bcb-b0b8-72ebc0d109b7 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:53.392281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:53.438099 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4eabaa-7ed2-4bcb-b0b8-72ebc0d109b7 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:53.472632 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfd0bc-ff60-40ed-a835-c21ee7945067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:53.473269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfd0bc-ff60-40ed-a835-c21ee7945067 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:53.473541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfd0bc-ff60-40ed-a835-c21ee7945067 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:53.473834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfd0bc-ff60-40ed-a835-c21ee7945067 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:53.487522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfd0bc-ff60-40ed-a835-c21ee7945067 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:53.489006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfd0bc-ff60-40ed-a835-c21ee7945067 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-a0dfd0bc-ff60-40ed-a835-c21ee7945067 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:53.501058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:53.502118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:53.503310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:53.503310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:53.503310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:53.503310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:53.503310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:53.503310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:53.503310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:53.503310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:53.503310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:06:53.503310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:53.503310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 456/925] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Aug 9 11:06:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:53.510714 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf862d8-62ef-4606-a6bc-7638307b543e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:53.618753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf862d8-62ef-4606-a6bc-7638307b543e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:53.654654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec0fb3-7eb0-40b4-800b-56cb357c51f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:53.655243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec0fb3-7eb0-40b4-800b-56cb357c51f0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:53.655520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec0fb3-7eb0-40b4-800b-56cb357c51f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:53.655784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec0fb3-7eb0-40b4-800b-56cb357c51f0 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:53.656523 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec0fb3-7eb0-40b4-800b-56cb357c51f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:53.656815 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec0fb3-7eb0-40b4-800b-56cb357c51f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:53.658289 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec0fb3-7eb0-40b4-800b-56cb357c51f0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:53.677511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 470/926] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Aug 9 11:06:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:53.683452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfd0bc-ff60-40ed-a835-c21ee7945067 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:53.794890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfd0bc-ff60-40ed-a835-c21ee7945067 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:53.809653 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:53.830338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282d0bf-5bef-4eb6-b38c-1efe24822f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:53.830965 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282d0bf-5bef-4eb6-b38c-1efe24822f49 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:53.831232 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282d0bf-5bef-4eb6-b38c-1efe24822f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:53.831496 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282d0bf-5bef-4eb6-b38c-1efe24822f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:53.842861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282d0bf-5bef-4eb6-b38c-1efe24822f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:53.844346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282d0bf-5bef-4eb6-b38c-1efe24822f49 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-0282d0bf-5bef-4eb6-b38c-1efe24822f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:53.859369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:53.860377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:53.861500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:53.861500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:53.861500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:53.861500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 457/927] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:53.867958 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec0fb3-7eb0-40b4-800b-56cb357c51f0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:53.877459 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:53.973436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec0fb3-7eb0-40b4-800b-56cb357c51f0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:54.008715 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e144a9-3a4f-4287-b22b-d3c8059468a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:54.009739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e144a9-3a4f-4287-b22b-d3c8059468a7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:54.010208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e144a9-3a4f-4287-b22b-d3c8059468a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:54.010703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e144a9-3a4f-4287-b22b-d3c8059468a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:54.011544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e144a9-3a4f-4287-b22b-d3c8059468a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:54.012040 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e144a9-3a4f-4287-b22b-d3c8059468a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:54.013603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e144a9-3a4f-4287-b22b-d3c8059468a7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:54.029788 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 471/928] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:54.032466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282d0bf-5bef-4eb6-b38c-1efe24822f49 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:54.141217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282d0bf-5bef-4eb6-b38c-1efe24822f49 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:54.162988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af55ad-a5e1-40ba-8a83-707b9b334dd0 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:54.163338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af55ad-a5e1-40ba-8a83-707b9b334dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:54.163529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af55ad-a5e1-40ba-8a83-707b9b334dd0 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:54.165786 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 472/929] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:54.171185 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f32f8-0bb8-4f09-bdf1-040f8adc1ad5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:54.171468 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f32f8-0bb8-4f09-bdf1-040f8adc1ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:54.171956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f32f8-0bb8-4f09-bdf1-040f8adc1ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:54.179825 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cc0a1-8b4a-40a1-ac96-c996d64bfe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:54.180776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cc0a1-8b4a-40a1-ac96-c996d64bfe6a None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:54.181254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cc0a1-8b4a-40a1-ac96-c996d64bfe6a None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:54.181938 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cc0a1-8b4a-40a1-ac96-c996d64bfe6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:54.189920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cc0a1-8b4a-40a1-ac96-c996d64bfe6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:54.191561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f31f32f8-0bb8-4f09-bdf1-040f8adc1ad5 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:54.191976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cc0a1-8b4a-40a1-ac96-c996d64bfe6a None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:54.192925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f31f32f8-0bb8-4f09-bdf1-040f8adc1ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:54.205091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-3f5cc0a1-8b4a-40a1-ac96-c996d64bfe6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:54.205091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:54.205091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:54.205091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:54.205091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:54.205091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:54.205091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:54.205091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:54.205091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:54.205091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:54.205091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:54.205091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:54.205091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:54.205091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:54.205091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:54.206328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:54.207236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:54.207236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:54.207236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:54.207236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:54.207236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:54.207236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:54.207236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:54.207236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:54.209693 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 458/930] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:54.219415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cc0a1-8b4a-40a1-ac96-c996d64bfe6a None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:54.256107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:54.258317 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:54.274036 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 473/931] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:06:54.297542 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f32f8-0bb8-4f09-bdf1-040f8adc1ad5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:54.343526 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cc0a1-8b4a-40a1-ac96-c996d64bfe6a None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:54.380849 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fadb5b-4fcd-4298-ac9a-60b34c8a5a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:54.381459 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fadb5b-4fcd-4298-ac9a-60b34c8a5a96 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:54.381758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fadb5b-4fcd-4298-ac9a-60b34c8a5a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:54.382024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fadb5b-4fcd-4298-ac9a-60b34c8a5a96 None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:54.382874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fadb5b-4fcd-4298-ac9a-60b34c8a5a96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:54.383240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fadb5b-4fcd-4298-ac9a-60b34c8a5a96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:54.384793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fadb5b-4fcd-4298-ac9a-60b34c8a5a96 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:54.399299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 459/932] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:54.403988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f32f8-0bb8-4f09-bdf1-040f8adc1ad5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:54.411855 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fadb5b-4fcd-4298-ac9a-60b34c8a5a96 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:54.440068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d996447-cfc6-4b42-82d4-1b3dd98b2961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:54.440686 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d996447-cfc6-4b42-82d4-1b3dd98b2961 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:54.440995 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d996447-cfc6-4b42-82d4-1b3dd98b2961 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:54.441217 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d996447-cfc6-4b42-82d4-1b3dd98b2961 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:54.441904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d996447-cfc6-4b42-82d4-1b3dd98b2961 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:54.443331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d996447-cfc6-4b42-82d4-1b3dd98b2961 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:54.446478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: WARNING keystone.server.flask.common [None req-0d996447-cfc6-4b42-82d4-1b3dd98b2961 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 09 11:06:54.469103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.sql.core [None req-0d996447-cfc6-4b42-82d4-1b3dd98b2961 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 11:06:54.469103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 11:06:54.469103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [parameters: {'id': '4cde09cc58464de886f8e38a99629aec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 11:06:54.469103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80168) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 11:06:54.477274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-0d996447-cfc6-4b42-82d4-1b3dd98b2961 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4cde09cc58464de886f8e38a99629aec.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4cde09cc58464de886f8e38a99629aec. Aug 09 11:06:54.477274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:54.477274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 11:06:54.477274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 11:06:54.477274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 11:06:54.477274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 11:06:54.477274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 11:06:54.477274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 11:06:54.477274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 11:06:54.477274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application conn.query(q) Aug 09 11:06:54.477274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 11:06:54.477274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 11:06:54.477274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result.read() Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 09 11:06:54.478155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application next(self.gen) Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application yield resource Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application next(self.gen) Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise self.value Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application session.commit() Aug 09 11:06:54.479132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.session.flush() Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application compat.raise_( Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 11:06:54.480580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 11:06:54.481503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 11:06:54.481503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 11:06:54.481503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 11:06:54.481503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 11:06:54.481503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 11:06:54.481503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 11:06:54.481503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 11:06:54.481503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 11:06:54.481503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 11:06:54.481503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 11:06:54.481503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 11:06:54.481503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 11:06:54.481503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 11:06:54.481503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 11:06:54.481503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application conn.query(q) Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result.read() Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 11:06:54.482320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 11:06:54.483191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 11:06:54.483191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 11:06:54.483191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 11:06:54.483191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 11:06:54.483191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 11:06:54.483191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 11:06:54.483191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 11:06:54.483191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 11:06:54.483191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [parameters: {'id': '4cde09cc58464de886f8e38a99629aec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 11:06:54.483191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 11:06:54.483191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:54.483191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:54.483191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:54.483191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:54.483191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:54.489349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:54.492169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:54.492169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 09 11:06:54.492169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 09 11:06:54.492169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:54.492169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:54.492169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 09 11:06:54.492169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 09 11:06:54.492169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4cde09cc58464de886f8e38a99629aec. Aug 09 11:06:54.492169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:54.492169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 474/933] 10.222.0.15 () {60 vars in 1140 bytes} [Tue Aug 9 11:06:54 2022] POST /identity/v3/projects => generated 262 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:54.492169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d996447-cfc6-4b42-82d4-1b3dd98b2961 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:54.531842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:54.548010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fadb5b-4fcd-4298-ac9a-60b34c8a5a96 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:54.567314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:54.586499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4a079-8c31-47d6-a199-f2fdf8aae939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:54.587156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4a079-8c31-47d6-a199-f2fdf8aae939 None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:54.587428 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4a079-8c31-47d6-a199-f2fdf8aae939 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:54.587713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4a079-8c31-47d6-a199-f2fdf8aae939 None admin] PATH_INFO: `/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/345ec6b0da4c4f07a6047190f8b2182d/roles/f8b621041fe241a586be5bf0799ff298` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:54.589964 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4a079-8c31-47d6-a199-f2fdf8aae939 None admin] RBAC: Authorizing `identity:create_grant(project_id=166e5328bfae434ba19d12be2eaa7a1b, user_id=345ec6b0da4c4f07a6047190f8b2182d, role_id=f8b621041fe241a586be5bf0799ff298)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:54.591563 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4a079-8c31-47d6-a199-f2fdf8aae939 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:54.607767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 460/934] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:06:54 2022] PUT /identity/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/345ec6b0da4c4f07a6047190f8b2182d/roles/f8b621041fe241a586be5bf0799ff298 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:06:54.633704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d996447-cfc6-4b42-82d4-1b3dd98b2961 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:54.674167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28349f0-5d15-4451-8790-35c2d347c48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:54.675359 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28349f0-5d15-4451-8790-35c2d347c48e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:54.675876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28349f0-5d15-4451-8790-35c2d347c48e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:54.676368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28349f0-5d15-4451-8790-35c2d347c48e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:54.684812 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28349f0-5d15-4451-8790-35c2d347c48e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:54.687315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28349f0-5d15-4451-8790-35c2d347c48e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:54.694733 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc4567-0024-49e2-a22c-df66fb88f874 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:54.695575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc4567-0024-49e2-a22c-df66fb88f874 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:54.695717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc4567-0024-49e2-a22c-df66fb88f874 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:54.697652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 461/935] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:54.702873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-e28349f0-5d15-4451-8790-35c2d347c48e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:54.702873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:54.702873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:54.702873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:54.702873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:54.702873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:54.702873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:54.702873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:54.702873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:54.702873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:54.702873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:54.702873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:54.702873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:54.702873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:54.702873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:54.703838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:54.704731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:54.704731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:54.704731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:54.704731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:54.704731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:54.704731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:54.704731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:54.704731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:54.705185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e46395-3195-4b8c-9f03-f166af933d6c None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:54.705185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e46395-3195-4b8c-9f03-f166af933d6c None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:54.705185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e46395-3195-4b8c-9f03-f166af933d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:54.707942 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 475/936] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:54.715504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28349f0-5d15-4451-8790-35c2d347c48e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:54.723564 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-76e46395-3195-4b8c-9f03-f166af933d6c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:54.724762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-76e46395-3195-4b8c-9f03-f166af933d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:54.798744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 462/937] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:06:54.801455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cb0bf-52ef-42cf-9db4-f65c14c7f45c None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:54.801455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cb0bf-52ef-42cf-9db4-f65c14c7f45c None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:54.801455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cb0bf-52ef-42cf-9db4-f65c14c7f45c None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:54.803008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 463/938] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:54.810570 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6541c-eaa4-45f3-82ea-8d10199b7139 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:54.811004 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6541c-eaa4-45f3-82ea-8d10199b7139 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:54.811386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6541c-eaa4-45f3-82ea-8d10199b7139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:54.830603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-b7c6541c-eaa4-45f3-82ea-8d10199b7139 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:54.831978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b7c6541c-eaa4-45f3-82ea-8d10199b7139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:54.838156 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28349f0-5d15-4451-8790-35c2d347c48e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:54.847696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:54.874571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fdf8e-6b6a-4428-934d-44f23eab4d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:54.875184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fdf8e-6b6a-4428-934d-44f23eab4d50 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:54.875464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fdf8e-6b6a-4428-934d-44f23eab4d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:54.875761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fdf8e-6b6a-4428-934d-44f23eab4d50 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:54.876510 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fdf8e-6b6a-4428-934d-44f23eab4d50 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:54.876869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fdf8e-6b6a-4428-934d-44f23eab4d50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:54.878707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fdf8e-6b6a-4428-934d-44f23eab4d50 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:54.909714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 464/939] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:54.909714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6541c-eaa4-45f3-82ea-8d10199b7139 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:54.910160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 476/940] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Aug 9 11:06:54 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:54.919740 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:54.932203 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fdf8e-6b6a-4428-934d-44f23eab4d50 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:55.051681 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fdf8e-6b6a-4428-934d-44f23eab4d50 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:55.059730 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6541c-eaa4-45f3-82ea-8d10199b7139 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:55.097833 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65df3a-b9cb-4949-a705-708b298dfd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:55.098092 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65df3a-b9cb-4949-a705-708b298dfd0b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:55.098308 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65df3a-b9cb-4949-a705-708b298dfd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:55.098589 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65df3a-b9cb-4949-a705-708b298dfd0b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:55.099430 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65df3a-b9cb-4949-a705-708b298dfd0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:55.100552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65df3a-b9cb-4949-a705-708b298dfd0b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-5c65df3a-b9cb-4949-a705-708b298dfd0b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:55.111719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:55.112751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:55.113701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:55.113701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:55.113701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:55.113701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:55.113701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:55.113701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:55.113701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:55.113701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:55.113701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:55.113701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:55.113701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:55.113701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:55.113701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 11:06:55.113701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:55.114488 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca13f7-8495-494a-8175-0bb140b2480d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:55.114488 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca13f7-8495-494a-8175-0bb140b2480d None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:55.114488 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca13f7-8495-494a-8175-0bb140b2480d None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:55.114721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 477/941] 10.222.0.15 () {56 vars in 1132 bytes} [Tue Aug 9 11:06:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:55.114797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca13f7-8495-494a-8175-0bb140b2480d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:55.114797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca13f7-8495-494a-8175-0bb140b2480d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:55.115588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca13f7-8495-494a-8175-0bb140b2480d None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:55.121829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65df3a-b9cb-4949-a705-708b298dfd0b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-3eca13f7-8495-494a-8175-0bb140b2480d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:55.124909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:55.126044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:55.126909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:55.126909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:55.126909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:55.126909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:55.126909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:55.126909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:55.126909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:55.126909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:55.126909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:55.126909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:55.126909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:55.126909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:55.126909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:06:55.126909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:55.127664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 465/942] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Aug 9 11:06:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:55.133713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca13f7-8495-494a-8175-0bb140b2480d None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:55.165745 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:55.218092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:55.253203 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca13f7-8495-494a-8175-0bb140b2480d None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:55.266806 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65df3a-b9cb-4949-a705-708b298dfd0b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:55.298694 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491818f-59e9-4c5c-9392-32d73a9fe9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:55.299586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491818f-59e9-4c5c-9392-32d73a9fe9dc None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:55.300031 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491818f-59e9-4c5c-9392-32d73a9fe9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:55.300622 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491818f-59e9-4c5c-9392-32d73a9fe9dc None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:55.301266 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491818f-59e9-4c5c-9392-32d73a9fe9dc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:55.301569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491818f-59e9-4c5c-9392-32d73a9fe9dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:55.303621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491818f-59e9-4c5c-9392-32d73a9fe9dc None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:55.314806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 466/943] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Aug 9 11:06:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:55.315004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b9b6a-ee28-4357-a06a-928ca1232d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:55.315004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b9b6a-ee28-4357-a06a-928ca1232d1d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:55.315004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b9b6a-ee28-4357-a06a-928ca1232d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:55.315242 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b9b6a-ee28-4357-a06a-928ca1232d1d None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:55.316438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491818f-59e9-4c5c-9392-32d73a9fe9dc None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:55.317098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b9b6a-ee28-4357-a06a-928ca1232d1d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:55.317396 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b9b6a-ee28-4357-a06a-928ca1232d1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:55.319051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b9b6a-ee28-4357-a06a-928ca1232d1d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:55.326187 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 478/944] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Aug 9 11:06:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:55.331789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b9b6a-ee28-4357-a06a-928ca1232d1d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:55.443766 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491818f-59e9-4c5c-9392-32d73a9fe9dc None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:55.465303 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:55.472728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b9b6a-ee28-4357-a06a-928ca1232d1d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:55.489806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c58be-5d44-4412-a25f-bcb0f3fbb518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:55.490417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c58be-5d44-4412-a25f-bcb0f3fbb518 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:55.490691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c58be-5d44-4412-a25f-bcb0f3fbb518 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:55.491078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c58be-5d44-4412-a25f-bcb0f3fbb518 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:55.491769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c58be-5d44-4412-a25f-bcb0f3fbb518 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:55.492179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c58be-5d44-4412-a25f-bcb0f3fbb518 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:55.493753 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c58be-5d44-4412-a25f-bcb0f3fbb518 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:55.495256 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:55.500052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 467/945] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Aug 9 11:06:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:55.506591 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c58be-5d44-4412-a25f-bcb0f3fbb518 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:55.517915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88a6ce-cb0a-48e9-82d6-7828d8686cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:55.519222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88a6ce-cb0a-48e9-82d6-7828d8686cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:55.519917 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88a6ce-cb0a-48e9-82d6-7828d8686cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:55.520355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88a6ce-cb0a-48e9-82d6-7828d8686cb0 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:55.520992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88a6ce-cb0a-48e9-82d6-7828d8686cb0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:55.521683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88a6ce-cb0a-48e9-82d6-7828d8686cb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:55.523605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88a6ce-cb0a-48e9-82d6-7828d8686cb0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:55.530564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 479/946] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Aug 9 11:06:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:55.537737 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88a6ce-cb0a-48e9-82d6-7828d8686cb0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:55.632802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c58be-5d44-4412-a25f-bcb0f3fbb518 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:55.653953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88a6ce-cb0a-48e9-82d6-7828d8686cb0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:55.667182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c874ff-2b15-4320-9785-55190dc29e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:55.667791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c874ff-2b15-4320-9785-55190dc29e45 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:55.668061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c874ff-2b15-4320-9785-55190dc29e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:55.668325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c874ff-2b15-4320-9785-55190dc29e45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:55.669031 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c874ff-2b15-4320-9785-55190dc29e45 None admin] RBAC: Adding query filter params (interface=public, service_id=6bae78cd1177486fa32b77ebd80bda93, region_id=RegionOne) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:55.669329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c874ff-2b15-4320-9785-55190dc29e45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:55.670764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c874ff-2b15-4320-9785-55190dc29e45 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:55.676432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 468/947] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Aug 9 11:06:55 2022] GET /identity/v3/endpoints?service_id=6bae78cd1177486fa32b77ebd80bda93&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:06:55.681945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c874ff-2b15-4320-9785-55190dc29e45 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:55.691215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554b236-94bc-43e6-befa-2d896e194a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:55.691920 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554b236-94bc-43e6-befa-2d896e194a57 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:55.692261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554b236-94bc-43e6-befa-2d896e194a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:55.692589 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554b236-94bc-43e6-befa-2d896e194a57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:55.693377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554b236-94bc-43e6-befa-2d896e194a57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:55.694926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554b236-94bc-43e6-befa-2d896e194a57 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:55.719891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 480/948] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:06:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:06:55.763603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:55.812002 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c874ff-2b15-4320-9785-55190dc29e45 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:55.856719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12897d8-4c4d-4a87-a613-61991c17ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:55.857333 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12897d8-4c4d-4a87-a613-61991c17ef03 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:55.857667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12897d8-4c4d-4a87-a613-61991c17ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:55.857936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12897d8-4c4d-4a87-a613-61991c17ef03 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:55.858587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12897d8-4c4d-4a87-a613-61991c17ef03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:55.859978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12897d8-4c4d-4a87-a613-61991c17ef03 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:55.867288 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 469/949] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Aug 9 11:06:55 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:06:56.677575 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50beb5-f443-4c7f-9138-95e8d4def2c6 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:56.678152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50beb5-f443-4c7f-9138-95e8d4def2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:56.678152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50beb5-f443-4c7f-9138-95e8d4def2c6 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:56.679799 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 481/950] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:56.685466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18210ddf-6a05-439b-be7b-2273a60b0dcd None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:56.685993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18210ddf-6a05-439b-be7b-2273a60b0dcd None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:56.686073 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18210ddf-6a05-439b-be7b-2273a60b0dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:56.706737 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-18210ddf-6a05-439b-be7b-2273a60b0dcd None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:56.707977 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-18210ddf-6a05-439b-be7b-2273a60b0dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:56.777241 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 470/951] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:56.799642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50beb5-f443-4c7f-9138-95e8d4def2c6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:56.818199 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:56.905971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50beb5-f443-4c7f-9138-95e8d4def2c6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:56.939532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f3e4c-b22e-40e5-9321-7d9835938799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:56.940159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f3e4c-b22e-40e5-9321-7d9835938799 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:56.940426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f3e4c-b22e-40e5-9321-7d9835938799 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:56.940687 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f3e4c-b22e-40e5-9321-7d9835938799 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:56.951355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f3e4c-b22e-40e5-9321-7d9835938799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-ea9f3e4c-b22e-40e5-9321-7d9835938799 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:06:56.955935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:56.958079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:56.960078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:56.960078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:56.960078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:56.960078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:56.960078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:06:56.960078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:06:56.960078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:06:56.960078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:06:56.960078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:06:56.960078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:06:56.960078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:06:56.960078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:56.960078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 482/952] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Aug 9 11:06:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:56.963421 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18210ddf-6a05-439b-be7b-2273a60b0dcd None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:57.015977 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:57.065773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18210ddf-6a05-439b-be7b-2273a60b0dcd None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:57.099684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2edd0-0d99-4f78-8db4-c5d4d7eeb7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:57.100281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2edd0-0d99-4f78-8db4-c5d4d7eeb7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:57.100546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2edd0-0d99-4f78-8db4-c5d4d7eeb7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:57.100797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2edd0-0d99-4f78-8db4-c5d4d7eeb7f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:57.101474 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2edd0-0d99-4f78-8db4-c5d4d7eeb7f2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:57.101798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2edd0-0d99-4f78-8db4-c5d4d7eeb7f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:57.103162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f2edd0-0d99-4f78-8db4-c5d4d7eeb7f2 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:57.111750 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 471/953] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Aug 9 11:06:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:57.114342 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcc01c-5d3e-4465-9fa3-ca931020711b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:57.114684 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcc01c-5d3e-4465-9fa3-ca931020711b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:57.115019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcc01c-5d3e-4465-9fa3-ca931020711b None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:57.116395 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 483/954] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:06:57.120954 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2edd0-0d99-4f78-8db4-c5d4d7eeb7f2 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:57.121238 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b270ad-955d-4f18-a408-29ae10834039 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:57.121509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b270ad-955d-4f18-a408-29ae10834039 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:57.121800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b270ad-955d-4f18-a408-29ae10834039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:57.147757 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-98b270ad-955d-4f18-a408-29ae10834039 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:57.149836 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-98b270ad-955d-4f18-a408-29ae10834039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:57.228076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 484/955] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:06:57.234936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2edd0-0d99-4f78-8db4-c5d4d7eeb7f2 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:57.249905 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:57.252498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b270ad-955d-4f18-a408-29ae10834039 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:57.262957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:57.275154 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad67a3-56a8-4b73-ba35-01994e205798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:57.275874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad67a3-56a8-4b73-ba35-01994e205798 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:57.276496 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad67a3-56a8-4b73-ba35-01994e205798 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:57.276834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad67a3-56a8-4b73-ba35-01994e205798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:57.289203 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad67a3-56a8-4b73-ba35-01994e205798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:57.290848 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad67a3-56a8-4b73-ba35-01994e205798 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-84ad67a3-56a8-4b73-ba35-01994e205798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:57.306153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:57.307419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:57.308704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:57.308704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:57.308704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:57.309393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 472/956] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:57.314864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad67a3-56a8-4b73-ba35-01994e205798 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:57.368556 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b270ad-955d-4f18-a408-29ae10834039 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:57.406589 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1616e7a-aab0-4ab8-a066-0f26bffdfbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:57.407492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1616e7a-aab0-4ab8-a066-0f26bffdfbaa None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:57.407901 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1616e7a-aab0-4ab8-a066-0f26bffdfbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:57.408338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1616e7a-aab0-4ab8-a066-0f26bffdfbaa None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:57.409247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1616e7a-aab0-4ab8-a066-0f26bffdfbaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:57.410990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1616e7a-aab0-4ab8-a066-0f26bffdfbaa None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:57.428050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.sql.core [None req-f1616e7a-aab0-4ab8-a066-0f26bffdfbaa None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 11:06:57.428050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 11:06:57.428050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [parameters: {'user_id': '48eda6356f604b7a93536f2ba73d8ecd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 11:06:57.428050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80168) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 11:06:57.429836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad67a3-56a8-4b73-ba35-01994e205798 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:57.436879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-f1616e7a-aab0-4ab8-a066-0f26bffdfbaa None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 11:06:57.436879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:57.436879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 11:06:57.436879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 11:06:57.436879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 11:06:57.436879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 11:06:57.436879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 11:06:57.436879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 11:06:57.436879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 11:06:57.436879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application conn.query(q) Aug 09 11:06:57.436879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 11:06:57.436879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 11:06:57.436879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 11:06:57.436879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result.read() Aug 09 11:06:57.436879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 11:06:57.437965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application next(self.gen) Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application yield resource Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application next(self.gen) Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise self.value Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application session.commit() Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 11:06:57.439141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.session.flush() Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application compat.raise_( Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 11:06:57.440339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 11:06:57.441965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application conn.query(q) Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application result.read() Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 11:06:57.443095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 11:06:57.444150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 11:06:57.444150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 11:06:57.444150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 11:06:57.444150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 11:06:57.444150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 11:06:57.444150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 11:06:57.444150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [parameters: {'user_id': '48eda6356f604b7a93536f2ba73d8ecd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 11:06:57.444150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 11:06:57.444150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:57.444150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:57.444150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:57.444150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:57.444150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:57.444150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:57.444150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 09 11:06:57.445184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 09 11:06:57.446387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 09 11:06:57.446387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 09 11:06:57.446387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 11:06:57.446387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 11:06:57.446387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 11:06:57.446387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:57.453744 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 485/957] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Aug 9 11:06:57 2022] POST /identity/v3/users => generated 160 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:57.455167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1616e7a-aab0-4ab8-a066-0f26bffdfbaa None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:57.485578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a3592-d10a-422b-8022-e7e63d24fa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:57.486798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a3592-d10a-422b-8022-e7e63d24fa4f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:57.487324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a3592-d10a-422b-8022-e7e63d24fa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:57.487846 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a3592-d10a-422b-8022-e7e63d24fa4f None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:57.489093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a3592-d10a-422b-8022-e7e63d24fa4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:57.489999 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a3592-d10a-422b-8022-e7e63d24fa4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:57.492113 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a3592-d10a-422b-8022-e7e63d24fa4f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:57.506902 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 473/958] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:57.512554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a3592-d10a-422b-8022-e7e63d24fa4f None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:57.543656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:57.557392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:57.597496 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1616e7a-aab0-4ab8-a066-0f26bffdfbaa None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:57.625213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a3592-d10a-422b-8022-e7e63d24fa4f None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:57.647819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117859a6-accf-4eec-b1a2-182ab83325c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:57.648592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117859a6-accf-4eec-b1a2-182ab83325c9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:57.648927 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117859a6-accf-4eec-b1a2-182ab83325c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:57.649274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117859a6-accf-4eec-b1a2-182ab83325c9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:57.656841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117859a6-accf-4eec-b1a2-182ab83325c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:57.658601 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117859a6-accf-4eec-b1a2-182ab83325c9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:57.668828 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad5e82-74da-4b75-b94d-0b63a83d41f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:57.669747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad5e82-74da-4b75-b94d-0b63a83d41f3 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:57.670211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad5e82-74da-4b75-b94d-0b63a83d41f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-117859a6-accf-4eec-b1a2-182ab83325c9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:57.670325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:57.671212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:57.672164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:57.672164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:57.672164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:57.672164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:57.672164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:57.672164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:57.672164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:57.672164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:57.672164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 11:06:57.672164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:57.673366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad5e82-74da-4b75-b94d-0b63a83d41f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:57.676289 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 486/959] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:06:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:06:57.677632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117859a6-accf-4eec-b1a2-182ab83325c9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:57.683904 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad5e82-74da-4b75-b94d-0b63a83d41f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:57.685674 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad5e82-74da-4b75-b94d-0b63a83d41f3 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-d5ad5e82-74da-4b75-b94d-0b63a83d41f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:06:57.701811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:57.702895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:57.703866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:57.703866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:57.703866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:06:57.703866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:06:57.703866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:06:57.703866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:06:57.703866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:06:57.703866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:06:57.703866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 11:06:57.703866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:57.706888 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 474/960] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Aug 9 11:06:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:57.713299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad5e82-74da-4b75-b94d-0b63a83d41f3 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:57.792052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117859a6-accf-4eec-b1a2-182ab83325c9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:57.808661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:57.821602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:57.831045 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f187e9-bdce-4e1e-87a3-75f19218b043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:57.831394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad5e82-74da-4b75-b94d-0b63a83d41f3 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:57.832246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f187e9-bdce-4e1e-87a3-75f19218b043 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:57.832716 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f187e9-bdce-4e1e-87a3-75f19218b043 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:57.833185 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f187e9-bdce-4e1e-87a3-75f19218b043 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:57.834111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f187e9-bdce-4e1e-87a3-75f19218b043 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:57.834623 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f187e9-bdce-4e1e-87a3-75f19218b043 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:57.836317 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f187e9-bdce-4e1e-87a3-75f19218b043 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:57.868625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d15907-0de0-4ca3-835c-4c796cbda5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:57.869420 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d15907-0de0-4ca3-835c-4c796cbda5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:57.869649 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d15907-0de0-4ca3-835c-4c796cbda5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:57.869890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d15907-0de0-4ca3-835c-4c796cbda5f3 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:57.870725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d15907-0de0-4ca3-835c-4c796cbda5f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:57.870969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d15907-0de0-4ca3-835c-4c796cbda5f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:57.872384 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d15907-0de0-4ca3-835c-4c796cbda5f3 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:57.875919 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 487/961] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Aug 9 11:06:57 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:57.879735 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195da331-8ea6-46eb-b3b6-cad53ebdc682 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:57.880284 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195da331-8ea6-46eb-b3b6-cad53ebdc682 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:57.880774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195da331-8ea6-46eb-b3b6-cad53ebdc682 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:57.887194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 488/962] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:57.889162 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a629df-744a-4660-8f3a-bce5d8c8b6a6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:57.889763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a629df-744a-4660-8f3a-bce5d8c8b6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:57.890263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a629df-744a-4660-8f3a-bce5d8c8b6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:57.893079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 475/963] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Aug 9 11:06:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:57.899183 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d15907-0de0-4ca3-835c-4c796cbda5f3 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:57.911219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-02a629df-744a-4660-8f3a-bce5d8c8b6a6 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:57.913358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-02a629df-744a-4660-8f3a-bce5d8c8b6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:58.000679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 489/964] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:06:58.000679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff471d-965f-4eaa-9985-7ef4cc25ca23 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:58.000679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff471d-965f-4eaa-9985-7ef4cc25ca23 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:58.000679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff471d-965f-4eaa-9985-7ef4cc25ca23 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:58.000679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 490/965] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:06:58.005634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb304d-0562-4556-b042-0c74c8a72328 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:58.005940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb304d-0562-4556-b042-0c74c8a72328 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:58.006213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb304d-0562-4556-b042-0c74c8a72328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:58.019218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d15907-0de0-4ca3-835c-4c796cbda5f3 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:58.025293 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-deeb304d-0562-4556-b042-0c74c8a72328 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:06:58.026584 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-deeb304d-0562-4556-b042-0c74c8a72328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:06:58.056623 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022eac-6b08-4f46-ac32-46c019059171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:58.057225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022eac-6b08-4f46-ac32-46c019059171 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:58.057491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022eac-6b08-4f46-ac32-46c019059171 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:58.057783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022eac-6b08-4f46-ac32-46c019059171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:58.077012 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:58.109610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 491/966] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:06:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:06:58.110816 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb304d-0562-4556-b042-0c74c8a72328 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:58.148493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0022eac-6b08-4f46-ac32-46c019059171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:58.149928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0022eac-6b08-4f46-ac32-46c019059171 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:58.169141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:58.225130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb304d-0562-4556-b042-0c74c8a72328 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:58.259412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e203685-f751-4e2a-b4f0-aae1f2f261d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:58.259675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 476/967] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:06:57 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:06:58.260045 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e203685-f751-4e2a-b4f0-aae1f2f261d7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:58.260314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e203685-f751-4e2a-b4f0-aae1f2f261d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:58.260581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e203685-f751-4e2a-b4f0-aae1f2f261d7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:58.260937 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022eac-6b08-4f46-ac32-46c019059171 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:58.261158 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e203685-f751-4e2a-b4f0-aae1f2f261d7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:58.262560 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e203685-f751-4e2a-b4f0-aae1f2f261d7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-7e203685-f751-4e2a-b4f0-aae1f2f261d7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:58.272161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:58.273452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:58.274365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:58.274365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:58.274365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:58.274365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:58.274365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:58.274365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:58.274365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:58.274365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:58.274365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:58.274365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:58.274365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:58.274365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:58.274365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:06:58.274365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:58.274365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 492/968] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:58.275195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e203685-f751-4e2a-b4f0-aae1f2f261d7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:58.310726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:58.363853 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022eac-6b08-4f46-ac32-46c019059171 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:58.371314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e203685-f751-4e2a-b4f0-aae1f2f261d7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:58.386515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:58.397436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b186ff-d005-4a43-9335-dcd72e96d7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:58.398136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b186ff-d005-4a43-9335-dcd72e96d7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:58.398406 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b186ff-d005-4a43-9335-dcd72e96d7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:58.398721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b186ff-d005-4a43-9335-dcd72e96d7e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:58.399250 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b186ff-d005-4a43-9335-dcd72e96d7e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:58.400629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b186ff-d005-4a43-9335-dcd72e96d7e3 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-58b186ff-d005-4a43-9335-dcd72e96d7e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:58.408952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:58.410283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:58.411344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:58.411344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:58.411344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:58.411344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:58.411344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:58.411344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:58.411344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:58.411344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:58.411344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:58.411344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:58.411344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:06:58.411344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:06:58.411344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:06:58.411344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:06:58.411344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 477/969] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Aug 9 11:06:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:58.412331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b186ff-d005-4a43-9335-dcd72e96d7e3 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:58.413138 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e43945-e739-4935-b7a4-5529a44635f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:58.413867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e43945-e739-4935-b7a4-5529a44635f4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:58.414198 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e43945-e739-4935-b7a4-5529a44635f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:58.414520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e43945-e739-4935-b7a4-5529a44635f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:58.426118 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e43945-e739-4935-b7a4-5529a44635f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:58.427570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e43945-e739-4935-b7a4-5529a44635f4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-b8e43945-e739-4935-b7a4-5529a44635f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:06:58.442390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:58.443503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:06:58.444652 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:06:58.444652 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:06:58.444652 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:58.445044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 493/970] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:06:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:58.445869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e43945-e739-4935-b7a4-5529a44635f4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:58.515295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b186ff-d005-4a43-9335-dcd72e96d7e3 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:58.524628 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:58.550954 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe5096-7a6a-4210-b3a3-99abf295692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:58.551554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe5096-7a6a-4210-b3a3-99abf295692c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:58.551818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe5096-7a6a-4210-b3a3-99abf295692c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:58.552085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe5096-7a6a-4210-b3a3-99abf295692c None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:58.552709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe5096-7a6a-4210-b3a3-99abf295692c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:58.553004 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe5096-7a6a-4210-b3a3-99abf295692c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:58.555676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe5096-7a6a-4210-b3a3-99abf295692c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:58.555801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e43945-e739-4935-b7a4-5529a44635f4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:58.560707 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 478/971] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Aug 9 11:06:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:58.561672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe5096-7a6a-4210-b3a3-99abf295692c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:58.590801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe70fd6-8e3f-468e-9426-a206a3f64db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:58.591407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe70fd6-8e3f-468e-9426-a206a3f64db5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:58.591712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe70fd6-8e3f-468e-9426-a206a3f64db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:58.591999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe70fd6-8e3f-468e-9426-a206a3f64db5 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:58.592588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe70fd6-8e3f-468e-9426-a206a3f64db5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:58.592911 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe70fd6-8e3f-468e-9426-a206a3f64db5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:58.594326 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe70fd6-8e3f-468e-9426-a206a3f64db5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:58.599178 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 494/972] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Aug 9 11:06:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:58.599946 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe70fd6-8e3f-468e-9426-a206a3f64db5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:58.629114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:58.671449 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe5096-7a6a-4210-b3a3-99abf295692c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:58.701659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe70fd6-8e3f-468e-9426-a206a3f64db5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:58.705681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f4138-3eeb-43b1-84a4-2188526c7b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:58.706282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f4138-3eeb-43b1-84a4-2188526c7b57 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:58.706550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f4138-3eeb-43b1-84a4-2188526c7b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:58.706813 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f4138-3eeb-43b1-84a4-2188526c7b57 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:58.707451 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f4138-3eeb-43b1-84a4-2188526c7b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:58.707769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f4138-3eeb-43b1-84a4-2188526c7b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:58.709149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f4138-3eeb-43b1-84a4-2188526c7b57 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:58.721183 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 479/973] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:58.722087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f4138-3eeb-43b1-84a4-2188526c7b57 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:58.739597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424567d-9c5e-4570-bb20-9419f85f2b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:58.740206 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424567d-9c5e-4570-bb20-9419f85f2b17 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:58.740478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424567d-9c5e-4570-bb20-9419f85f2b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:58.740959 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424567d-9c5e-4570-bb20-9419f85f2b17 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:58.741371 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424567d-9c5e-4570-bb20-9419f85f2b17 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:58.741697 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424567d-9c5e-4570-bb20-9419f85f2b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:58.743052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424567d-9c5e-4570-bb20-9419f85f2b17 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:58.747535 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 495/974] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Aug 9 11:06:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:58.748295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424567d-9c5e-4570-bb20-9419f85f2b17 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:58.753189 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:58.833006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f4138-3eeb-43b1-84a4-2188526c7b57 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:58.872381 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:58.876464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe924a5d-89ba-4ccb-8d9e-be5d28817202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:58.877090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe924a5d-89ba-4ccb-8d9e-be5d28817202 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:58.877452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe924a5d-89ba-4ccb-8d9e-be5d28817202 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:58.877768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe924a5d-89ba-4ccb-8d9e-be5d28817202 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:58.878782 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe924a5d-89ba-4ccb-8d9e-be5d28817202 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:58.879155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe924a5d-89ba-4ccb-8d9e-be5d28817202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:58.880575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe924a5d-89ba-4ccb-8d9e-be5d28817202 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:58.885904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424567d-9c5e-4570-bb20-9419f85f2b17 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:58.887114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 480/975] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Aug 9 11:06:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:58.893020 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe924a5d-89ba-4ccb-8d9e-be5d28817202 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:58.928255 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d31d65-4b62-48ba-9256-49185f268df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:58.928797 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d31d65-4b62-48ba-9256-49185f268df1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:58.929085 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d31d65-4b62-48ba-9256-49185f268df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:58.929334 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d31d65-4b62-48ba-9256-49185f268df1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:58.936562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d31d65-4b62-48ba-9256-49185f268df1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:58.938048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d31d65-4b62-48ba-9256-49185f268df1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:58.950088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-60d31d65-4b62-48ba-9256-49185f268df1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:58.950088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:06:58.950088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:06:58.950088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:06:58.950088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:06:58.950088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:06:58.950088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:06:58.950088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:06:58.950088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:06:58.950088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:06:58.950088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:06:58.950088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:06:58.950088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:06:58.950088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:06:58.950088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:06:58.951037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:06:58.951960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:06:58.951960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:06:58.951960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:06:58.951960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:06:58.951960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:06:58.951960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:06:58.951960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:06:58.951960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:06:58.951960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 496/976] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:06:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:06:58.956815 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d31d65-4b62-48ba-9256-49185f268df1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:58.998484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:06:59.006631 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe924a5d-89ba-4ccb-8d9e-be5d28817202 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:59.042670 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae811fe-1437-481f-9c72-982b0dfb843a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:59.043278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae811fe-1437-481f-9c72-982b0dfb843a None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:59.043560 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae811fe-1437-481f-9c72-982b0dfb843a None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:59.043812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae811fe-1437-481f-9c72-982b0dfb843a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:59.044468 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae811fe-1437-481f-9c72-982b0dfb843a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:59.045883 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae811fe-1437-481f-9c72-982b0dfb843a None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:59.064529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d31d65-4b62-48ba-9256-49185f268df1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:59.077668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 481/977] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:06:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:06:59.116804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744028c7-fd95-46c2-8778-2d8880a0a25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:59.117427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744028c7-fd95-46c2-8778-2d8880a0a25a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:59.117730 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744028c7-fd95-46c2-8778-2d8880a0a25a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:59.117998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744028c7-fd95-46c2-8778-2d8880a0a25a None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:59.118684 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744028c7-fd95-46c2-8778-2d8880a0a25a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:59.118986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744028c7-fd95-46c2-8778-2d8880a0a25a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:59.120432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744028c7-fd95-46c2-8778-2d8880a0a25a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:59.135441 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 497/978] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:06:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:06:59.141815 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae811fe-1437-481f-9c72-982b0dfb843a None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:06:59.257786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae811fe-1437-481f-9c72-982b0dfb843a None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:06:59.293678 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabf025-524a-498c-9a35-d49157ba7faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:06:59.294306 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabf025-524a-498c-9a35-d49157ba7faf None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:06:59.294574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabf025-524a-498c-9a35-d49157ba7faf None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:06:59.294833 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabf025-524a-498c-9a35-d49157ba7faf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:06:59.295560 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eabf025-524a-498c-9a35-d49157ba7faf None admin] RBAC: Adding query filter params (role.id=f8b621041fe241a586be5bf0799ff298, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=345ec6b0da4c4f07a6047190f8b2182d) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:06:59.295865 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eabf025-524a-498c-9a35-d49157ba7faf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:06:59.297300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eabf025-524a-498c-9a35-d49157ba7faf None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:06:59.303839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 482/979] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:06:59 2022] GET /identity/v3/role_assignments?user.id=345ec6b0da4c4f07a6047190f8b2182d&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=f8b621041fe241a586be5bf0799ff298 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:00.741922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51da4a-a8c3-4dfa-bd6a-61bf580a5db6 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:00.742435 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51da4a-a8c3-4dfa-bd6a-61bf580a5db6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:00.742435 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51da4a-a8c3-4dfa-bd6a-61bf580a5db6 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:00.743871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 498/980] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:00.749042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96a450-9cfc-4bf4-b18c-dfc6f8627e4a None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:00.749466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96a450-9cfc-4bf4-b18c-dfc6f8627e4a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:00.749651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96a450-9cfc-4bf4-b18c-dfc6f8627e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:00.768941 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-aa96a450-9cfc-4bf4-b18c-dfc6f8627e4a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:00.770182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-aa96a450-9cfc-4bf4-b18c-dfc6f8627e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:00.782493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:00.843928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 483/981] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:00.865870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51da4a-a8c3-4dfa-bd6a-61bf580a5db6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:00.875291 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:00.973980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51da4a-a8c3-4dfa-bd6a-61bf580a5db6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:01.008872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975c040-d8eb-43de-852c-130af608cd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:01.009393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975c040-d8eb-43de-852c-130af608cd4d None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:01.009683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975c040-d8eb-43de-852c-130af608cd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:01.009951 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975c040-d8eb-43de-852c-130af608cd4d None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:01.010588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975c040-d8eb-43de-852c-130af608cd4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:01.011938 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975c040-d8eb-43de-852c-130af608cd4d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:01.037504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 499/982] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Aug 9 11:07:00 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:07:01.080402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1ef6-b5a7-4c05-a02e-27addbabb8ec None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:01.080685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1ef6-b5a7-4c05-a02e-27addbabb8ec None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:01.080949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff1ef6-b5a7-4c05-a02e-27addbabb8ec None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:01.082606 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 484/983] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:01.088378 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f57e7-dc7f-4eee-9482-1c118f0932e6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:01.088792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f57e7-dc7f-4eee-9482-1c118f0932e6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:01.089001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f57e7-dc7f-4eee-9482-1c118f0932e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:01.108782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9b0f57e7-dc7f-4eee-9482-1c118f0932e6 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:01.110018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9b0f57e7-dc7f-4eee-9482-1c118f0932e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:01.177816 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:01.200678 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 500/984] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:07:01.222301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff1ef6-b5a7-4c05-a02e-27addbabb8ec None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:01.326019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff1ef6-b5a7-4c05-a02e-27addbabb8ec None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:01.328880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e779df-a307-4a5e-9789-226753338ab9 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:01.329163 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e779df-a307-4a5e-9789-226753338ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:01.329603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e779df-a307-4a5e-9789-226753338ab9 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:01.331259 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 501/985] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:01.336971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecea9d-7852-4a47-b929-664a7985031b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:01.337250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecea9d-7852-4a47-b929-664a7985031b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:01.337517 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecea9d-7852-4a47-b929-664a7985031b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:01.358467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b2ecea9d-7852-4a47-b929-664a7985031b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:01.359653 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b2ecea9d-7852-4a47-b929-664a7985031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:01.363772 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df026d-ff26-4b01-a7d1-bb03307e759b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:01.364398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df026d-ff26-4b01-a7d1-bb03307e759b None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:01.364666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df026d-ff26-4b01-a7d1-bb03307e759b None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:01.364927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df026d-ff26-4b01-a7d1-bb03307e759b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:01.365507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df026d-ff26-4b01-a7d1-bb03307e759b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:01.366993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df026d-ff26-4b01-a7d1-bb03307e759b None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-27df026d-ff26-4b01-a7d1-bb03307e759b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:01.376267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:01.377334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:01.378602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:01.378602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:01.378602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:01.378602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:01.378602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:01.378602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:01.378602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:01.378602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:01.378602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:01.378602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:01.378602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:07:01.378602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:07:01.378602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:07:01.378602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:01.378602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 485/986] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Aug 9 11:07:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:01.383766 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df026d-ff26-4b01-a7d1-bb03307e759b None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:01.397457 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:01.444544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 502/987] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:07:01.459796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecea9d-7852-4a47-b929-664a7985031b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:01.499413 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df026d-ff26-4b01-a7d1-bb03307e759b None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:01.534717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66473d-ecf8-4045-bf7c-2ee8cd80a7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:01.535322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66473d-ecf8-4045-bf7c-2ee8cd80a7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:01.535587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66473d-ecf8-4045-bf7c-2ee8cd80a7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:01.535847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66473d-ecf8-4045-bf7c-2ee8cd80a7b5 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:01.536472 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66473d-ecf8-4045-bf7c-2ee8cd80a7b5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:01.536765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66473d-ecf8-4045-bf7c-2ee8cd80a7b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:01.538173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66473d-ecf8-4045-bf7c-2ee8cd80a7b5 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:01.543718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 486/988] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Aug 9 11:07:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:01.550042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66473d-ecf8-4045-bf7c-2ee8cd80a7b5 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:01.567883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecea9d-7852-4a47-b929-664a7985031b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:01.591491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:01.605236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8acdf-e62d-4fde-ad0c-5123659142c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:01.606042 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8acdf-e62d-4fde-ad0c-5123659142c8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:01.606313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8acdf-e62d-4fde-ad0c-5123659142c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:01.606575 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8acdf-e62d-4fde-ad0c-5123659142c8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:01.607149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8acdf-e62d-4fde-ad0c-5123659142c8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:01.608527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8acdf-e62d-4fde-ad0c-5123659142c8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-2fb8acdf-e62d-4fde-ad0c-5123659142c8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:01.617304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:01.618356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:01.619240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:01.619240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:01.619240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:01.619240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:01.619240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:01.619240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:01.619240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:01.619240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:01.619240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:01.619240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:01.619240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:07:01.619240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:07:01.619240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:07:01.619240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:01.619240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 503/989] 10.222.0.15 () {56 vars in 1105 bytes} [Tue Aug 9 11:07:01 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:07:01.624273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8acdf-e62d-4fde-ad0c-5123659142c8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:01.630748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:01.658280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66473d-ecf8-4045-bf7c-2ee8cd80a7b5 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:01.694273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ede3f-6f03-46ae-977f-40f51c72717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:01.695090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ede3f-6f03-46ae-977f-40f51c72717a None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:01.695456 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ede3f-6f03-46ae-977f-40f51c72717a None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:01.695847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ede3f-6f03-46ae-977f-40f51c72717a None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:01.696580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ede3f-6f03-46ae-977f-40f51c72717a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:01.696976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ede3f-6f03-46ae-977f-40f51c72717a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:01.698481 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ede3f-6f03-46ae-977f-40f51c72717a None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:01.704265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 487/990] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Aug 9 11:07:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:01.709945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ede3f-6f03-46ae-977f-40f51c72717a None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:01.734106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8acdf-e62d-4fde-ad0c-5123659142c8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:01.772443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb603be-ad4f-417a-be6d-09c37ac3309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:01.773148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb603be-ad4f-417a-be6d-09c37ac3309b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:01.773332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb603be-ad4f-417a-be6d-09c37ac3309b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:01.773590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb603be-ad4f-417a-be6d-09c37ac3309b None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:01.774231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb603be-ad4f-417a-be6d-09c37ac3309b None admin] RBAC: Adding query filter params (name=image) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:01.774529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb603be-ad4f-417a-be6d-09c37ac3309b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:01.775883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb603be-ad4f-417a-be6d-09c37ac3309b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:01.780775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 504/991] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:01.786404 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb603be-ad4f-417a-be6d-09c37ac3309b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:01.815080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ede3f-6f03-46ae-977f-40f51c72717a None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:01.836935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:01.851283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023eab4-0dc1-40f4-ab21-e824ab45fd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:01.851789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023eab4-0dc1-40f4-ab21-e824ab45fd30 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:01.852059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023eab4-0dc1-40f4-ab21-e824ab45fd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:01.852317 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023eab4-0dc1-40f4-ab21-e824ab45fd30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:01.853018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023eab4-0dc1-40f4-ab21-e824ab45fd30 None admin] RBAC: Adding query filter params (interface=admin, service_id=6bae78cd1177486fa32b77ebd80bda93, region_id=RegionOne) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:01.853318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023eab4-0dc1-40f4-ab21-e824ab45fd30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:01.854715 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023eab4-0dc1-40f4-ab21-e824ab45fd30 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:01.860712 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 488/992] 10.222.0.15 () {56 vars in 1249 bytes} [Tue Aug 9 11:07:01 2022] GET /identity/v3/endpoints?service_id=6bae78cd1177486fa32b77ebd80bda93&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:01.866373 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023eab4-0dc1-40f4-ab21-e824ab45fd30 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:01.869353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:01.889900 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb603be-ad4f-417a-be6d-09c37ac3309b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:01.924981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c88e0-5209-466d-aef2-d7b27b362a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:01.925758 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c88e0-5209-466d-aef2-d7b27b362a2c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:01.926097 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c88e0-5209-466d-aef2-d7b27b362a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:01.926425 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c88e0-5209-466d-aef2-d7b27b362a2c None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:01.927105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c88e0-5209-466d-aef2-d7b27b362a2c None admin] RBAC: Adding query filter params (type=image) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:01.927465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c88e0-5209-466d-aef2-d7b27b362a2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:01.928878 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c88e0-5209-466d-aef2-d7b27b362a2c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:01.933888 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 505/993] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:01.992415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023eab4-0dc1-40f4-ab21-e824ab45fd30 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:02.030873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4e3e9-6398-4ed2-a7b2-48fd29158ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:02.031492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4e3e9-6398-4ed2-a7b2-48fd29158ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:02.031730 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4e3e9-6398-4ed2-a7b2-48fd29158ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:02.032014 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4e3e9-6398-4ed2-a7b2-48fd29158ab1 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:02.032601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4e3e9-6398-4ed2-a7b2-48fd29158ab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:02.034017 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4e3e9-6398-4ed2-a7b2-48fd29158ab1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:02.041269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 489/994] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Aug 9 11:07:01 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:07:03.090368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00663f-8348-46fb-a182-6c4eb62f4200 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:03.090948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00663f-8348-46fb-a182-6c4eb62f4200 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:03.090948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00663f-8348-46fb-a182-6c4eb62f4200 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:03.092429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 506/995] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:03.097605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf01ff-1ab1-4a3a-a241-85995074886c None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:03.098104 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf01ff-1ab1-4a3a-a241-85995074886c None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:03.098104 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf01ff-1ab1-4a3a-a241-85995074886c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:03.116360 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-6ebf01ff-1ab1-4a3a-a241-85995074886c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:03.117607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6ebf01ff-1ab1-4a3a-a241-85995074886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:03.180683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:03.189997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 490/996] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:03.216857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00663f-8348-46fb-a182-6c4eb62f4200 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:03.329164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00663f-8348-46fb-a182-6c4eb62f4200 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:03.343760 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:03.365047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a51e99-0b6d-4cce-a983-8a9b46ea860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:03.365699 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a51e99-0b6d-4cce-a983-8a9b46ea860a None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:03.365971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a51e99-0b6d-4cce-a983-8a9b46ea860a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:03.366229 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a51e99-0b6d-4cce-a983-8a9b46ea860a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:03.366942 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a51e99-0b6d-4cce-a983-8a9b46ea860a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:03.368308 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a51e99-0b6d-4cce-a983-8a9b46ea860a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-23a51e99-0b6d-4cce-a983-8a9b46ea860a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:03.377115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:03.378144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:03.379375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:03.379375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:03.379375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:03.379375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:03.379375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:03.379375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:03.379375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:03.379375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:03.379375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:03.379375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:03.379375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:07:03.379375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:07:03.379375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:07:03.379375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:03.383860 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 507/997] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:07:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:03.384915 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf01ff-1ab1-4a3a-a241-85995074886c None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:03.496430 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf01ff-1ab1-4a3a-a241-85995074886c None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:03.532799 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c8562-fbd9-4c32-8458-5faea8b85777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:03.533402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c8562-fbd9-4c32-8458-5faea8b85777 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:03.533708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c8562-fbd9-4c32-8458-5faea8b85777 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:03.533975 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c8562-fbd9-4c32-8458-5faea8b85777 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:03.534604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c8562-fbd9-4c32-8458-5faea8b85777 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:03.534964 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c8562-fbd9-4c32-8458-5faea8b85777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:03.536349 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c8562-fbd9-4c32-8458-5faea8b85777 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:03.541716 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 491/998] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Aug 9 11:07:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:03.547397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a51e99-0b6d-4cce-a983-8a9b46ea860a None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:03.658444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a51e99-0b6d-4cce-a983-8a9b46ea860a None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:03.693233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bd5e5-ac5d-4e64-85e6-211f3a78f542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:03.693885 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bd5e5-ac5d-4e64-85e6-211f3a78f542 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:03.694162 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bd5e5-ac5d-4e64-85e6-211f3a78f542 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:03.694432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bd5e5-ac5d-4e64-85e6-211f3a78f542 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:03.695108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bd5e5-ac5d-4e64-85e6-211f3a78f542 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:03.695411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bd5e5-ac5d-4e64-85e6-211f3a78f542 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:03.696820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bd5e5-ac5d-4e64-85e6-211f3a78f542 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:03.707295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 508/999] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Aug 9 11:07:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:03.708603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c8562-fbd9-4c32-8458-5faea8b85777 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:03.772125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:03.815082 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c8562-fbd9-4c32-8458-5faea8b85777 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:03.849833 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4859c65-c1bb-4ed8-85b4-c42c2daddb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:03.850449 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4859c65-c1bb-4ed8-85b4-c42c2daddb3c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:03.850717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4859c65-c1bb-4ed8-85b4-c42c2daddb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:03.851017 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4859c65-c1bb-4ed8-85b4-c42c2daddb3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:03.851731 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4859c65-c1bb-4ed8-85b4-c42c2daddb3c None admin] RBAC: Adding query filter params (interface=public, service_id=a1179720f4e545448566b9fc66ba4363, region_id=RegionOne) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:03.852033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4859c65-c1bb-4ed8-85b4-c42c2daddb3c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:03.853427 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4859c65-c1bb-4ed8-85b4-c42c2daddb3c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:03.859292 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 492/1000] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Aug 9 11:07:03 2022] GET /identity/v3/endpoints?service_id=a1179720f4e545448566b9fc66ba4363&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:03.864760 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bd5e5-ac5d-4e64-85e6-211f3a78f542 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:03.909514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:03.944142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1ff50-3ed0-42d2-bd02-1657f9be5046 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:03.944142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1ff50-3ed0-42d2-bd02-1657f9be5046 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:03.944142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1ff50-3ed0-42d2-bd02-1657f9be5046 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:03.944142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 493/1001] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:03.949357 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f2dd9-7d93-4bf8-9bab-36ae05a24a01 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:03.949657 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f2dd9-7d93-4bf8-9bab-36ae05a24a01 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:03.949927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f2dd9-7d93-4bf8-9bab-36ae05a24a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:03.967725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-a91f2dd9-7d93-4bf8-9bab-36ae05a24a01 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:03.968922 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a91f2dd9-7d93-4bf8-9bab-36ae05a24a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:03.972011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bd5e5-ac5d-4e64-85e6-211f3a78f542 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:04.008026 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f11af-a269-42cb-8fde-d88386e3cc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:04.008638 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f11af-a269-42cb-8fde-d88386e3cc11 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:04.008909 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f11af-a269-42cb-8fde-d88386e3cc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:04.009198 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f11af-a269-42cb-8fde-d88386e3cc11 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:04.009820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f11af-a269-42cb-8fde-d88386e3cc11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:04.011169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f11af-a269-42cb-8fde-d88386e3cc11 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:04.018853 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 509/1002] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Aug 9 11:07:03 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:07:04.061669 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 494/1003] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:07:04.070590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de57627-1b37-403d-82dc-e731af6bc047 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:04.070978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de57627-1b37-403d-82dc-e731af6bc047 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:04.071140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de57627-1b37-403d-82dc-e731af6bc047 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:04.072540 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 510/1004] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:04.078778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8155d0d-7dcc-4df9-be96-879c291b3d1a None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:04.079117 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8155d0d-7dcc-4df9-be96-879c291b3d1a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:04.079307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8155d0d-7dcc-4df9-be96-879c291b3d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:04.082121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de57627-1b37-403d-82dc-e731af6bc047 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:04.101963 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-e8155d0d-7dcc-4df9-be96-879c291b3d1a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:04.103490 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e8155d0d-7dcc-4df9-be96-879c291b3d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:04.163217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:04.184669 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 495/1005] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:04.199370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de57627-1b37-403d-82dc-e731af6bc047 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:04.207765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8155d0d-7dcc-4df9-be96-879c291b3d1a None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:04.208586 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:04.238771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d82741-be79-49b5-8be5-1352fa6709bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:04.239382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d82741-be79-49b5-8be5-1352fa6709bb None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:04.239657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d82741-be79-49b5-8be5-1352fa6709bb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:04.239922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d82741-be79-49b5-8be5-1352fa6709bb None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:04.240559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d82741-be79-49b5-8be5-1352fa6709bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:04.242128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d82741-be79-49b5-8be5-1352fa6709bb None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:04.265660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 511/1006] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Aug 9 11:07:04 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:07:04.315968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8155d0d-7dcc-4df9-be96-879c291b3d1a None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:04.362486 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45348120-b1e9-4f38-87b2-4b123ba7d36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:04.363125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45348120-b1e9-4f38-87b2-4b123ba7d36b None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:04.363393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45348120-b1e9-4f38-87b2-4b123ba7d36b None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:04.363659 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45348120-b1e9-4f38-87b2-4b123ba7d36b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:04.364243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45348120-b1e9-4f38-87b2-4b123ba7d36b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:04.365664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45348120-b1e9-4f38-87b2-4b123ba7d36b None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-45348120-b1e9-4f38-87b2-4b123ba7d36b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:04.375196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:04.376278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:04.377769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:04.377769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:04.377769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:04.377769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:04.377769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:04.377769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:04.377769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:04.377769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:04.377769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:04.377769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:04.377769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:07:04.377769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:07:04.377769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 11:07:04.377769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:04.377769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 496/1007] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Aug 9 11:07:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:07:04.383079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d82741-be79-49b5-8be5-1352fa6709bb None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:04.497138 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d82741-be79-49b5-8be5-1352fa6709bb None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:04.532138 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f93b7a-ae33-4d3b-acd6-d53751860a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:04.532752 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f93b7a-ae33-4d3b-acd6-d53751860a2e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:04.533025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f93b7a-ae33-4d3b-acd6-d53751860a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:04.533290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f93b7a-ae33-4d3b-acd6-d53751860a2e None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:04.533945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f93b7a-ae33-4d3b-acd6-d53751860a2e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:04.534247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f93b7a-ae33-4d3b-acd6-d53751860a2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:04.535614 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f93b7a-ae33-4d3b-acd6-d53751860a2e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:04.541004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 512/1008] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Aug 9 11:07:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:04.546962 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45348120-b1e9-4f38-87b2-4b123ba7d36b None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:04.594628 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:04.652380 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45348120-b1e9-4f38-87b2-4b123ba7d36b None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:04.687753 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ddc3a-901e-4490-a7e2-9523623dbf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:04.688369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ddc3a-901e-4490-a7e2-9523623dbf82 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:04.688639 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ddc3a-901e-4490-a7e2-9523623dbf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:04.688899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ddc3a-901e-4490-a7e2-9523623dbf82 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:04.689536 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ddc3a-901e-4490-a7e2-9523623dbf82 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:04.689865 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ddc3a-901e-4490-a7e2-9523623dbf82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:04.691259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ddc3a-901e-4490-a7e2-9523623dbf82 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:04.697121 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 497/1009] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Aug 9 11:07:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:04.702683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f93b7a-ae33-4d3b-acd6-d53751860a2e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:04.735984 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:04.813898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f93b7a-ae33-4d3b-acd6-d53751860a2e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:04.847820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284dbeb3-e790-428e-8701-da760dc199bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:04.848433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dbeb3-e790-428e-8701-da760dc199bc None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:04.848714 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dbeb3-e790-428e-8701-da760dc199bc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:04.848984 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284dbeb3-e790-428e-8701-da760dc199bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:04.849666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dbeb3-e790-428e-8701-da760dc199bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:04.851104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284dbeb3-e790-428e-8701-da760dc199bc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:04.868708 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 513/1010] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:07:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:07:06.036528 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448212c-0239-4eee-8bff-73a74bcf4a16 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:06.037081 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448212c-0239-4eee-8bff-73a74bcf4a16 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:06.037081 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448212c-0239-4eee-8bff-73a74bcf4a16 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:06.038424 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 498/1011] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:06.043908 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec145e-db74-48fb-a671-79ba4e875fd2 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:06.044353 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec145e-db74-48fb-a671-79ba4e875fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:06.044431 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec145e-db74-48fb-a671-79ba4e875fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:06.062857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-93ec145e-db74-48fb-a671-79ba4e875fd2 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:06.064051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-93ec145e-db74-48fb-a671-79ba4e875fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:06.146100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 514/1012] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:06 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:06.165696 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448212c-0239-4eee-8bff-73a74bcf4a16 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:06.272025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448212c-0239-4eee-8bff-73a74bcf4a16 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:06.281121 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:06.307764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3aba3-d98d-4b1a-a9b6-1edf08f5e742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:06.308394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3aba3-d98d-4b1a-a9b6-1edf08f5e742 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:06.308660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3aba3-d98d-4b1a-a9b6-1edf08f5e742 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:06.308921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3aba3-d98d-4b1a-a9b6-1edf08f5e742 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:06.309495 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3aba3-d98d-4b1a-a9b6-1edf08f5e742 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:06.310907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3aba3-d98d-4b1a-a9b6-1edf08f5e742 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-69b3aba3-d98d-4b1a-a9b6-1edf08f5e742 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:06.319841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:06.320908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:06.326834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:06.326834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:06.326834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:06.326834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:06.326834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:06.326834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:06.326834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:06.326834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:06.326834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:06.326834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:06.326834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:07:06.326834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:07:06.326834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 11:07:06.326834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:06.326834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 499/1013] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:07:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:06.329638 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31eef4-a2c6-4df0-8dc7-3f46427da0c2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:06.329752 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3aba3-d98d-4b1a-a9b6-1edf08f5e742 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:06.330008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31eef4-a2c6-4df0-8dc7-3f46427da0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:06.330282 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31eef4-a2c6-4df0-8dc7-3f46427da0c2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:06.331934 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 515/1014] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:06.337020 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee6187-eafd-4381-a774-e630395d53e5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:06.337299 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee6187-eafd-4381-a774-e630395d53e5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:06.337657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee6187-eafd-4381-a774-e630395d53e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:06.355764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-aaee6187-eafd-4381-a774-e630395d53e5 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:06.356988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-aaee6187-eafd-4381-a774-e630395d53e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:06.368652 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:06.433563 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 516/1015] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:06 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:07:06.436924 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3aba3-d98d-4b1a-a9b6-1edf08f5e742 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:06.455764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee6187-eafd-4381-a774-e630395d53e5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:06.489911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64e2b5-154e-4a7b-973e-eca0eefb82b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:06.490768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64e2b5-154e-4a7b-973e-eca0eefb82b2 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:06.491041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64e2b5-154e-4a7b-973e-eca0eefb82b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:06.491531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64e2b5-154e-4a7b-973e-eca0eefb82b2 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:06.492316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64e2b5-154e-4a7b-973e-eca0eefb82b2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:06.492769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64e2b5-154e-4a7b-973e-eca0eefb82b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:06.494187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64e2b5-154e-4a7b-973e-eca0eefb82b2 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:06.500027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 500/1016] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Aug 9 11:07:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:06.506257 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64e2b5-154e-4a7b-973e-eca0eefb82b2 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:06.543170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:06.571961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee6187-eafd-4381-a774-e630395d53e5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:06.608853 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fc002-a93e-4111-baaa-a4a6bca464eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:06.609537 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fc002-a93e-4111-baaa-a4a6bca464eb None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:06.609787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64e2b5-154e-4a7b-973e-eca0eefb82b2 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:06.609887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fc002-a93e-4111-baaa-a4a6bca464eb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:06.610102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fc002-a93e-4111-baaa-a4a6bca464eb None admin] PATH_INFO: `/v3/services/image` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:06.610685 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fc002-a93e-4111-baaa-a4a6bca464eb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:06.612285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fc002-a93e-4111-baaa-a4a6bca464eb None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-b10fc002-a93e-4111-baaa-a4a6bca464eb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:06.621522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:06.627637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:06.628887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:06.628887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:06.628887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:06.628887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:06.628887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:06.628887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:06.628887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:06.628887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:06.628887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:06.628887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:06.628887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:07:06.628887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:07:06.628887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:07:06.628887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:06.628887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 517/1017] 10.222.0.15 () {56 vars in 1105 bytes} [Tue Aug 9 11:07:06 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:07:06.629745 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fc002-a93e-4111-baaa-a4a6bca464eb None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:06.643209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:06.651934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66939806-fa05-423b-b18a-198dc768507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:06.652553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66939806-fa05-423b-b18a-198dc768507c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:06.652827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66939806-fa05-423b-b18a-198dc768507c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:06.653087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66939806-fa05-423b-b18a-198dc768507c None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:06.653764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66939806-fa05-423b-b18a-198dc768507c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:06.654055 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66939806-fa05-423b-b18a-198dc768507c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:06.655439 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66939806-fa05-423b-b18a-198dc768507c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:06.660918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 501/1018] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Aug 9 11:07:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:06.666650 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66939806-fa05-423b-b18a-198dc768507c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:06.741930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fc002-a93e-4111-baaa-a4a6bca464eb None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:06.773728 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:06.776921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66939806-fa05-423b-b18a-198dc768507c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:06.781120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e5113-b1f9-4e2f-b590-2e8880395820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:06.781766 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e5113-b1f9-4e2f-b590-2e8880395820 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:06.782042 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e5113-b1f9-4e2f-b590-2e8880395820 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:06.782311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e5113-b1f9-4e2f-b590-2e8880395820 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:06.782938 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e5113-b1f9-4e2f-b590-2e8880395820 None admin] RBAC: Adding query filter params (name=image) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:06.783238 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e5113-b1f9-4e2f-b590-2e8880395820 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:06.784609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e5113-b1f9-4e2f-b590-2e8880395820 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:06.794659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 518/1019] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:06.795682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e5113-b1f9-4e2f-b590-2e8880395820 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:06.819440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baba3f1-4889-410e-b1fe-52a3d6b618a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:06.820393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baba3f1-4889-410e-b1fe-52a3d6b618a1 None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:06.820669 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baba3f1-4889-410e-b1fe-52a3d6b618a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:06.820941 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baba3f1-4889-410e-b1fe-52a3d6b618a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:06.821604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baba3f1-4889-410e-b1fe-52a3d6b618a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:06.823072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baba3f1-4889-410e-b1fe-52a3d6b618a1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:06.844521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 502/1020] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:07:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:07:06.882895 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:06.889445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30613-5c82-49c0-8d57-ad013d125970 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:06.889967 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30613-5c82-49c0-8d57-ad013d125970 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:06.890244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30613-5c82-49c0-8d57-ad013d125970 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:06.892655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 503/1021] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:06.898825 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef08999-fcc3-4d1c-8a4b-a4d8b8d3aea1 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:06.899245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef08999-fcc3-4d1c-8a4b-a4d8b8d3aea1 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:06.899518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef08999-fcc3-4d1c-8a4b-a4d8b8d3aea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:06.917073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e5113-b1f9-4e2f-b590-2e8880395820 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:06.919502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-1ef08999-fcc3-4d1c-8a4b-a4d8b8d3aea1 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:06.920731 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-1ef08999-fcc3-4d1c-8a4b-a4d8b8d3aea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:06.964861 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2926db-79b2-4d6f-b43e-6262552a2470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:06.965554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2926db-79b2-4d6f-b43e-6262552a2470 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:06.965965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2926db-79b2-4d6f-b43e-6262552a2470 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:06.966223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2926db-79b2-4d6f-b43e-6262552a2470 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:06.966882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2926db-79b2-4d6f-b43e-6262552a2470 None admin] RBAC: Adding query filter params (type=image) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:06.967181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2926db-79b2-4d6f-b43e-6262552a2470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:06.968566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2926db-79b2-4d6f-b43e-6262552a2470 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:06.974141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 519/1022] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:06.980518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2926db-79b2-4d6f-b43e-6262552a2470 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:07.010839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 504/1023] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:07.033735 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef08999-fcc3-4d1c-8a4b-a4d8b8d3aea1 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:07.113565 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2926db-79b2-4d6f-b43e-6262552a2470 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:07.137906 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:07.156140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edb6eb-bd2d-419d-aef0-fc16058b0035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:07.156761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edb6eb-bd2d-419d-aef0-fc16058b0035 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:07.156875 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef08999-fcc3-4d1c-8a4b-a4d8b8d3aea1 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:07.157056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edb6eb-bd2d-419d-aef0-fc16058b0035 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:07.157298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edb6eb-bd2d-419d-aef0-fc16058b0035 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:07.158032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edb6eb-bd2d-419d-aef0-fc16058b0035 None admin] RBAC: Adding query filter params (interface=public, service_id=4529078afad04cea9e669383c0a7af20, region_id=RegionOne) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:07.158347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edb6eb-bd2d-419d-aef0-fc16058b0035 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:07.159790 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edb6eb-bd2d-419d-aef0-fc16058b0035 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:07.161409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:07.166223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 520/1024] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Aug 9 11:07:06 2022] GET /identity/v3/endpoints?service_id=4529078afad04cea9e669383c0a7af20&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:07.171683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edb6eb-bd2d-419d-aef0-fc16058b0035 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:07.196006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a31177-e9b6-45b7-8ed4-4d8f418b5804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:07.196635 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a31177-e9b6-45b7-8ed4-4d8f418b5804 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:07.196911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a31177-e9b6-45b7-8ed4-4d8f418b5804 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:07.197174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a31177-e9b6-45b7-8ed4-4d8f418b5804 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:07.198365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a31177-e9b6-45b7-8ed4-4d8f418b5804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:07.199814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a31177-e9b6-45b7-8ed4-4d8f418b5804 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:07.201731 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 505/1025] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:07.207225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a31177-e9b6-45b7-8ed4-4d8f418b5804 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:07.289674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edb6eb-bd2d-419d-aef0-fc16058b0035 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:07.312986 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a31177-e9b6-45b7-8ed4-4d8f418b5804 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:07.326032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d99d5c-661e-4c13-aa33-915b56f405ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:07.326649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d99d5c-661e-4c13-aa33-915b56f405ea None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:07.326924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d99d5c-661e-4c13-aa33-915b56f405ea None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:07.327192 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d99d5c-661e-4c13-aa33-915b56f405ea None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:07.327800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d99d5c-661e-4c13-aa33-915b56f405ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:07.329169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d99d5c-661e-4c13-aa33-915b56f405ea None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:07.335858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 521/1026] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Aug 9 11:07:07 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:07:07.356452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c0fea-aef3-4048-a871-41210fb7506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:07.357083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c0fea-aef3-4048-a871-41210fb7506f None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:07.357355 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c0fea-aef3-4048-a871-41210fb7506f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:07.357652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c0fea-aef3-4048-a871-41210fb7506f None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:07.358304 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c0fea-aef3-4048-a871-41210fb7506f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:07.359778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c0fea-aef3-4048-a871-41210fb7506f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:07.397775 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 506/1027] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Aug 9 11:07:07 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:07:08.969088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58b580-d7ca-4991-9ecb-a4c721463a0e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:08.969682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58b580-d7ca-4991-9ecb-a4c721463a0e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:08.969682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58b580-d7ca-4991-9ecb-a4c721463a0e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:08.971172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 522/1028] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:08.976520 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b1e82-6182-4e36-8c2f-6b2abad7c8d5 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:08.976957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b1e82-6182-4e36-8c2f-6b2abad7c8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:08.977033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b1e82-6182-4e36-8c2f-6b2abad7c8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:08.993306 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:09.004011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-644b1e82-6182-4e36-8c2f-6b2abad7c8d5 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:09.005969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-644b1e82-6182-4e36-8c2f-6b2abad7c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:09.101668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 507/1029] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:07:09.135189 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58b580-d7ca-4991-9ecb-a4c721463a0e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:09.216558 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:09.260984 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58b580-d7ca-4991-9ecb-a4c721463a0e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:09.298840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef89876-1436-4fb8-984f-e217017913c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:09.299472 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef89876-1436-4fb8-984f-e217017913c7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:09.299704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef89876-1436-4fb8-984f-e217017913c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:09.300003 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef89876-1436-4fb8-984f-e217017913c7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:09.312297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef89876-1436-4fb8-984f-e217017913c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-7ef89876-1436-4fb8-984f-e217017913c7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:07:09.316955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:09.318611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:09.319480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:09.319480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:09.319480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:09.319480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:09.319480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:07:09.319480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:07:09.319480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:07:09.319480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:07:09.319480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:07:09.319480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:07:09.319480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:07:09.319480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:09.319480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 523/1030] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Aug 9 11:07:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:07:09.327925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b1e82-6182-4e36-8c2f-6b2abad7c8d5 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:09.353076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1847010-7e4c-472d-83ff-f49d4f544263 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:09.353406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1847010-7e4c-472d-83ff-f49d4f544263 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:09.353655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1847010-7e4c-472d-83ff-f49d4f544263 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:09.355149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 524/1031] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:09.360374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2f30-e6c7-45e5-b005-7062099982ba None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:09.360658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2f30-e6c7-45e5-b005-7062099982ba None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:09.360885 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d2f30-e6c7-45e5-b005-7062099982ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:09.382030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a61d2f30-e6c7-45e5-b005-7062099982ba None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:09.383332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a61d2f30-e6c7-45e5-b005-7062099982ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:09.461561 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b1e82-6182-4e36-8c2f-6b2abad7c8d5 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:09.465975 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 525/1032] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:09.467503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ace97-013e-4e02-852c-8639ef7e5af0 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:09.467908 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ace97-013e-4e02-852c-8639ef7e5af0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:09.468301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ace97-013e-4e02-852c-8639ef7e5af0 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:09.474104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 526/1033] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:09.478076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fe897-311f-4cc5-bacb-098a9366db8e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:09.478359 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fe897-311f-4cc5-bacb-098a9366db8e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:09.478631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fe897-311f-4cc5-bacb-098a9366db8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:09.498475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ec5fe897-311f-4cc5-bacb-098a9366db8e None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:09.499675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ec5fe897-311f-4cc5-bacb-098a9366db8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:09.501241 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc70765-438d-4c06-adad-cd16993184af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:09.501887 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc70765-438d-4c06-adad-cd16993184af None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:09.502158 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc70765-438d-4c06-adad-cd16993184af None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:09.502422 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc70765-438d-4c06-adad-cd16993184af None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:09.503442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc70765-438d-4c06-adad-cd16993184af None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:09.503737 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc70765-438d-4c06-adad-cd16993184af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:09.505116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc70765-438d-4c06-adad-cd16993184af None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:09.507727 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:09.517919 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 508/1034] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Aug 9 11:07:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:09.519607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc70765-438d-4c06-adad-cd16993184af None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:09.548810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:09.569886 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 527/1035] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:09.570699 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fe897-311f-4cc5-bacb-098a9366db8e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:09.635529 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc70765-438d-4c06-adad-cd16993184af None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:09.670723 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d139c9-1083-43d9-aa2e-fe8ff5033c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:09.671352 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d139c9-1083-43d9-aa2e-fe8ff5033c66 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:09.671599 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d139c9-1083-43d9-aa2e-fe8ff5033c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:09.671876 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d139c9-1083-43d9-aa2e-fe8ff5033c66 None admin] PATH_INFO: `/v3/services/image` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:09.672429 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d139c9-1083-43d9-aa2e-fe8ff5033c66 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:09.673845 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d139c9-1083-43d9-aa2e-fe8ff5033c66 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-35d139c9-1083-43d9-aa2e-fe8ff5033c66 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:09.682839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:09.684036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:09.684900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:09.684900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:09.684900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:09.684900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:09.684900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:09.684900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:09.684900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:09.684900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:09.684900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:09.684900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:09.684900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:07:09.684900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:07:09.684900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 11:07:09.684900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:09.684900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 509/1036] 10.222.0.15 () {56 vars in 1105 bytes} [Tue Aug 9 11:07:09 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:09.685739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fe897-311f-4cc5-bacb-098a9366db8e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:09.685817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d139c9-1083-43d9-aa2e-fe8ff5033c66 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:09.719742 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fba840-3244-4e13-a34a-0654ce57b8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:09.720378 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fba840-3244-4e13-a34a-0654ce57b8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:09.720652 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fba840-3244-4e13-a34a-0654ce57b8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:09.720907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fba840-3244-4e13-a34a-0654ce57b8e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:09.731116 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fba840-3244-4e13-a34a-0654ce57b8e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:09.732552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fba840-3244-4e13-a34a-0654ce57b8e9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:09.746541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-e7fba840-3244-4e13-a34a-0654ce57b8e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:07:09.746692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:09.747615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:07:09.748968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:07:09.748968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:07:09.748968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:09.748968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 528/1037] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:09.748968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fba840-3244-4e13-a34a-0654ce57b8e9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:09.787789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:09.789805 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d139c9-1083-43d9-aa2e-fe8ff5033c66 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:09.823608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4919f94-1267-4ac8-a91e-95c594cb0f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:09.824218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4919f94-1267-4ac8-a91e-95c594cb0f99 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:09.824487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4919f94-1267-4ac8-a91e-95c594cb0f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:09.824747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4919f94-1267-4ac8-a91e-95c594cb0f99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:09.825869 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4919f94-1267-4ac8-a91e-95c594cb0f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:09.827294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4919f94-1267-4ac8-a91e-95c594cb0f99 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:09.828834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 510/1038] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:09.829692 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4919f94-1267-4ac8-a91e-95c594cb0f99 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:09.856144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fba840-3244-4e13-a34a-0654ce57b8e9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:09.889476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876626a1-f99c-448a-9e3a-4420caef0a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:09.890099 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876626a1-f99c-448a-9e3a-4420caef0a6c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:09.890365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876626a1-f99c-448a-9e3a-4420caef0a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:09.890640 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876626a1-f99c-448a-9e3a-4420caef0a6c None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:09.891250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876626a1-f99c-448a-9e3a-4420caef0a6c None admin] RBAC: Adding query filter params (name=image) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:09.891540 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876626a1-f99c-448a-9e3a-4420caef0a6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:09.892897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876626a1-f99c-448a-9e3a-4420caef0a6c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:09.897533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 529/1039] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:09.898351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876626a1-f99c-448a-9e3a-4420caef0a6c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:09.927082 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4919f94-1267-4ac8-a91e-95c594cb0f99 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:09.954526 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:09.960836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d8042-6fe9-44e2-b1de-f743ec14f099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:09.961431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d8042-6fe9-44e2-b1de-f743ec14f099 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:09.961733 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d8042-6fe9-44e2-b1de-f743ec14f099 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:09.961993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d8042-6fe9-44e2-b1de-f743ec14f099 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:09.962621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d8042-6fe9-44e2-b1de-f743ec14f099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:09.962912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d8042-6fe9-44e2-b1de-f743ec14f099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:09.964276 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d8042-6fe9-44e2-b1de-f743ec14f099 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:09.975179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 511/1040] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:09.976124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d8042-6fe9-44e2-b1de-f743ec14f099 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:09.994496 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:09.998910 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876626a1-f99c-448a-9e3a-4420caef0a6c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:10.032870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541c29e-2173-4918-8b4a-9bfcc8072c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:10.033817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541c29e-2173-4918-8b4a-9bfcc8072c8c None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:10.034092 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541c29e-2173-4918-8b4a-9bfcc8072c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:10.034358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541c29e-2173-4918-8b4a-9bfcc8072c8c None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:10.034985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541c29e-2173-4918-8b4a-9bfcc8072c8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:10.036405 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541c29e-2173-4918-8b4a-9bfcc8072c8c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:10.067798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 530/1041] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:07:09 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:07:10.067798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541c29e-2173-4918-8b4a-9bfcc8072c8c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:10.088329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d8042-6fe9-44e2-b1de-f743ec14f099 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:10.127405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913ba6c-00fc-4c0d-8c0d-a3a7088daa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:10.128390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913ba6c-00fc-4c0d-8c0d-a3a7088daa31 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:10.128778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913ba6c-00fc-4c0d-8c0d-a3a7088daa31 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:10.129049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913ba6c-00fc-4c0d-8c0d-a3a7088daa31 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:10.129792 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913ba6c-00fc-4c0d-8c0d-a3a7088daa31 None admin] RBAC: Adding query filter params (type=image) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:10.130010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913ba6c-00fc-4c0d-8c0d-a3a7088daa31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:10.131428 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913ba6c-00fc-4c0d-8c0d-a3a7088daa31 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:10.141839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 512/1042] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:10.143444 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913ba6c-00fc-4c0d-8c0d-a3a7088daa31 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:10.179216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541c29e-2173-4918-8b4a-9bfcc8072c8c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:10.205163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:10.225677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a45101-70b0-441b-b852-5dffa514692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:10.226726 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a45101-70b0-441b-b852-5dffa514692d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:10.226994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a45101-70b0-441b-b852-5dffa514692d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:10.227258 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a45101-70b0-441b-b852-5dffa514692d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:10.236626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a45101-70b0-441b-b852-5dffa514692d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:10.238108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a45101-70b0-441b-b852-5dffa514692d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-f2a45101-70b0-441b-b852-5dffa514692d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:07:10.250642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:10.252015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:10.253406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:10.253406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:10.253406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:07:10.253406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:07:10.253406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:07:10.253406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:07:10.253406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:07:10.253406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:07:10.253406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:07:10.253406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:10.253406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 531/1043] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Aug 9 11:07:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:10.258848 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a45101-70b0-441b-b852-5dffa514692d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:10.259395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913ba6c-00fc-4c0d-8c0d-a3a7088daa31 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:10.281715 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:10.313818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9136d0-037b-4329-9619-03e86facb03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:10.314684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9136d0-037b-4329-9619-03e86facb03c None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:10.315146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9136d0-037b-4329-9619-03e86facb03c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:10.315593 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9136d0-037b-4329-9619-03e86facb03c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:10.316720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9136d0-037b-4329-9619-03e86facb03c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:10.318593 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9136d0-037b-4329-9619-03e86facb03c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:10.345242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 513/1044] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:07:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:07:10.382991 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a45101-70b0-441b-b852-5dffa514692d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:10.429523 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2ce64-9af9-4bec-98b9-1a2963047273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:10.430180 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2ce64-9af9-4bec-98b9-1a2963047273 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:10.430452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2ce64-9af9-4bec-98b9-1a2963047273 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:10.430720 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2ce64-9af9-4bec-98b9-1a2963047273 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:10.431464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2ce64-9af9-4bec-98b9-1a2963047273 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:10.431813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2ce64-9af9-4bec-98b9-1a2963047273 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:10.433311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2ce64-9af9-4bec-98b9-1a2963047273 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:10.454195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 532/1045] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Aug 9 11:07:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:10.460057 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9136d0-037b-4329-9619-03e86facb03c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:10.577604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9136d0-037b-4329-9619-03e86facb03c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:10.589942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:10.616266 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1071b14-02bc-409b-8d94-58561bd4edb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:10.617062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1071b14-02bc-409b-8d94-58561bd4edb4 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:10.617336 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1071b14-02bc-409b-8d94-58561bd4edb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:10.617597 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1071b14-02bc-409b-8d94-58561bd4edb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:10.689284 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1071b14-02bc-409b-8d94-58561bd4edb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:10.690824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1071b14-02bc-409b-8d94-58561bd4edb4 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:10.797750 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 514/1046] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:07:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:07:10.801432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2ce64-9af9-4bec-98b9-1a2963047273 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:10.873520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:10.910022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2ce64-9af9-4bec-98b9-1a2963047273 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:10.944294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f8a8c-6a85-4d2d-8134-99f59083d1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:10.944982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f8a8c-6a85-4d2d-8134-99f59083d1ef None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:10.945251 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f8a8c-6a85-4d2d-8134-99f59083d1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:10.945520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f8a8c-6a85-4d2d-8134-99f59083d1ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:10.956280 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f8a8c-6a85-4d2d-8134-99f59083d1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:10.957744 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f8a8c-6a85-4d2d-8134-99f59083d1ef None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-a07f8a8c-6a85-4d2d-8134-99f59083d1ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:07:10.972692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:10.973968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:07:10.974898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:07:10.974898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:07:10.974898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:10.977994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 533/1047] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:10.979655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1071b14-02bc-409b-8d94-58561bd4edb4 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:10.991592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:11.082127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1071b14-02bc-409b-8d94-58561bd4edb4 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:11.118364 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b65a-ef32-45e9-91f9-235b1e6d39d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:11.119022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b65a-ef32-45e9-91f9-235b1e6d39d9 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:11.119256 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b65a-ef32-45e9-91f9-235b1e6d39d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:11.119487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b65a-ef32-45e9-91f9-235b1e6d39d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:11.120128 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4b65a-ef32-45e9-91f9-235b1e6d39d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:11.120424 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4b65a-ef32-45e9-91f9-235b1e6d39d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:11.121939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4b65a-ef32-45e9-91f9-235b1e6d39d9 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:11.134371 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 515/1048] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:11.139880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f8a8c-6a85-4d2d-8134-99f59083d1ef None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:11.245647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f8a8c-6a85-4d2d-8134-99f59083d1ef None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:11.268194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:11.284803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a47189-2f41-4d0f-84cf-d0a4619f1f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:11.285529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47189-2f41-4d0f-84cf-d0a4619f1f1c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:11.285831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47189-2f41-4d0f-84cf-d0a4619f1f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:11.286100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47189-2f41-4d0f-84cf-d0a4619f1f1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:11.293343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a47189-2f41-4d0f-84cf-d0a4619f1f1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:11.294810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a47189-2f41-4d0f-84cf-d0a4619f1f1c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:11.305989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-f9a47189-2f41-4d0f-84cf-d0a4619f1f1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:07:11.305989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:11.305989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:11.305989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:11.305989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:11.305989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:11.305989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:11.305989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:11.305989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:11.305989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:11.305989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:11.305989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:11.305989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:07:11.305989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:07:11.305989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:11.306880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:11.307803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:07:11.307803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:07:11.307803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:07:11.307803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:07:11.307803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:07:11.307803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:07:11.307803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:07:11.307803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:11.312043 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 534/1049] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:07:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:11.313016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b65a-ef32-45e9-91f9-235b1e6d39d9 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:11.385840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:11.418801 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b65a-ef32-45e9-91f9-235b1e6d39d9 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:11.453212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0943b-5728-4777-be49-fd499a094d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:11.453848 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0943b-5728-4777-be49-fd499a094d81 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:11.454117 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0943b-5728-4777-be49-fd499a094d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:11.454381 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0943b-5728-4777-be49-fd499a094d81 None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:11.455069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0943b-5728-4777-be49-fd499a094d81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:11.455366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0943b-5728-4777-be49-fd499a094d81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:11.456886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0943b-5728-4777-be49-fd499a094d81 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:11.473654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 516/1050] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:07:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:11.477750 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a47189-2f41-4d0f-84cf-d0a4619f1f1c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:11.588067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a47189-2f41-4d0f-84cf-d0a4619f1f1c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:11.621212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e102da-b309-4e44-9d29-475167ddfc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:11.621831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e102da-b309-4e44-9d29-475167ddfc24 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:11.622100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e102da-b309-4e44-9d29-475167ddfc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:11.622365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e102da-b309-4e44-9d29-475167ddfc24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:11.623074 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e102da-b309-4e44-9d29-475167ddfc24 None admin] RBAC: Adding query filter params (role.id=f8b621041fe241a586be5bf0799ff298, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=881030d7605b40879762d1c199362ee1) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:11.623374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e102da-b309-4e44-9d29-475167ddfc24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:11.624782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e102da-b309-4e44-9d29-475167ddfc24 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:11.630767 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 535/1051] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:07:11 2022] GET /identity/v3/role_assignments?user.id=881030d7605b40879762d1c199362ee1&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=f8b621041fe241a586be5bf0799ff298 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:12.136039 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1edfb-c9f4-4793-a235-0ac2dfc9268d None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:12.136039 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1edfb-c9f4-4793-a235-0ac2dfc9268d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:12.136039 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1edfb-c9f4-4793-a235-0ac2dfc9268d None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:12.137047 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 517/1052] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:12.142952 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d66cc4-95b4-4000-b447-132582b1c74e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:12.143840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d66cc4-95b4-4000-b447-132582b1c74e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:12.144251 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d66cc4-95b4-4000-b447-132582b1c74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:12.163855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-36d66cc4-95b4-4000-b447-132582b1c74e None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:12.165275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-36d66cc4-95b4-4000-b447-132582b1c74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:12.208232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:12.238023 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 536/1053] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:12.261984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1edfb-c9f4-4793-a235-0ac2dfc9268d None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:12.368621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1edfb-c9f4-4793-a235-0ac2dfc9268d None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:12.399948 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:12.400816 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11280ee-643e-44f1-b8cd-07df27932c29 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:12.401096 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11280ee-643e-44f1-b8cd-07df27932c29 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:12.401485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11280ee-643e-44f1-b8cd-07df27932c29 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:12.403337 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 537/1054] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:07:12.408633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285178ed-442e-4dc1-9b44-9dccd447d78a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:12.408909 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285178ed-442e-4dc1-9b44-9dccd447d78a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:12.409181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285178ed-442e-4dc1-9b44-9dccd447d78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:12.410408 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13505c-e377-48fa-a5cd-59717e9c0fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:12.411043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13505c-e377-48fa-a5cd-59717e9c0fca None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:12.411314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13505c-e377-48fa-a5cd-59717e9c0fca None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:12.411576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13505c-e377-48fa-a5cd-59717e9c0fca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:12.423633 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13505c-e377-48fa-a5cd-59717e9c0fca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:07:12.428148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-285178ed-442e-4dc1-9b44-9dccd447d78a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-5e13505c-e377-48fa-a5cd-59717e9c0fca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:07:12.428260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:12.429190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:12.430725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:12.430725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:12.430725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:12.430725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:12.430725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:07:12.430725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:07:12.430725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:07:12.430725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:07:12.430725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:07:12.430725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:07:12.430725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:07:12.430725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:12.431549 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-285178ed-442e-4dc1-9b44-9dccd447d78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:12.431636 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 518/1055] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:07:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:12.435616 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13505c-e377-48fa-a5cd-59717e9c0fca None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:12.509913 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 538/1056] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:07:12.531176 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285178ed-442e-4dc1-9b44-9dccd447d78a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:12.547019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13505c-e377-48fa-a5cd-59717e9c0fca None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:12.581421 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06904a-a5e7-47ca-b448-1deca00072d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:12.582135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06904a-a5e7-47ca-b448-1deca00072d1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:12.582404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06904a-a5e7-47ca-b448-1deca00072d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:12.582666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06904a-a5e7-47ca-b448-1deca00072d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:12.583316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06904a-a5e7-47ca-b448-1deca00072d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:12.583609 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06904a-a5e7-47ca-b448-1deca00072d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:12.585006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06904a-a5e7-47ca-b448-1deca00072d1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:12.593676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 519/1057] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:07:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:12.599469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06904a-a5e7-47ca-b448-1deca00072d1 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:12.642108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285178ed-442e-4dc1-9b44-9dccd447d78a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:12.644520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:12.654577 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:12.678522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8b4bc-4825-4d7e-b064-fa5377b69d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:12.679451 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8b4bc-4825-4d7e-b064-fa5377b69d15 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:12.679722 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8b4bc-4825-4d7e-b064-fa5377b69d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:12.679986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8b4bc-4825-4d7e-b064-fa5377b69d15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:12.704780 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06904a-a5e7-47ca-b448-1deca00072d1 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:12.739677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a80e8-3c8c-44fa-9fb3-f325fa234b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:12.740297 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a80e8-3c8c-44fa-9fb3-f325fa234b55 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:12.740576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a80e8-3c8c-44fa-9fb3-f325fa234b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:12.740840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a80e8-3c8c-44fa-9fb3-f325fa234b55 None admin] PATH_INFO: `/v3/users/b19a5d0506254110a8795dec8c502665` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:12.752246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8b4bc-4825-4d7e-b064-fa5377b69d15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:12.754431 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8b4bc-4825-4d7e-b064-fa5377b69d15 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:12.755361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a80e8-3c8c-44fa-9fb3-f325fa234b55 None admin] RBAC: Authorizing `identity:get_user(user_id=b19a5d0506254110a8795dec8c502665)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:12.756811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a80e8-3c8c-44fa-9fb3-f325fa234b55 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:12.758549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 520/1058] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:07:12 2022] GET /identity/v3/users/b19a5d0506254110a8795dec8c502665 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:12.764322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a80e8-3c8c-44fa-9fb3-f325fa234b55 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:12.864826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 539/1059] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:07:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 11:07:12.871011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8b4bc-4825-4d7e-b064-fa5377b69d15 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:12.874458 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:12.874577 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a80e8-3c8c-44fa-9fb3-f325fa234b55 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:12.886667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:12.911222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9537066-70fe-4bfc-91aa-290fbad043b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:12.911751 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9537066-70fe-4bfc-91aa-290fbad043b5 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:12.912021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9537066-70fe-4bfc-91aa-290fbad043b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:12.912283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9537066-70fe-4bfc-91aa-290fbad043b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:12.978062 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8b4bc-4825-4d7e-b064-fa5377b69d15 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:12.984563 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9537066-70fe-4bfc-91aa-290fbad043b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:12.986347 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9537066-70fe-4bfc-91aa-290fbad043b5 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:13.013316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db01903-b8dd-4f62-b181-8a45d25d87c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:13.013972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db01903-b8dd-4f62-b181-8a45d25d87c7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:13.014243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db01903-b8dd-4f62-b181-8a45d25d87c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:13.014506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db01903-b8dd-4f62-b181-8a45d25d87c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:13.024467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db01903-b8dd-4f62-b181-8a45d25d87c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:13.025940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db01903-b8dd-4f62-b181-8a45d25d87c7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-2db01903-b8dd-4f62-b181-8a45d25d87c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:07:13.040346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:13.041544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:07:13.042513 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:07:13.042513 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:07:13.042513 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:13.042513 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 540/1060] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:07:13.048828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db01903-b8dd-4f62-b181-8a45d25d87c7 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:13.099100 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 521/1061] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:07:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 11:07:13.105083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9537066-70fe-4bfc-91aa-290fbad043b5 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:13.116452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:13.120176 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:13.167782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db01903-b8dd-4f62-b181-8a45d25d87c7 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:13.205465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314a643-979b-496f-9828-db69d0924bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:13.206351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314a643-979b-496f-9828-db69d0924bee None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:13.206796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314a643-979b-496f-9828-db69d0924bee None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:13.207228 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314a643-979b-496f-9828-db69d0924bee None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:13.208018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314a643-979b-496f-9828-db69d0924bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:13.208475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314a643-979b-496f-9828-db69d0924bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:13.209865 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314a643-979b-496f-9828-db69d0924bee None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:13.218016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9537066-70fe-4bfc-91aa-290fbad043b5 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:13.222266 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 541/1062] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:13.257197 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88672fda-a767-4a24-b0d5-dc6f90dd3ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:13.258289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88672fda-a767-4a24-b0d5-dc6f90dd3ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:13.258764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88672fda-a767-4a24-b0d5-dc6f90dd3ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:13.259247 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88672fda-a767-4a24-b0d5-dc6f90dd3ac8 None admin] PATH_INFO: `/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:13.260741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88672fda-a767-4a24-b0d5-dc6f90dd3ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=2593ae1c231e4b50bdbbf66f115df6ba)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:13.262523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88672fda-a767-4a24-b0d5-dc6f90dd3ac8 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:13.264834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 522/1063] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:07:13 2022] GET /identity/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:13.270807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314a643-979b-496f-9828-db69d0924bee None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:13.391482 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314a643-979b-496f-9828-db69d0924bee None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:13.409423 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:13.430659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed390da3-96d7-46ce-8da4-6efd6fdf99d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:13.431129 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed390da3-96d7-46ce-8da4-6efd6fdf99d1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:13.431411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed390da3-96d7-46ce-8da4-6efd6fdf99d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:13.431695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed390da3-96d7-46ce-8da4-6efd6fdf99d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:13.432411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed390da3-96d7-46ce-8da4-6efd6fdf99d1 None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=2593ae1c231e4b50bdbbf66f115df6ba, user.id=b19a5d0506254110a8795dec8c502665) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:13.432714 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed390da3-96d7-46ce-8da4-6efd6fdf99d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:13.434211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed390da3-96d7-46ce-8da4-6efd6fdf99d1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:13.440332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 542/1064] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:07:13 2022] GET /identity/v3/role_assignments?user.id=b19a5d0506254110a8795dec8c502665&scope.project.id=2593ae1c231e4b50bdbbf66f115df6ba&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:13.591605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1952-9962-4b9c-aaef-4978c1e81c41 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:13.591833 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1952-9962-4b9c-aaef-4978c1e81c41 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:13.592127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1952-9962-4b9c-aaef-4978c1e81c41 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:13.593475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 523/1065] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:13.599102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c28398-87b1-4629-9033-60cd3ba992be None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:13.599377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c28398-87b1-4629-9033-60cd3ba992be None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:13.599648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c28398-87b1-4629-9033-60cd3ba992be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:13.618224 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d5c28398-87b1-4629-9033-60cd3ba992be None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:13.619392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d5c28398-87b1-4629-9033-60cd3ba992be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:13.691086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 543/1066] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:07:13.713005 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c1952-9962-4b9c-aaef-4978c1e81c41 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:13.796099 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:13.820979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c1952-9962-4b9c-aaef-4978c1e81c41 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:13.860486 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ff405-d486-4558-aafa-4a0f55d2c894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:13.861104 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ff405-d486-4558-aafa-4a0f55d2c894 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:13.861368 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ff405-d486-4558-aafa-4a0f55d2c894 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:13.861594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ff405-d486-4558-aafa-4a0f55d2c894 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:13.871896 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ff405-d486-4558-aafa-4a0f55d2c894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-ca2ff405-d486-4558-aafa-4a0f55d2c894 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:07:13.876441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:13.877446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:13.878726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:13.878726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:13.878726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:13.878726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:13.878726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:07:13.878726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:07:13.878726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:07:13.878726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:07:13.878726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:07:13.878726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:07:13.878726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:07:13.878726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:13.878726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 524/1067] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Aug 9 11:07:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:13.884094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c28398-87b1-4629-9033-60cd3ba992be None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:13.993327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c28398-87b1-4629-9033-60cd3ba992be None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:14.004492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:14.028319 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eeb6ae-a6e7-41bd-92c7-6e1bb6949c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:14.028922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eeb6ae-a6e7-41bd-92c7-6e1bb6949c28 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:14.029195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eeb6ae-a6e7-41bd-92c7-6e1bb6949c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:14.029460 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eeb6ae-a6e7-41bd-92c7-6e1bb6949c28 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:14.030140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eeb6ae-a6e7-41bd-92c7-6e1bb6949c28 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:14.030437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eeb6ae-a6e7-41bd-92c7-6e1bb6949c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:14.031809 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eeb6ae-a6e7-41bd-92c7-6e1bb6949c28 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:14.044845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 544/1068] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Aug 9 11:07:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:14.046157 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ff405-d486-4558-aafa-4a0f55d2c894 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:14.150339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ff405-d486-4558-aafa-4a0f55d2c894 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:14.185094 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640008af-00cb-43f2-80a9-f3be5992bebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:14.185818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640008af-00cb-43f2-80a9-f3be5992bebc None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:14.186037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640008af-00cb-43f2-80a9-f3be5992bebc None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:14.186295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640008af-00cb-43f2-80a9-f3be5992bebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:14.193344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:14.197557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640008af-00cb-43f2-80a9-f3be5992bebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:14.199043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640008af-00cb-43f2-80a9-f3be5992bebc None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-640008af-00cb-43f2-80a9-f3be5992bebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:07:14.213521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:14.214485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:07:14.215571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:07:14.215571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:07:14.215571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:14.215571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 525/1069] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:14.220619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eeb6ae-a6e7-41bd-92c7-6e1bb6949c28 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:14.321565 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eeb6ae-a6e7-41bd-92c7-6e1bb6949c28 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:14.356150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ec44e-e995-4bea-9417-910c6c6b2c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:14.356747 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ec44e-e995-4bea-9417-910c6c6b2c6c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:14.356989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ec44e-e995-4bea-9417-910c6c6b2c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:14.357289 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ec44e-e995-4bea-9417-910c6c6b2c6c None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:14.357952 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ec44e-e995-4bea-9417-910c6c6b2c6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:14.358247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ec44e-e995-4bea-9417-910c6c6b2c6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:14.359621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ec44e-e995-4bea-9417-910c6c6b2c6c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:14.372471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 545/1070] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:14.378696 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640008af-00cb-43f2-80a9-f3be5992bebc None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:14.484574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640008af-00cb-43f2-80a9-f3be5992bebc None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:14.521914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763cfba-f42e-46fc-9f49-ac5be01781d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:14.522565 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763cfba-f42e-46fc-9f49-ac5be01781d0 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:14.522836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763cfba-f42e-46fc-9f49-ac5be01781d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:14.523104 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763cfba-f42e-46fc-9f49-ac5be01781d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:14.531433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763cfba-f42e-46fc-9f49-ac5be01781d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:14.532973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763cfba-f42e-46fc-9f49-ac5be01781d0 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-1763cfba-f42e-46fc-9f49-ac5be01781d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:07:14.544159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:14.545110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:14.546147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:14.546147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:14.546147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:07:14.546147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:07:14.546147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:07:14.546147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:07:14.546147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:07:14.546147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:07:14.546147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:07:14.546147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:14.546147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 526/1071] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Aug 9 11:07:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:14.551518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ec44e-e995-4bea-9417-910c6c6b2c6c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:14.583935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:14.653251 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ec44e-e995-4bea-9417-910c6c6b2c6c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:14.695751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cf8f8-125f-4776-82d8-1a27c03a6150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:14.696354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cf8f8-125f-4776-82d8-1a27c03a6150 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:14.696627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cf8f8-125f-4776-82d8-1a27c03a6150 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:14.696892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cf8f8-125f-4776-82d8-1a27c03a6150 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:14.697644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cf8f8-125f-4776-82d8-1a27c03a6150 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:14.697960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cf8f8-125f-4776-82d8-1a27c03a6150 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:14.699381 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cf8f8-125f-4776-82d8-1a27c03a6150 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:14.717165 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 546/1072] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Aug 9 11:07:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:14.723043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763cfba-f42e-46fc-9f49-ac5be01781d0 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:14.777459 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:14.835355 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763cfba-f42e-46fc-9f49-ac5be01781d0 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:14.872930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9a480-6008-4b3d-af6d-635419e34b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:14.873548 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9a480-6008-4b3d-af6d-635419e34b73 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:14.873857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9a480-6008-4b3d-af6d-635419e34b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:14.874126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9a480-6008-4b3d-af6d-635419e34b73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:14.885321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9a480-6008-4b3d-af6d-635419e34b73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:14.886804 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9a480-6008-4b3d-af6d-635419e34b73 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-98c9a480-6008-4b3d-af6d-635419e34b73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:07:14.900831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:14.901857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:07:14.902789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:07:14.902789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:07:14.902789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:14.902789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 527/1073] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:14.907834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cf8f8-125f-4776-82d8-1a27c03a6150 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:15.000779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:15.012564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cf8f8-125f-4776-82d8-1a27c03a6150 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:15.048371 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd64c0c-7bdf-4d43-84fd-22e55f4e6f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:15.048970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd64c0c-7bdf-4d43-84fd-22e55f4e6f18 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:15.049251 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd64c0c-7bdf-4d43-84fd-22e55f4e6f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:15.049511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd64c0c-7bdf-4d43-84fd-22e55f4e6f18 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:15.050177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd64c0c-7bdf-4d43-84fd-22e55f4e6f18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:15.050473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd64c0c-7bdf-4d43-84fd-22e55f4e6f18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:15.051836 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd64c0c-7bdf-4d43-84fd-22e55f4e6f18 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:15.063382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 547/1074] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:15.069062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9a480-6008-4b3d-af6d-635419e34b73 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:15.170253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9a480-6008-4b3d-af6d-635419e34b73 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:15.171659 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:15.207657 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc4ad-495c-459e-9fb9-61a24b904bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:15.208283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc4ad-495c-459e-9fb9-61a24b904bef None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:15.208560 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc4ad-495c-459e-9fb9-61a24b904bef None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:15.208821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc4ad-495c-459e-9fb9-61a24b904bef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:15.216025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edc4ad-495c-459e-9fb9-61a24b904bef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:15.217526 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edc4ad-495c-459e-9fb9-61a24b904bef None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:15.230604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-53edc4ad-495c-459e-9fb9-61a24b904bef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:07:15.230604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:15.230604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:15.230604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:15.230604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:15.230604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:15.230604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:15.230604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:15.230604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:15.230604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:15.230604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:15.230604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:15.230604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:07:15.230604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:07:15.230604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:15.231743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:15.237947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:07:15.237947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:07:15.237947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:07:15.237947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:07:15.237947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:07:15.237947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:07:15.237947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:07:15.237947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:15.237947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 528/1075] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:07:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:15.238566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd64c0c-7bdf-4d43-84fd-22e55f4e6f18 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:15.344206 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd64c0c-7bdf-4d43-84fd-22e55f4e6f18 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:15.379191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a30e7-44e7-435b-ab06-13f778d6de98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:15.379792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a30e7-44e7-435b-ab06-13f778d6de98 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:15.380063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a30e7-44e7-435b-ab06-13f778d6de98 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:15.380327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a30e7-44e7-435b-ab06-13f778d6de98 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:15.381009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a30e7-44e7-435b-ab06-13f778d6de98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:15.381277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a30e7-44e7-435b-ab06-13f778d6de98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:15.382829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a30e7-44e7-435b-ab06-13f778d6de98 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:15.394910 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 548/1076] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:07:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:15.401114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc4ad-495c-459e-9fb9-61a24b904bef None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:15.404952 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513d8a7-0d0f-459e-8e9a-0b670e920aaa None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:15.405206 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513d8a7-0d0f-459e-8e9a-0b670e920aaa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:15.405471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513d8a7-0d0f-459e-8e9a-0b670e920aaa None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:15.406807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 549/1077] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:07:15.411722 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f229c-f087-483b-9fc4-8b20a3089522 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:15.412002 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f229c-f087-483b-9fc4-8b20a3089522 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:15.412273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f229c-f087-483b-9fc4-8b20a3089522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:15.430499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8c9f229c-f087-483b-9fc4-8b20a3089522 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:15.431622 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8c9f229c-f087-483b-9fc4-8b20a3089522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:15.434399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:15.500954 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 550/1078] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:15.506491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc4ad-495c-459e-9fb9-61a24b904bef None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:15.523838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f229c-f087-483b-9fc4-8b20a3089522 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:15.539594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ef376-2b42-4d96-90b2-6eaaf2f1e4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:15.540251 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ef376-2b42-4d96-90b2-6eaaf2f1e4de None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:15.540537 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ef376-2b42-4d96-90b2-6eaaf2f1e4de None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:15.540815 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ef376-2b42-4d96-90b2-6eaaf2f1e4de None admin] PATH_INFO: `/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/881030d7605b40879762d1c199362ee1/roles/f8b621041fe241a586be5bf0799ff298` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:15.543033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ef376-2b42-4d96-90b2-6eaaf2f1e4de None admin] RBAC: Authorizing `identity:create_grant(project_id=166e5328bfae434ba19d12be2eaa7a1b, user_id=881030d7605b40879762d1c199362ee1, role_id=f8b621041fe241a586be5bf0799ff298)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:15.544429 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ef376-2b42-4d96-90b2-6eaaf2f1e4de None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:15.559510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 529/1079] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:07:15 2022] PUT /identity/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/881030d7605b40879762d1c199362ee1/roles/f8b621041fe241a586be5bf0799ff298 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:07:15.625189 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f229c-f087-483b-9fc4-8b20a3089522 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:15.662001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c5375-b329-4f44-906a-8421bc682363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:15.662629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c5375-b329-4f44-906a-8421bc682363 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:15.662896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c5375-b329-4f44-906a-8421bc682363 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:15.663160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c5375-b329-4f44-906a-8421bc682363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:15.671827 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:15.675080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c5375-b329-4f44-906a-8421bc682363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-575c5375-b329-4f44-906a-8421bc682363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:07:15.680325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:15.681445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:15.682521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:15.682521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:15.682521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:15.682521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:15.682521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:07:15.682521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:07:15.682521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:07:15.682521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:07:15.682521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:07:15.682521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:07:15.682521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:07:15.682521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:15.682521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 551/1080] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:07:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:07:15.687953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ef376-2b42-4d96-90b2-6eaaf2f1e4de None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:15.714737 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:15.791734 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ef376-2b42-4d96-90b2-6eaaf2f1e4de None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:15.829294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c7d4-2d8e-4550-b782-0b6a631e5159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:15.830006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c7d4-2d8e-4550-b782-0b6a631e5159 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:15.830353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c7d4-2d8e-4550-b782-0b6a631e5159 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:15.830637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c7d4-2d8e-4550-b782-0b6a631e5159 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:15.831440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c7d4-2d8e-4550-b782-0b6a631e5159 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:15.831821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c7d4-2d8e-4550-b782-0b6a631e5159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:15.833461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c7d4-2d8e-4550-b782-0b6a631e5159 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:15.845455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 530/1081] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:07:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:15.852965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c5375-b329-4f44-906a-8421bc682363 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:15.966289 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c5375-b329-4f44-906a-8421bc682363 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:16.001343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895a5fb-a3ac-453a-8da0-bb711e972614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:16.001992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895a5fb-a3ac-453a-8da0-bb711e972614 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:16.002265 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895a5fb-a3ac-453a-8da0-bb711e972614 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:16.002529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895a5fb-a3ac-453a-8da0-bb711e972614 None admin] PATH_INFO: `/v3/users/b19a5d0506254110a8795dec8c502665` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:16.004046 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895a5fb-a3ac-453a-8da0-bb711e972614 None admin] RBAC: Authorizing `identity:get_user(user_id=b19a5d0506254110a8795dec8c502665)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:16.005498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895a5fb-a3ac-453a-8da0-bb711e972614 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:16.007403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 552/1082] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:07:15 2022] GET /identity/v3/users/b19a5d0506254110a8795dec8c502665 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:16.013133 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c7d4-2d8e-4550-b782-0b6a631e5159 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:16.094879 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:16.112141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c7d4-2d8e-4550-b782-0b6a631e5159 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:16.147518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d8537-d796-4a0c-9dd1-bd093fb593b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:16.148164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d8537-d796-4a0c-9dd1-bd093fb593b1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:16.148437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d8537-d796-4a0c-9dd1-bd093fb593b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:16.148705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d8537-d796-4a0c-9dd1-bd093fb593b1 None admin] PATH_INFO: `/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:16.149911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d8537-d796-4a0c-9dd1-bd093fb593b1 None admin] RBAC: Authorizing `identity:get_project(project_id=2593ae1c231e4b50bdbbf66f115df6ba)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:16.151352 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d8537-d796-4a0c-9dd1-bd093fb593b1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:16.152987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 531/1083] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:07:16 2022] GET /identity/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:16.159103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895a5fb-a3ac-453a-8da0-bb711e972614 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:16.226630 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:16.260925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895a5fb-a3ac-453a-8da0-bb711e972614 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:16.296266 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa14ad-425b-4292-b69d-d089aae5a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:16.296925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa14ad-425b-4292-b69d-d089aae5a528 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:16.297197 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa14ad-425b-4292-b69d-d089aae5a528 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:16.297465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa14ad-425b-4292-b69d-d089aae5a528 None admin] PATH_INFO: `/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba/users/b19a5d0506254110a8795dec8c502665/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:16.299499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa14ad-425b-4292-b69d-d089aae5a528 None admin] RBAC: Authorizing `identity:create_grant(project_id=2593ae1c231e4b50bdbbf66f115df6ba, user_id=b19a5d0506254110a8795dec8c502665, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:16.300921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa14ad-425b-4292-b69d-d089aae5a528 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:16.315180 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 553/1084] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:07:16 2022] PUT /identity/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba/users/b19a5d0506254110a8795dec8c502665/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:07:17.528643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecfe13-efeb-4fbf-8097-7fdae8fb1b30 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:17.529187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecfe13-efeb-4fbf-8097-7fdae8fb1b30 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:17.529187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecfe13-efeb-4fbf-8097-7fdae8fb1b30 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:17.530518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 532/1085] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:17.535831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed275c-1f4a-4e8f-91af-e6e6c71a999d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:17.536284 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed275c-1f4a-4e8f-91af-e6e6c71a999d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:17.536374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed275c-1f4a-4e8f-91af-e6e6c71a999d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:17.555325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-46ed275c-1f4a-4e8f-91af-e6e6c71a999d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:17.556494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-46ed275c-1f4a-4e8f-91af-e6e6c71a999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:17.630834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 554/1086] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:17.653574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecfe13-efeb-4fbf-8097-7fdae8fb1b30 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:17.757971 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecfe13-efeb-4fbf-8097-7fdae8fb1b30 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:17.792985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8b903-76b2-46ea-96f0-7909a371b273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:17.793604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8b903-76b2-46ea-96f0-7909a371b273 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:17.793903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8b903-76b2-46ea-96f0-7909a371b273 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:17.794146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8b903-76b2-46ea-96f0-7909a371b273 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:17.804936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8b903-76b2-46ea-96f0-7909a371b273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-bac8b903-76b2-46ea-96f0-7909a371b273 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:07:17.809589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:17.810557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:17.811621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:17.811621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:17.811621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:17.811621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:17.811621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:07:17.811621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:07:17.811621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:07:17.811621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:07:17.811621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:07:17.811621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:07:17.811621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 11:07:17.811621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:17.811621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 533/1087] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Aug 9 11:07:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:17.817015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed275c-1f4a-4e8f-91af-e6e6c71a999d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:17.878583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:17.922466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed275c-1f4a-4e8f-91af-e6e6c71a999d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:17.958171 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a844dd-8a10-4978-bf41-17f63efc019c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:17.958778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a844dd-8a10-4978-bf41-17f63efc019c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:17.959049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a844dd-8a10-4978-bf41-17f63efc019c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:17.959315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a844dd-8a10-4978-bf41-17f63efc019c None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:17.959966 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a844dd-8a10-4978-bf41-17f63efc019c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:17.960304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a844dd-8a10-4978-bf41-17f63efc019c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:17.961690 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a844dd-8a10-4978-bf41-17f63efc019c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:17.970076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 555/1088] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Aug 9 11:07:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:17.976094 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8b903-76b2-46ea-96f0-7909a371b273 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:17.992727 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:18.091791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8b903-76b2-46ea-96f0-7909a371b273 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:18.127042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7097a-088b-4fa7-9fe5-680afe488f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:18.127692 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7097a-088b-4fa7-9fe5-680afe488f73 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:18.128322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7097a-088b-4fa7-9fe5-680afe488f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:18.128586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7097a-088b-4fa7-9fe5-680afe488f73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:18.139737 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7097a-088b-4fa7-9fe5-680afe488f73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:18.141201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7097a-088b-4fa7-9fe5-680afe488f73 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-bef7097a-088b-4fa7-9fe5-680afe488f73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:07:18.155713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:18.156794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:07:18.157741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:07:18.157741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:07:18.157741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:18.157741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 534/1089] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:18.162951 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a844dd-8a10-4978-bf41-17f63efc019c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:18.266285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a844dd-8a10-4978-bf41-17f63efc019c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:18.280415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39745e-12ac-4ddb-9777-5043e868da70 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:18.280713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39745e-12ac-4ddb-9777-5043e868da70 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:18.280983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39745e-12ac-4ddb-9777-5043e868da70 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:18.282519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 535/1090] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:18.286678 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:18.287224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc84eb-9eff-4328-82ac-16605787dd42 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:18.287653 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc84eb-9eff-4328-82ac-16605787dd42 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:18.287653 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc84eb-9eff-4328-82ac-16605787dd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:18.302944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c1c8-e043-41db-a299-32c61bfc3dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:18.303551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c1c8-e043-41db-a299-32c61bfc3dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:18.303843 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c1c8-e043-41db-a299-32c61bfc3dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:18.304108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c1c8-e043-41db-a299-32c61bfc3dd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:18.304740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754c1c8-e043-41db-a299-32c61bfc3dd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:18.305036 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754c1c8-e043-41db-a299-32c61bfc3dd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:18.305832 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-77bc84eb-9eff-4328-82ac-16605787dd42 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:18.306427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754c1c8-e043-41db-a299-32c61bfc3dd5 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:18.307013 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-77bc84eb-9eff-4328-82ac-16605787dd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:18.318539 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 556/1091] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:18.324536 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c1c8-e043-41db-a299-32c61bfc3dd5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:18.365361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:18.373788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 536/1092] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:07:18.397294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc84eb-9eff-4328-82ac-16605787dd42 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:18.426117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c1c8-e043-41db-a299-32c61bfc3dd5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:18.461764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a6b51-6beb-49c8-ae6c-82cd38e7355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:18.462417 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a6b51-6beb-49c8-ae6c-82cd38e7355d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:18.462690 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a6b51-6beb-49c8-ae6c-82cd38e7355d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:18.462956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a6b51-6beb-49c8-ae6c-82cd38e7355d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:18.470006 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a6b51-6beb-49c8-ae6c-82cd38e7355d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:18.471439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a6b51-6beb-49c8-ae6c-82cd38e7355d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-7c1a6b51-6beb-49c8-ae6c-82cd38e7355d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:07:18.485125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:18.486803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:18.487978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:18.487978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:18.487978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:07:18.487978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:07:18.487978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:07:18.487978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:07:18.487978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:07:18.487978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:07:18.487978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 11:07:18.487978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:18.487978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 557/1093] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Aug 9 11:07:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:18.492054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a6b51-6beb-49c8-ae6c-82cd38e7355d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:18.501140 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc84eb-9eff-4328-82ac-16605787dd42 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:18.535118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5d4bd-9b2d-47d9-91a5-d052a8c8fb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:18.535824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5d4bd-9b2d-47d9-91a5-d052a8c8fb26 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:18.535990 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5d4bd-9b2d-47d9-91a5-d052a8c8fb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:18.536251 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5d4bd-9b2d-47d9-91a5-d052a8c8fb26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:18.541334 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:18.547781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5d4bd-9b2d-47d9-91a5-d052a8c8fb26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-80c5d4bd-9b2d-47d9-91a5-d052a8c8fb26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:07:18.552505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:18.553545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:18.554691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:18.554691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:18.554691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:18.554691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:18.554691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:07:18.554691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:07:18.554691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:07:18.554691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:07:18.554691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:07:18.554691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:07:18.554691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:07:18.554691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:18.554691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 537/1094] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:07:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:18.559924 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5d4bd-9b2d-47d9-91a5-d052a8c8fb26 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:18.600435 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a6b51-6beb-49c8-ae6c-82cd38e7355d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:18.614874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:18.635626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b566a39-00e6-42c4-8808-43d0cb5037e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:18.636143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b566a39-00e6-42c4-8808-43d0cb5037e2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:18.636415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b566a39-00e6-42c4-8808-43d0cb5037e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:18.636678 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b566a39-00e6-42c4-8808-43d0cb5037e2 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:18.637400 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b566a39-00e6-42c4-8808-43d0cb5037e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:18.637722 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b566a39-00e6-42c4-8808-43d0cb5037e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:18.641301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b566a39-00e6-42c4-8808-43d0cb5037e2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:18.662398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 558/1095] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Aug 9 11:07:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:18.667134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5d4bd-9b2d-47d9-91a5-d052a8c8fb26 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:18.668539 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b566a39-00e6-42c4-8808-43d0cb5037e2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:18.702114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df304a-36ba-4c77-982e-850d773c6881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:18.702716 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df304a-36ba-4c77-982e-850d773c6881 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:18.702984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df304a-36ba-4c77-982e-850d773c6881 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:18.703268 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df304a-36ba-4c77-982e-850d773c6881 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:18.703919 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df304a-36ba-4c77-982e-850d773c6881 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:18.704212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df304a-36ba-4c77-982e-850d773c6881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:18.705591 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df304a-36ba-4c77-982e-850d773c6881 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:18.714257 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 538/1096] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:07:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:18.720783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df304a-36ba-4c77-982e-850d773c6881 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:18.765648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:18.769167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b566a39-00e6-42c4-8808-43d0cb5037e2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:18.803660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11ad84-7d08-40e8-9e9c-1b43b29a16df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:18.804326 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11ad84-7d08-40e8-9e9c-1b43b29a16df None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:18.804596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11ad84-7d08-40e8-9e9c-1b43b29a16df None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:18.804859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11ad84-7d08-40e8-9e9c-1b43b29a16df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:18.822831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df304a-36ba-4c77-982e-850d773c6881 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:18.838918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:18.857302 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81498-1e08-4068-bec7-a3410f3dcda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:18.857956 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81498-1e08-4068-bec7-a3410f3dcda3 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:18.858231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81498-1e08-4068-bec7-a3410f3dcda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:18.858498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81498-1e08-4068-bec7-a3410f3dcda3 None admin] PATH_INFO: `/v3/users/b19a5d0506254110a8795dec8c502665` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:18.859649 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd81498-1e08-4068-bec7-a3410f3dcda3 None admin] RBAC: Authorizing `identity:get_user(user_id=b19a5d0506254110a8795dec8c502665)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:18.861094 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd81498-1e08-4068-bec7-a3410f3dcda3 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:18.862706 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 539/1097] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:07:18 2022] GET /identity/v3/users/b19a5d0506254110a8795dec8c502665 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:18.868595 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81498-1e08-4068-bec7-a3410f3dcda3 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:18.872701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11ad84-7d08-40e8-9e9c-1b43b29a16df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:18.874979 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11ad84-7d08-40e8-9e9c-1b43b29a16df None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:18.968115 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81498-1e08-4068-bec7-a3410f3dcda3 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:18.968341 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:18.973514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 559/1098] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:07:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:07:18.979364 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11ad84-7d08-40e8-9e9c-1b43b29a16df None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:19.007184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ac018-1cf4-4b98-a20b-7add086b6cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:19.008067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac018-1cf4-4b98-a20b-7add086b6cdc None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:19.008339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac018-1cf4-4b98-a20b-7add086b6cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:19.008662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac018-1cf4-4b98-a20b-7add086b6cdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:19.067785 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:19.084122 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ac018-1cf4-4b98-a20b-7add086b6cdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:19.085602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ac018-1cf4-4b98-a20b-7add086b6cdc None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:19.091041 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11ad84-7d08-40e8-9e9c-1b43b29a16df None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:19.124639 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1850e0-748d-4dc6-b359-80822c0acca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:19.125270 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1850e0-748d-4dc6-b359-80822c0acca1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:19.125537 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1850e0-748d-4dc6-b359-80822c0acca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:19.125828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1850e0-748d-4dc6-b359-80822c0acca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:19.136379 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1850e0-748d-4dc6-b359-80822c0acca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:19.137850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1850e0-748d-4dc6-b359-80822c0acca1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-9f1850e0-748d-4dc6-b359-80822c0acca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:07:19.153135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:19.154277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:07:19.155253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:07:19.155253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:07:19.155253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:19.155253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 560/1099] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:19.160253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1850e0-748d-4dc6-b359-80822c0acca1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:19.189603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 540/1100] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:07:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 11:07:19.195631 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ac018-1cf4-4b98-a20b-7add086b6cdc None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:19.212029 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:19.260183 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1850e0-748d-4dc6-b359-80822c0acca1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:19.278314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:19.293822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf84287-02e8-4b8b-8fa2-87d727cec08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:19.294437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf84287-02e8-4b8b-8fa2-87d727cec08e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:19.294712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf84287-02e8-4b8b-8fa2-87d727cec08e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:19.294812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ac018-1cf4-4b98-a20b-7add086b6cdc None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:19.294970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf84287-02e8-4b8b-8fa2-87d727cec08e None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:19.295609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf84287-02e8-4b8b-8fa2-87d727cec08e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:19.295905 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf84287-02e8-4b8b-8fa2-87d727cec08e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:19.297299 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf84287-02e8-4b8b-8fa2-87d727cec08e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:19.309116 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 561/1101] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:07:19.314967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf84287-02e8-4b8b-8fa2-87d727cec08e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:19.330422 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7749de-5586-4b06-97de-0e2f667d452c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:19.331069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7749de-5586-4b06-97de-0e2f667d452c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:19.331340 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7749de-5586-4b06-97de-0e2f667d452c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:19.331604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7749de-5586-4b06-97de-0e2f667d452c None admin] PATH_INFO: `/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:19.332770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7749de-5586-4b06-97de-0e2f667d452c None admin] RBAC: Authorizing `identity:get_project(project_id=2593ae1c231e4b50bdbbf66f115df6ba)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:19.334305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7749de-5586-4b06-97de-0e2f667d452c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:19.336157 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 541/1102] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:07:19 2022] GET /identity/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:19.342674 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7749de-5586-4b06-97de-0e2f667d452c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:19.416286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf84287-02e8-4b8b-8fa2-87d727cec08e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:19.427893 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:19.444039 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7749de-5586-4b06-97de-0e2f667d452c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:19.451879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b1f88-33e1-4e0a-bcd9-3784c763c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:19.452603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b1f88-33e1-4e0a-bcd9-3784c763c08e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:19.452932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b1f88-33e1-4e0a-bcd9-3784c763c08e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:19.453562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b1f88-33e1-4e0a-bcd9-3784c763c08e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:19.460070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b1f88-33e1-4e0a-bcd9-3784c763c08e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:19.461504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b1f88-33e1-4e0a-bcd9-3784c763c08e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:19.472128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-055b1f88-33e1-4e0a-bcd9-3784c763c08e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:07:19.472128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:19.472128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:19.472128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:19.472128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:19.472128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:19.472128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:19.472128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:19.472128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:19.472128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:19.472128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:19.472128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:19.472128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:07:19.472128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:07:19.472128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:19.473201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:19.474157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:07:19.474157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:07:19.474157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:07:19.474157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:07:19.474157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:07:19.474157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:07:19.474157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:07:19.474157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:19.474157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 562/1103] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:07:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:07:19.479280 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b1f88-33e1-4e0a-bcd9-3784c763c08e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:19.484751 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa358ba5-e88e-42c3-ad0f-b7530e59928d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:19.485420 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358ba5-e88e-42c3-ad0f-b7530e59928d None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:19.485722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358ba5-e88e-42c3-ad0f-b7530e59928d None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:19.486013 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358ba5-e88e-42c3-ad0f-b7530e59928d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:19.486744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa358ba5-e88e-42c3-ad0f-b7530e59928d None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=2593ae1c231e4b50bdbbf66f115df6ba, user.id=b19a5d0506254110a8795dec8c502665) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:19.487049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa358ba5-e88e-42c3-ad0f-b7530e59928d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:19.488499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa358ba5-e88e-42c3-ad0f-b7530e59928d None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:19.495161 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 542/1104] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:07:19 2022] GET /identity/v3/role_assignments?user.id=b19a5d0506254110a8795dec8c502665&scope.project.id=2593ae1c231e4b50bdbbf66f115df6ba&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:19.591150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b1f88-33e1-4e0a-bcd9-3784c763c08e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:19.630100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc1f69-926b-4106-8288-cf60095627fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:19.630721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc1f69-926b-4106-8288-cf60095627fc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:19.630996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc1f69-926b-4106-8288-cf60095627fc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:19.631263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc1f69-926b-4106-8288-cf60095627fc None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:19.632032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc1f69-926b-4106-8288-cf60095627fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:19.632339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc1f69-926b-4106-8288-cf60095627fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:19.633823 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc1f69-926b-4106-8288-cf60095627fc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:19.647054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 563/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:07:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:19.654174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa358ba5-e88e-42c3-ad0f-b7530e59928d None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:19.674727 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:19.755851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa358ba5-e88e-42c3-ad0f-b7530e59928d None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:19.789881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd45e4-e8cc-4ead-afd8-1da0e8cd70fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:19.790477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd45e4-e8cc-4ead-afd8-1da0e8cd70fe None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:19.790743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd45e4-e8cc-4ead-afd8-1da0e8cd70fe None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:19.790999 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd45e4-e8cc-4ead-afd8-1da0e8cd70fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:19.791708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd45e4-e8cc-4ead-afd8-1da0e8cd70fe None admin] RBAC: Adding query filter params (role.id=f8b621041fe241a586be5bf0799ff298, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=881030d7605b40879762d1c199362ee1) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:19.792001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd45e4-e8cc-4ead-afd8-1da0e8cd70fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:19.793432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd45e4-e8cc-4ead-afd8-1da0e8cd70fe None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:19.799415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 543/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:07:19 2022] GET /identity/v3/role_assignments?user.id=881030d7605b40879762d1c199362ee1&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=f8b621041fe241a586be5bf0799ff298 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:21.506962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcb77d-e58e-4475-8b48-939212717dc4 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:21.507511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcb77d-e58e-4475-8b48-939212717dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:21.507511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcb77d-e58e-4475-8b48-939212717dc4 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:21.508963 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 564/1107] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:21.514515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004e5f9-22b2-4446-88a9-5ba416b22290 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:21.514920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004e5f9-22b2-4446-88a9-5ba416b22290 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:21.515048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004e5f9-22b2-4446-88a9-5ba416b22290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:21.533559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-4004e5f9-22b2-4446-88a9-5ba416b22290 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:21.534783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-4004e5f9-22b2-4446-88a9-5ba416b22290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:21.606159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 544/1108] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:07:21.630949 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcb77d-e58e-4475-8b48-939212717dc4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:21.663346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:21.737418 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcb77d-e58e-4475-8b48-939212717dc4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:21.771846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa2c98-9094-4742-ad8c-ef84b3d5dd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:21.772493 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa2c98-9094-4742-ad8c-ef84b3d5dd7f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:21.772766 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa2c98-9094-4742-ad8c-ef84b3d5dd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:21.773032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa2c98-9094-4742-ad8c-ef84b3d5dd7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:21.774153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa2c98-9094-4742-ad8c-ef84b3d5dd7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:21.775635 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa2c98-9094-4742-ad8c-ef84b3d5dd7f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:21.777209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 565/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:21.783318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004e5f9-22b2-4446-88a9-5ba416b22290 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:21.795377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:21.883469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004e5f9-22b2-4446-88a9-5ba416b22290 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:21.918880 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b2dec-7729-4b4a-88d1-f92efd3c6574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:21.919469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b2dec-7729-4b4a-88d1-f92efd3c6574 None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:21.919739 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b2dec-7729-4b4a-88d1-f92efd3c6574 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:21.920004 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b2dec-7729-4b4a-88d1-f92efd3c6574 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:21.920626 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b2dec-7729-4b4a-88d1-f92efd3c6574 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:21.922113 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b2dec-7729-4b4a-88d1-f92efd3c6574 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:21.944566 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 545/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:07:21 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:07:23.964552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f1fed-3459-4153-8e20-dd6d557e3472 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:23.965227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f1fed-3459-4153-8e20-dd6d557e3472 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:23.965227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f1fed-3459-4153-8e20-dd6d557e3472 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:23.966601 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 566/1111] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:23.973327 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cacf0-9552-4874-bcfb-9645a10c888d None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:23.973820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cacf0-9552-4874-bcfb-9645a10c888d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:23.973913 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cacf0-9552-4874-bcfb-9645a10c888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:23.994941 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-df9cacf0-9552-4874-bcfb-9645a10c888d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:23.996134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-df9cacf0-9552-4874-bcfb-9645a10c888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:24.059013 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:24.069449 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 546/1112] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 11:07:24.097170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f1fed-3459-4153-8e20-dd6d557e3472 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:24.199354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:24.204994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f1fed-3459-4153-8e20-dd6d557e3472 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:24.239810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64ba0e-2e46-4c1c-8a6b-5ec99b7b9266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:24.240353 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64ba0e-2e46-4c1c-8a6b-5ec99b7b9266 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:24.240625 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64ba0e-2e46-4c1c-8a6b-5ec99b7b9266 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:24.240890 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64ba0e-2e46-4c1c-8a6b-5ec99b7b9266 None admin] PATH_INFO: `/v3/roles/90f6c18c707742de8521c29b89d64215` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:24.242395 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64ba0e-2e46-4c1c-8a6b-5ec99b7b9266 None admin] RBAC: Authorizing `identity:get_role(role_id=90f6c18c707742de8521c29b89d64215)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:24.243759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64ba0e-2e46-4c1c-8a6b-5ec99b7b9266 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:24.245110 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 567/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:07:24 2022] GET /identity/v3/roles/90f6c18c707742de8521c29b89d64215 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:24.251202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cacf0-9552-4874-bcfb-9645a10c888d None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:24.358898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cacf0-9552-4874-bcfb-9645a10c888d None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:24.395918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465872db-dab0-4f82-a11d-ec90f5084649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:24.396539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465872db-dab0-4f82-a11d-ec90f5084649 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:24.396818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465872db-dab0-4f82-a11d-ec90f5084649 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:24.397073 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465872db-dab0-4f82-a11d-ec90f5084649 None admin] PATH_INFO: `/v3/users/54df7a803b8442a0a72f2b23f5685ce0` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:24.410575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465872db-dab0-4f82-a11d-ec90f5084649 None admin] RBAC: Authorizing `identity:get_user(user_id=54df7a803b8442a0a72f2b23f5685ce0)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:24.412056 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465872db-dab0-4f82-a11d-ec90f5084649 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:24.413817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 547/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:07:24 2022] GET /identity/v3/users/54df7a803b8442a0a72f2b23f5685ce0 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:24.420099 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64ba0e-2e46-4c1c-8a6b-5ec99b7b9266 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:24.536626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64ba0e-2e46-4c1c-8a6b-5ec99b7b9266 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:24.572314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0517b-8915-417b-9f6c-21b91344aa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:24.572925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0517b-8915-417b-9f6c-21b91344aa69 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:24.573196 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0517b-8915-417b-9f6c-21b91344aa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:24.573454 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0517b-8915-417b-9f6c-21b91344aa69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:24.607939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:24.642766 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0517b-8915-417b-9f6c-21b91344aa69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:24.644195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0517b-8915-417b-9f6c-21b91344aa69 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:24.746940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 568/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:07:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:07:24.753533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465872db-dab0-4f82-a11d-ec90f5084649 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:24.812066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:24.859221 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465872db-dab0-4f82-a11d-ec90f5084649 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:24.896204 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b12fda-3216-4113-8769-c98b03540945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:24.896808 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b12fda-3216-4113-8769-c98b03540945 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:24.897087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b12fda-3216-4113-8769-c98b03540945 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:24.897348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b12fda-3216-4113-8769-c98b03540945 None admin] PATH_INFO: `/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:24.898737 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b12fda-3216-4113-8769-c98b03540945 None admin] RBAC: Authorizing `identity:get_project(project_id=2593ae1c231e4b50bdbbf66f115df6ba)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:24.900185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b12fda-3216-4113-8769-c98b03540945 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:24.901903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 548/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:07:24 2022] GET /identity/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:24.908520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0517b-8915-417b-9f6c-21b91344aa69 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:24.983126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:25.020769 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0517b-8915-417b-9f6c-21b91344aa69 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:25.057063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae655b29-dc0b-44b7-b888-92d22ca886a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:25.057665 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae655b29-dc0b-44b7-b888-92d22ca886a3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:25.057954 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae655b29-dc0b-44b7-b888-92d22ca886a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:25.058226 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae655b29-dc0b-44b7-b888-92d22ca886a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:25.058935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae655b29-dc0b-44b7-b888-92d22ca886a3 None admin] RBAC: Adding query filter params (role.id=90f6c18c707742de8521c29b89d64215, scope.project.id=2593ae1c231e4b50bdbbf66f115df6ba, user.id=54df7a803b8442a0a72f2b23f5685ce0) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:25.059234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae655b29-dc0b-44b7-b888-92d22ca886a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:25.060667 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae655b29-dc0b-44b7-b888-92d22ca886a3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:25.066681 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 569/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:07:24 2022] GET /identity/v3/role_assignments?user.id=54df7a803b8442a0a72f2b23f5685ce0&scope.project.id=2593ae1c231e4b50bdbbf66f115df6ba&role.id=90f6c18c707742de8521c29b89d64215 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:27.014639 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f076c-0fe7-4fb5-811e-d4cef99ed853 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:27.015210 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f076c-0fe7-4fb5-811e-d4cef99ed853 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:27.015210 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f076c-0fe7-4fb5-811e-d4cef99ed853 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:27.016566 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 549/1118] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:27.022668 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa214db-a48e-4109-a63a-623df82e7744 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:27.023103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa214db-a48e-4109-a63a-623df82e7744 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:27.023206 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa214db-a48e-4109-a63a-623df82e7744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:27.042675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-caa214db-a48e-4109-a63a-623df82e7744 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:27.043872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-caa214db-a48e-4109-a63a-623df82e7744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:27.118775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 570/1119] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:27.142222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f076c-0fe7-4fb5-811e-d4cef99ed853 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:27.248636 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f076c-0fe7-4fb5-811e-d4cef99ed853 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:27.273221 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:27.285470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee631a-3961-41fc-85db-3752f895a48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:27.286120 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee631a-3961-41fc-85db-3752f895a48d None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:27.286395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee631a-3961-41fc-85db-3752f895a48d None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:27.286661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee631a-3961-41fc-85db-3752f895a48d None admin] PATH_INFO: `/v3/roles/90f6c18c707742de8521c29b89d64215` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:27.288641 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee631a-3961-41fc-85db-3752f895a48d None admin] RBAC: Authorizing `identity:get_role(role_id=90f6c18c707742de8521c29b89d64215)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:27.290765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee631a-3961-41fc-85db-3752f895a48d None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:27.291410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 550/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:07:27 2022] GET /identity/v3/roles/90f6c18c707742de8521c29b89d64215 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:27.297949 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa214db-a48e-4109-a63a-623df82e7744 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:27.356820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:27.405516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa214db-a48e-4109-a63a-623df82e7744 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:27.441977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25108f44-72be-43fb-b8a1-b5ed29b84194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:27.442596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25108f44-72be-43fb-b8a1-b5ed29b84194 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:27.442865 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25108f44-72be-43fb-b8a1-b5ed29b84194 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:27.443127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25108f44-72be-43fb-b8a1-b5ed29b84194 None admin] PATH_INFO: `/v3/users/54df7a803b8442a0a72f2b23f5685ce0` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:27.444413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25108f44-72be-43fb-b8a1-b5ed29b84194 None admin] RBAC: Authorizing `identity:get_user(user_id=54df7a803b8442a0a72f2b23f5685ce0)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:27.445865 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25108f44-72be-43fb-b8a1-b5ed29b84194 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:27.447463 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 571/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:07:27 2022] GET /identity/v3/users/54df7a803b8442a0a72f2b23f5685ce0 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:27.453543 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee631a-3961-41fc-85db-3752f895a48d None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:27.560534 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee631a-3961-41fc-85db-3752f895a48d None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:27.595679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b969f-4ce4-4fc3-bb6b-35317b6f9286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:27.596295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b969f-4ce4-4fc3-bb6b-35317b6f9286 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:27.596589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b969f-4ce4-4fc3-bb6b-35317b6f9286 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:27.596825 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b969f-4ce4-4fc3-bb6b-35317b6f9286 None admin] PATH_INFO: `/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:27.597976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b969f-4ce4-4fc3-bb6b-35317b6f9286 None admin] RBAC: Authorizing `identity:get_project(project_id=2593ae1c231e4b50bdbbf66f115df6ba)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:27.599415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b969f-4ce4-4fc3-bb6b-35317b6f9286 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:27.601069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 551/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:07:27 2022] GET /identity/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:27.607513 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25108f44-72be-43fb-b8a1-b5ed29b84194 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:27.708989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25108f44-72be-43fb-b8a1-b5ed29b84194 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:27.735873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:27.744129 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71464d2d-1d28-467a-92d2-6f2f621f0348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:27.744784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71464d2d-1d28-467a-92d2-6f2f621f0348 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:27.745054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71464d2d-1d28-467a-92d2-6f2f621f0348 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:27.745321 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71464d2d-1d28-467a-92d2-6f2f621f0348 None admin] PATH_INFO: `/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba/users/54df7a803b8442a0a72f2b23f5685ce0/roles/90f6c18c707742de8521c29b89d64215` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:27.747702 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71464d2d-1d28-467a-92d2-6f2f621f0348 None admin] RBAC: Authorizing `identity:create_grant(project_id=2593ae1c231e4b50bdbbf66f115df6ba, user_id=54df7a803b8442a0a72f2b23f5685ce0, role_id=90f6c18c707742de8521c29b89d64215)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:27.749134 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71464d2d-1d28-467a-92d2-6f2f621f0348 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:27.763532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 572/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:07:27 2022] PUT /identity/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba/users/54df7a803b8442a0a72f2b23f5685ce0/roles/90f6c18c707742de8521c29b89d64215 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:07:29.768956 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a3e41-ed26-45b5-8753-85892ae21922 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:29.769499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a3e41-ed26-45b5-8753-85892ae21922 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:29.769499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a3e41-ed26-45b5-8753-85892ae21922 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:29.770764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 552/1124] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:29.776176 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a45673-18f7-4c8a-8656-273a104f06ec None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:29.776606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a45673-18f7-4c8a-8656-273a104f06ec None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:29.776717 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a45673-18f7-4c8a-8656-273a104f06ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:29.796020 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f8a45673-18f7-4c8a-8656-273a104f06ec None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:29.797219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f8a45673-18f7-4c8a-8656-273a104f06ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:29.868073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 573/1125] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:29.891549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a3e41-ed26-45b5-8753-85892ae21922 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:29.954441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:30.000212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a3e41-ed26-45b5-8753-85892ae21922 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:30.043181 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45769ce5-1954-4e01-a64f-29f36ed3e369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:30.043802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45769ce5-1954-4e01-a64f-29f36ed3e369 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:30.044075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45769ce5-1954-4e01-a64f-29f36ed3e369 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:30.044339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45769ce5-1954-4e01-a64f-29f36ed3e369 None admin] PATH_INFO: `/v3/roles/90f6c18c707742de8521c29b89d64215` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:30.045809 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45769ce5-1954-4e01-a64f-29f36ed3e369 None admin] RBAC: Authorizing `identity:get_role(role_id=90f6c18c707742de8521c29b89d64215)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:30.047188 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45769ce5-1954-4e01-a64f-29f36ed3e369 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:30.048519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 553/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:07:29 2022] GET /identity/v3/roles/90f6c18c707742de8521c29b89d64215 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:30.054753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a45673-18f7-4c8a-8656-273a104f06ec None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:30.156243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a45673-18f7-4c8a-8656-273a104f06ec None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:30.173490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:30.191720 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969b76e-18a0-4a10-b47f-320ee1b5b9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:30.192330 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969b76e-18a0-4a10-b47f-320ee1b5b9ec None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:30.192596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969b76e-18a0-4a10-b47f-320ee1b5b9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:30.192859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969b76e-18a0-4a10-b47f-320ee1b5b9ec None admin] PATH_INFO: `/v3/users/54df7a803b8442a0a72f2b23f5685ce0` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:30.194012 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969b76e-18a0-4a10-b47f-320ee1b5b9ec None admin] RBAC: Authorizing `identity:get_user(user_id=54df7a803b8442a0a72f2b23f5685ce0)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:30.195485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969b76e-18a0-4a10-b47f-320ee1b5b9ec None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:30.197067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 574/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:07:30 2022] GET /identity/v3/users/54df7a803b8442a0a72f2b23f5685ce0 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:30.203141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45769ce5-1954-4e01-a64f-29f36ed3e369 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:30.310377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45769ce5-1954-4e01-a64f-29f36ed3e369 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:30.337923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:30.348694 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34e1b3-c537-475a-bd65-0b36927a0a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:30.349300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34e1b3-c537-475a-bd65-0b36927a0a4e None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:30.349568 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34e1b3-c537-475a-bd65-0b36927a0a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:30.349867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34e1b3-c537-475a-bd65-0b36927a0a4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:30.436813 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34e1b3-c537-475a-bd65-0b36927a0a4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:30.438307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34e1b3-c537-475a-bd65-0b36927a0a4e None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:30.537502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 554/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:07:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:07:30.543951 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969b76e-18a0-4a10-b47f-320ee1b5b9ec None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:30.647557 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969b76e-18a0-4a10-b47f-320ee1b5b9ec None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:30.686692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456976bc-a52f-4b8b-b1c1-3add06a9ff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:30.687351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456976bc-a52f-4b8b-b1c1-3add06a9ff06 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:30.687626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456976bc-a52f-4b8b-b1c1-3add06a9ff06 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:30.687895 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456976bc-a52f-4b8b-b1c1-3add06a9ff06 None admin] PATH_INFO: `/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:30.689083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456976bc-a52f-4b8b-b1c1-3add06a9ff06 None admin] RBAC: Authorizing `identity:get_project(project_id=2593ae1c231e4b50bdbbf66f115df6ba)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:30.690536 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456976bc-a52f-4b8b-b1c1-3add06a9ff06 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:30.692222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 575/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:07:30 2022] GET /identity/v3/projects/2593ae1c231e4b50bdbbf66f115df6ba => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:30.698786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34e1b3-c537-475a-bd65-0b36927a0a4e None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:30.726906 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:30.803747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34e1b3-c537-475a-bd65-0b36927a0a4e None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:30.838353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd508238-df71-4c49-9ab1-d70dd75ce42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:30.838943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd508238-df71-4c49-9ab1-d70dd75ce42d None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:30.839215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd508238-df71-4c49-9ab1-d70dd75ce42d None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:30.839478 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd508238-df71-4c49-9ab1-d70dd75ce42d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:30.840199 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd508238-df71-4c49-9ab1-d70dd75ce42d None admin] RBAC: Adding query filter params (role.id=90f6c18c707742de8521c29b89d64215, scope.project.id=2593ae1c231e4b50bdbbf66f115df6ba, user.id=54df7a803b8442a0a72f2b23f5685ce0) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:30.840499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd508238-df71-4c49-9ab1-d70dd75ce42d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:30.841968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd508238-df71-4c49-9ab1-d70dd75ce42d None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:30.847768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 555/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:07:30 2022] GET /identity/v3/role_assignments?user.id=54df7a803b8442a0a72f2b23f5685ce0&scope.project.id=2593ae1c231e4b50bdbbf66f115df6ba&role.id=90f6c18c707742de8521c29b89d64215 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:32.833757 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54bf82-99ad-47b1-a491-dddbbe50217f None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:32.834331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54bf82-99ad-47b1-a491-dddbbe50217f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:32.834331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54bf82-99ad-47b1-a491-dddbbe50217f None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:32.835779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 576/1131] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:32.840997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667b982-e093-49e2-a1ec-a792bad46b4f None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:32.841438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667b982-e093-49e2-a1ec-a792bad46b4f None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:32.841531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667b982-e093-49e2-a1ec-a792bad46b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:32.860281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-d667b982-e093-49e2-a1ec-a792bad46b4f None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:32.861483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d667b982-e093-49e2-a1ec-a792bad46b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:32.932946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 556/1132] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:32.956114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54bf82-99ad-47b1-a491-dddbbe50217f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:33.015636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:33.062810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54bf82-99ad-47b1-a491-dddbbe50217f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:33.098320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825fce8c-ff3b-4421-a3be-01d15d1d7592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:33.098870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fce8c-ff3b-4421-a3be-01d15d1d7592 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:33.099139 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fce8c-ff3b-4421-a3be-01d15d1d7592 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:33.099403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fce8c-ff3b-4421-a3be-01d15d1d7592 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:33.100559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825fce8c-ff3b-4421-a3be-01d15d1d7592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:33.102037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825fce8c-ff3b-4421-a3be-01d15d1d7592 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:33.103598 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 577/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:33.109665 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667b982-e093-49e2-a1ec-a792bad46b4f None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:33.131171 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:33.211040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667b982-e093-49e2-a1ec-a792bad46b4f None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:33.246250 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e5445-f6b2-47a1-84e4-f04a70056b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:33.246834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e5445-f6b2-47a1-84e4-f04a70056b8e None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:33.247140 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e5445-f6b2-47a1-84e4-f04a70056b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:33.247405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e5445-f6b2-47a1-84e4-f04a70056b8e None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:33.248027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e5445-f6b2-47a1-84e4-f04a70056b8e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:33.249463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e5445-f6b2-47a1-84e4-f04a70056b8e None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:33.279964 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 557/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Aug 9 11:07:33 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:07:35.273331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919c79e-b05c-44d1-be18-62e83ece1d89 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:35.273932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919c79e-b05c-44d1-be18-62e83ece1d89 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:35.273932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919c79e-b05c-44d1-be18-62e83ece1d89 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:35.275269 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 578/1135] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:35.280522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d874dc-9dcb-4da6-bf3b-09a42def6cca None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:35.280956 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d874dc-9dcb-4da6-bf3b-09a42def6cca None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:35.281048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d874dc-9dcb-4da6-bf3b-09a42def6cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:35.300004 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-d7d874dc-9dcb-4da6-bf3b-09a42def6cca None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:35.301216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d7d874dc-9dcb-4da6-bf3b-09a42def6cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:35.371701 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 558/1136] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:35.396794 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919c79e-b05c-44d1-be18-62e83ece1d89 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:35.505360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919c79e-b05c-44d1-be18-62e83ece1d89 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:35.528439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:35.540294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecac4f8-6d65-4bc2-a0d0-18a36079bb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:35.540917 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecac4f8-6d65-4bc2-a0d0-18a36079bb13 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:35.541189 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecac4f8-6d65-4bc2-a0d0-18a36079bb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:35.541452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecac4f8-6d65-4bc2-a0d0-18a36079bb13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:35.542617 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecac4f8-6d65-4bc2-a0d0-18a36079bb13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:35.544044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecac4f8-6d65-4bc2-a0d0-18a36079bb13 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:35.545656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 579/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:07:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:35.551666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d874dc-9dcb-4da6-bf3b-09a42def6cca None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:35.553973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:35.649476 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d874dc-9dcb-4da6-bf3b-09a42def6cca None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:35.684042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f16cf-feb8-4cc7-8c85-fdfdb7c75cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:35.684651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f16cf-feb8-4cc7-8c85-fdfdb7c75cc4 None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:35.684925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f16cf-feb8-4cc7-8c85-fdfdb7c75cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:35.685184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f16cf-feb8-4cc7-8c85-fdfdb7c75cc4 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:35.685846 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f16cf-feb8-4cc7-8c85-fdfdb7c75cc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:35.687311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f16cf-feb8-4cc7-8c85-fdfdb7c75cc4 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:35.709850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 559/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:07:35 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:07:37.728746 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d205a-ca54-4ee9-bc0d-41d25af38349 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:37.729306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d205a-ca54-4ee9-bc0d-41d25af38349 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:37.729306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d205a-ca54-4ee9-bc0d-41d25af38349 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:37.730664 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 580/1139] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:37.736396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2e25e-69d6-4d8e-a91d-ccd2e0d4019b None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:37.736813 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2e25e-69d6-4d8e-a91d-ccd2e0d4019b None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:37.736910 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2e25e-69d6-4d8e-a91d-ccd2e0d4019b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:37.761510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-a0d2e25e-69d6-4d8e-a91d-ccd2e0d4019b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:37.762775 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a0d2e25e-69d6-4d8e-a91d-ccd2e0d4019b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:37.818494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:37.833147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 560/1140] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:37.856477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d205a-ca54-4ee9-bc0d-41d25af38349 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:37.966784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d205a-ca54-4ee9-bc0d-41d25af38349 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:38.005978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9e5b1-1e13-4bf6-af73-627428514cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:38.006484 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9e5b1-1e13-4bf6-af73-627428514cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:38.006811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9e5b1-1e13-4bf6-af73-627428514cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:38.007075 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9e5b1-1e13-4bf6-af73-627428514cd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:38.017583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9e5b1-1e13-4bf6-af73-627428514cd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-f3c9e5b1-1e13-4bf6-af73-627428514cd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:07:38.022132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:38.023257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:38.024368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:38.024368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:38.024368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:38.024368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:38.024368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:07:38.024368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:07:38.024368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:07:38.024368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:07:38.024368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:07:38.024368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:07:38.024368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:07:38.024368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:38.024368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 581/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:07:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:38.029657 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2e25e-69d6-4d8e-a91d-ccd2e0d4019b None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:38.129953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2e25e-69d6-4d8e-a91d-ccd2e0d4019b None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:38.163624 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d424c64-7553-4f4f-bb98-fccb3ca52807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:38.164213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d424c64-7553-4f4f-bb98-fccb3ca52807 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:38.164483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d424c64-7553-4f4f-bb98-fccb3ca52807 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:38.164738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d424c64-7553-4f4f-bb98-fccb3ca52807 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:38.165382 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d424c64-7553-4f4f-bb98-fccb3ca52807 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:38.165674 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d424c64-7553-4f4f-bb98-fccb3ca52807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:38.167053 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d424c64-7553-4f4f-bb98-fccb3ca52807 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:38.174991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 561/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:07:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:38.181293 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9e5b1-1e13-4bf6-af73-627428514cd5 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:38.233142 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:38.284308 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9e5b1-1e13-4bf6-af73-627428514cd5 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:38.318330 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc8c69-1b3e-4112-b204-ab9f4c10b28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:38.318939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc8c69-1b3e-4112-b204-ab9f4c10b28c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:38.319228 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc8c69-1b3e-4112-b204-ab9f4c10b28c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:38.319495 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc8c69-1b3e-4112-b204-ab9f4c10b28c None admin] PATH_INFO: `/v3/users/7e4cc3f61ad34277a3a615eb246e1478` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:38.332794 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc8c69-1b3e-4112-b204-ab9f4c10b28c None admin] RBAC: Authorizing `identity:get_user(user_id=7e4cc3f61ad34277a3a615eb246e1478)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:38.334263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc8c69-1b3e-4112-b204-ab9f4c10b28c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:38.335913 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 582/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:07:38 2022] GET /identity/v3/users/7e4cc3f61ad34277a3a615eb246e1478 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:38.342177 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d424c64-7553-4f4f-bb98-fccb3ca52807 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:38.394611 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:38.449202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d424c64-7553-4f4f-bb98-fccb3ca52807 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:38.483798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353be0b-5941-42d9-b74c-e688aec41ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:38.484402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353be0b-5941-42d9-b74c-e688aec41ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:38.484669 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353be0b-5941-42d9-b74c-e688aec41ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:38.484936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353be0b-5941-42d9-b74c-e688aec41ca2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:38.557650 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353be0b-5941-42d9-b74c-e688aec41ca2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:38.559092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353be0b-5941-42d9-b74c-e688aec41ca2 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:38.607030 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:38.660601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 562/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:07:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:07:38.666979 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc8c69-1b3e-4112-b204-ab9f4c10b28c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:38.766696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc8c69-1b3e-4112-b204-ab9f4c10b28c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:38.775735 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:38.801491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78e10f-cb58-479a-ad56-e64863277c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:38.802136 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78e10f-cb58-479a-ad56-e64863277c13 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:38.802406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78e10f-cb58-479a-ad56-e64863277c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:38.802666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78e10f-cb58-479a-ad56-e64863277c13 None admin] PATH_INFO: `/v3/projects/c762131d47d44c2ba89d3d4b3c2caa0c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:38.803865 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78e10f-cb58-479a-ad56-e64863277c13 None admin] RBAC: Authorizing `identity:get_project(project_id=c762131d47d44c2ba89d3d4b3c2caa0c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:38.805283 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78e10f-cb58-479a-ad56-e64863277c13 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:38.806944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 583/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:07:38 2022] GET /identity/v3/projects/c762131d47d44c2ba89d3d4b3c2caa0c => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:38.813497 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353be0b-5941-42d9-b74c-e688aec41ca2 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:38.912528 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353be0b-5941-42d9-b74c-e688aec41ca2 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:38.946966 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f842e93-c68e-4f3b-9d4c-93b16941d869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:38.947555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f842e93-c68e-4f3b-9d4c-93b16941d869 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:38.947820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f842e93-c68e-4f3b-9d4c-93b16941d869 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:38.948078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f842e93-c68e-4f3b-9d4c-93b16941d869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:38.948784 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f842e93-c68e-4f3b-9d4c-93b16941d869 None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=c762131d47d44c2ba89d3d4b3c2caa0c, user.id=7e4cc3f61ad34277a3a615eb246e1478) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:38.949080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f842e93-c68e-4f3b-9d4c-93b16941d869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:38.950701 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f842e93-c68e-4f3b-9d4c-93b16941d869 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:38.956154 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 563/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:07:38 2022] GET /identity/v3/role_assignments?user.id=7e4cc3f61ad34277a3a615eb246e1478&scope.project.id=c762131d47d44c2ba89d3d4b3c2caa0c&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:40.909829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127cdf1-de2d-4057-80f7-89cf53be0fe8 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:40.910413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127cdf1-de2d-4057-80f7-89cf53be0fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:40.910413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127cdf1-de2d-4057-80f7-89cf53be0fe8 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:40.911700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 584/1147] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:40.917391 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cb18-08d5-4324-ab3d-fea807945b4e None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:40.917813 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cb18-08d5-4324-ab3d-fea807945b4e None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:40.917965 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cb18-08d5-4324-ab3d-fea807945b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:40.936754 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-1466cb18-08d5-4324-ab3d-fea807945b4e None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:40.937989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-1466cb18-08d5-4324-ab3d-fea807945b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:40.947427 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:41.008285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 564/1148] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:41.030670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127cdf1-de2d-4057-80f7-89cf53be0fe8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:41.136301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127cdf1-de2d-4057-80f7-89cf53be0fe8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:41.170839 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097e682-4a71-4f85-be49-c1c142dda3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:41.171385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097e682-4a71-4f85-be49-c1c142dda3cd None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:41.171657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097e682-4a71-4f85-be49-c1c142dda3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:41.171928 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097e682-4a71-4f85-be49-c1c142dda3cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:41.182429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097e682-4a71-4f85-be49-c1c142dda3cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-4097e682-4a71-4f85-be49-c1c142dda3cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:07:41.187071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:41.188254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:41.189107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:41.189107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:41.189107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:41.189107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:41.189107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:07:41.189107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:07:41.189107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:07:41.189107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:07:41.189107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:07:41.189107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:07:41.189107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:07:41.189107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:41.189107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 585/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:07:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:41.194682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466cb18-08d5-4324-ab3d-fea807945b4e None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:41.302431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466cb18-08d5-4324-ab3d-fea807945b4e None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:41.338370 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c1ed6-f908-4f9c-a069-f16632ca309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:41.338928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c1ed6-f908-4f9c-a069-f16632ca309b None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:41.339214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c1ed6-f908-4f9c-a069-f16632ca309b None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:41.339480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c1ed6-f908-4f9c-a069-f16632ca309b None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:41.340127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c1ed6-f908-4f9c-a069-f16632ca309b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:41.340426 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c1ed6-f908-4f9c-a069-f16632ca309b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:41.341838 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c1ed6-f908-4f9c-a069-f16632ca309b None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:41.349957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 565/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:07:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:41.356274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097e682-4a71-4f85-be49-c1c142dda3cd None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:41.392680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:41.459309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097e682-4a71-4f85-be49-c1c142dda3cd None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:41.495530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842d368-9326-4cfe-b20a-84118e983f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:41.496152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d368-9326-4cfe-b20a-84118e983f7d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:41.496419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d368-9326-4cfe-b20a-84118e983f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:41.496680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842d368-9326-4cfe-b20a-84118e983f7d None admin] PATH_INFO: `/v3/users/7e4cc3f61ad34277a3a615eb246e1478` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:41.497858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842d368-9326-4cfe-b20a-84118e983f7d None admin] RBAC: Authorizing `identity:get_user(user_id=7e4cc3f61ad34277a3a615eb246e1478)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:41.499291 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842d368-9326-4cfe-b20a-84118e983f7d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:41.500872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 586/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:07:41 2022] GET /identity/v3/users/7e4cc3f61ad34277a3a615eb246e1478 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:41.507385 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c1ed6-f908-4f9c-a069-f16632ca309b None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:41.517152 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:41.606240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c1ed6-f908-4f9c-a069-f16632ca309b None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:41.641686 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7456dcd-f6f0-49a1-ad1c-d5278fe43068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:41.642324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7456dcd-f6f0-49a1-ad1c-d5278fe43068 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:41.642576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7456dcd-f6f0-49a1-ad1c-d5278fe43068 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:41.642851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7456dcd-f6f0-49a1-ad1c-d5278fe43068 None admin] PATH_INFO: `/v3/projects/c762131d47d44c2ba89d3d4b3c2caa0c` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:41.643988 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7456dcd-f6f0-49a1-ad1c-d5278fe43068 None admin] RBAC: Authorizing `identity:get_project(project_id=c762131d47d44c2ba89d3d4b3c2caa0c)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:41.645430 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7456dcd-f6f0-49a1-ad1c-d5278fe43068 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:41.647101 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 566/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:07:41 2022] GET /identity/v3/projects/c762131d47d44c2ba89d3d4b3c2caa0c => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:41.653490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842d368-9326-4cfe-b20a-84118e983f7d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:41.754053 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842d368-9326-4cfe-b20a-84118e983f7d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:41.756325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:41.789866 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325ea89-009c-4487-8ba0-2432508bf022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:41.790514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325ea89-009c-4487-8ba0-2432508bf022 None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:41.790784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325ea89-009c-4487-8ba0-2432508bf022 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:41.791051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325ea89-009c-4487-8ba0-2432508bf022 None admin] PATH_INFO: `/v3/projects/c762131d47d44c2ba89d3d4b3c2caa0c/users/7e4cc3f61ad34277a3a615eb246e1478/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:41.793047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325ea89-009c-4487-8ba0-2432508bf022 None admin] RBAC: Authorizing `identity:create_grant(project_id=c762131d47d44c2ba89d3d4b3c2caa0c, user_id=7e4cc3f61ad34277a3a615eb246e1478, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:41.794493 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325ea89-009c-4487-8ba0-2432508bf022 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:41.808890 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 587/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:07:41 2022] PUT /identity/v3/projects/c762131d47d44c2ba89d3d4b3c2caa0c/users/7e4cc3f61ad34277a3a615eb246e1478/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:07:43.749919 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e784fea-44f6-4724-bd6f-1d4ba7d56392 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:43.750448 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e784fea-44f6-4724-bd6f-1d4ba7d56392 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:43.750448 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e784fea-44f6-4724-bd6f-1d4ba7d56392 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:43.751689 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 567/1154] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:43.757389 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a812bb-2035-4639-8831-d8ad7b43bc66 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:43.757841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a812bb-2035-4639-8831-d8ad7b43bc66 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:43.757928 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a812bb-2035-4639-8831-d8ad7b43bc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:43.777083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-79a812bb-2035-4639-8831-d8ad7b43bc66 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:43.778327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-79a812bb-2035-4639-8831-d8ad7b43bc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:43.848910 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 588/1155] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:43.872432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e784fea-44f6-4724-bd6f-1d4ba7d56392 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:43.952293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:43.980061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e784fea-44f6-4724-bd6f-1d4ba7d56392 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:44.014953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267da3cd-3299-41f3-a8a6-40894b446c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:44.015486 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267da3cd-3299-41f3-a8a6-40894b446c5f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:44.015758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267da3cd-3299-41f3-a8a6-40894b446c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:44.016024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267da3cd-3299-41f3-a8a6-40894b446c5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:44.026923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267da3cd-3299-41f3-a8a6-40894b446c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-267da3cd-3299-41f3-a8a6-40894b446c5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:07:44.031555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:44.032555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:44.033465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:44.033465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:44.033465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:44.033465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:44.033465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:07:44.033465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:07:44.033465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:07:44.033465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:07:44.033465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:07:44.033465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:07:44.033465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:07:44.033465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:44.033465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 568/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:07:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:44.039181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a812bb-2035-4639-8831-d8ad7b43bc66 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:44.134215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:44.141572 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a812bb-2035-4639-8831-d8ad7b43bc66 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:44.175492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00061069-cc6f-40b7-b884-fffe27ceca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:44.176091 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00061069-cc6f-40b7-b884-fffe27ceca8b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:44.176362 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00061069-cc6f-40b7-b884-fffe27ceca8b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:44.176626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00061069-cc6f-40b7-b884-fffe27ceca8b None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:44.177274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00061069-cc6f-40b7-b884-fffe27ceca8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:44.177568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00061069-cc6f-40b7-b884-fffe27ceca8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:44.179021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00061069-cc6f-40b7-b884-fffe27ceca8b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:44.187194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 589/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:07:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:44.193358 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267da3cd-3299-41f3-a8a6-40894b446c5f None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:44.301823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267da3cd-3299-41f3-a8a6-40894b446c5f None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:44.336270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94375bce-0344-4b44-ba78-fe23594c66df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:44.336888 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94375bce-0344-4b44-ba78-fe23594c66df None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:44.337158 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94375bce-0344-4b44-ba78-fe23594c66df None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:44.337426 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94375bce-0344-4b44-ba78-fe23594c66df None admin] PATH_INFO: `/v3/users/7e4cc3f61ad34277a3a615eb246e1478` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:44.338620 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94375bce-0344-4b44-ba78-fe23594c66df None admin] RBAC: Authorizing `identity:get_user(user_id=7e4cc3f61ad34277a3a615eb246e1478)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:44.340075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94375bce-0344-4b44-ba78-fe23594c66df None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:44.341656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 569/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:07:44 2022] GET /identity/v3/users/7e4cc3f61ad34277a3a615eb246e1478 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:44.347960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00061069-cc6f-40b7-b884-fffe27ceca8b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:44.449898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00061069-cc6f-40b7-b884-fffe27ceca8b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:44.485532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9a801-9fe3-4035-8275-26865696c151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:44.486167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9a801-9fe3-4035-8275-26865696c151 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:44.486441 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9a801-9fe3-4035-8275-26865696c151 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:44.486701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9a801-9fe3-4035-8275-26865696c151 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:44.512139 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:44.555298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9a801-9fe3-4035-8275-26865696c151 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:44.556657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9a801-9fe3-4035-8275-26865696c151 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:44.656166 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 590/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:07:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:07:44.662648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94375bce-0344-4b44-ba78-fe23594c66df None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:44.665877 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:44.767431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94375bce-0344-4b44-ba78-fe23594c66df None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:44.801749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6d806-0c7b-491e-b562-977a9c36b3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:44.802366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6d806-0c7b-491e-b562-977a9c36b3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:44.802640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6d806-0c7b-491e-b562-977a9c36b3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:44.802907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6d806-0c7b-491e-b562-977a9c36b3b1 None admin] PATH_INFO: `/v3/projects/c762131d47d44c2ba89d3d4b3c2caa0c` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:44.804116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6d806-0c7b-491e-b562-977a9c36b3b1 None admin] RBAC: Authorizing `identity:get_project(project_id=c762131d47d44c2ba89d3d4b3c2caa0c)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:44.805664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6d806-0c7b-491e-b562-977a9c36b3b1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:44.807231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 570/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:07:44 2022] GET /identity/v3/projects/c762131d47d44c2ba89d3d4b3c2caa0c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:44.813673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9a801-9fe3-4035-8275-26865696c151 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:44.873946 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:44.917297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9a801-9fe3-4035-8275-26865696c151 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:44.951814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed882a1d-aee1-4447-ab37-357839525cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:44.952414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed882a1d-aee1-4447-ab37-357839525cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:44.952684 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed882a1d-aee1-4447-ab37-357839525cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:44.952947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed882a1d-aee1-4447-ab37-357839525cf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:44.953666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed882a1d-aee1-4447-ab37-357839525cf7 None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=c762131d47d44c2ba89d3d4b3c2caa0c, user.id=7e4cc3f61ad34277a3a615eb246e1478) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:44.953981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed882a1d-aee1-4447-ab37-357839525cf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:44.955407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed882a1d-aee1-4447-ab37-357839525cf7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:44.961689 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 591/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:07:44 2022] GET /identity/v3/role_assignments?user.id=7e4cc3f61ad34277a3a615eb246e1478&scope.project.id=c762131d47d44c2ba89d3d4b3c2caa0c&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:46.976787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849100d-49df-46b0-9b00-9ccdb03c5faa None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:46.977386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849100d-49df-46b0-9b00-9ccdb03c5faa None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:46.977386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849100d-49df-46b0-9b00-9ccdb03c5faa None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:46.978751 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 571/1162] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:46.984078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6918c5-9b51-4d99-88f4-692497aada66 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:46.984518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6918c5-9b51-4d99-88f4-692497aada66 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:46.984636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6918c5-9b51-4d99-88f4-692497aada66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:47.003881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ca6918c5-9b51-4d99-88f4-692497aada66 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:47.005055 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ca6918c5-9b51-4d99-88f4-692497aada66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:47.075134 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 592/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:47.097496 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849100d-49df-46b0-9b00-9ccdb03c5faa None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:47.171129 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:47.203441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849100d-49df-46b0-9b00-9ccdb03c5faa None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:47.237807 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d157c8a-1b08-42f2-af0a-98c6a1759fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:47.238326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d157c8a-1b08-42f2-af0a-98c6a1759fda None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:47.238594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d157c8a-1b08-42f2-af0a-98c6a1759fda None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:47.238854 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d157c8a-1b08-42f2-af0a-98c6a1759fda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:47.306116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d157c8a-1b08-42f2-af0a-98c6a1759fda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:47.307584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d157c8a-1b08-42f2-af0a-98c6a1759fda None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:47.374427 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:47.406870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 572/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:07:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:07:47.413286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6918c5-9b51-4d99-88f4-692497aada66 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:47.463643 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:47.516840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6918c5-9b51-4d99-88f4-692497aada66 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:47.550854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8912a3-48a7-43ff-8331-5924e87681c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:47.551473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8912a3-48a7-43ff-8331-5924e87681c8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:47.551740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8912a3-48a7-43ff-8331-5924e87681c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:47.551999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8912a3-48a7-43ff-8331-5924e87681c8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:47.558911 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8912a3-48a7-43ff-8331-5924e87681c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:47.560355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8912a3-48a7-43ff-8331-5924e87681c8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-1a8912a3-48a7-43ff-8331-5924e87681c8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:47.572186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:47.573372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:47.574621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:47.574621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:47.574621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:47.574621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:47.574621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:47.574621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:47.574621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:47.574621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:47.574621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:47.574621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:47.574621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 09 11:07:47.574621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:07:47.574621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 11:07:47.574621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:07:47.574621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 593/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Aug 9 11:07:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:47.579561 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d157c8a-1b08-42f2-af0a-98c6a1759fda None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:47.678861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d157c8a-1b08-42f2-af0a-98c6a1759fda None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:47.714408 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244201f-2a3d-4480-8166-54aa44fdd307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:47.715012 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244201f-2a3d-4480-8166-54aa44fdd307 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:47.715287 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244201f-2a3d-4480-8166-54aa44fdd307 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:47.715554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244201f-2a3d-4480-8166-54aa44fdd307 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:47.716194 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244201f-2a3d-4480-8166-54aa44fdd307 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:47.716497 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244201f-2a3d-4480-8166-54aa44fdd307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:47.717905 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244201f-2a3d-4480-8166-54aa44fdd307 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:47.728206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 573/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Aug 9 11:07:47 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:49.669478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955e875-609b-46b7-b190-a9375069c3a1 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:49.670097 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955e875-609b-46b7-b190-a9375069c3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:49.670097 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955e875-609b-46b7-b190-a9375069c3a1 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:49.671368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 594/1167] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:49.676907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2a7c8-4ef3-45fd-bdf0-5fdf790ebdb7 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:49.677325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2a7c8-4ef3-45fd-bdf0-5fdf790ebdb7 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:49.677446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2a7c8-4ef3-45fd-bdf0-5fdf790ebdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:49.697749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-b1c2a7c8-4ef3-45fd-bdf0-5fdf790ebdb7 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:49.698999 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b1c2a7c8-4ef3-45fd-bdf0-5fdf790ebdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:49.727862 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:49.769773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 574/1168] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:49.792644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955e875-609b-46b7-b190-a9375069c3a1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:49.896211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955e875-609b-46b7-b190-a9375069c3a1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:49.906520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:49.930247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9729d-ae6f-47a7-a22c-74c4df00c552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:49.930847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9729d-ae6f-47a7-a22c-74c4df00c552 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:49.931103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9729d-ae6f-47a7-a22c-74c4df00c552 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:49.931388 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9729d-ae6f-47a7-a22c-74c4df00c552 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:49.932075 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9729d-ae6f-47a7-a22c-74c4df00c552 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:49.933428 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9729d-ae6f-47a7-a22c-74c4df00c552 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:49.951123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 595/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Tue Aug 9 11:07:49 2022] POST /identity/v3/domains => generated 267 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:07:51.999413 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a6585-9a72-419c-98e0-dd01a40c7e4a None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:51.999980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a6585-9a72-419c-98e0-dd01a40c7e4a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:51.999980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a6585-9a72-419c-98e0-dd01a40c7e4a None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:52.001246 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 575/1170] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:52.007202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f5c9d-b586-48b5-b4a0-9e5fc0cc6c11 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:52.007676 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f5c9d-b586-48b5-b4a0-9e5fc0cc6c11 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:52.007767 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f5c9d-b586-48b5-b4a0-9e5fc0cc6c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:52.026587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-772f5c9d-b586-48b5-b4a0-9e5fc0cc6c11 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:52.027808 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-772f5c9d-b586-48b5-b4a0-9e5fc0cc6c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:52.098942 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 596/1171] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:52.122236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a6585-9a72-419c-98e0-dd01a40c7e4a None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:52.230427 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a6585-9a72-419c-98e0-dd01a40c7e4a None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:52.266773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173800b0-5283-4789-ac1b-ec61c40c8fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:52.267297 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173800b0-5283-4789-ac1b-ec61c40c8fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:52.267572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173800b0-5283-4789-ac1b-ec61c40c8fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:52.267834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173800b0-5283-4789-ac1b-ec61c40c8fc2 None admin] PATH_INFO: `/v3/domains/7f0b4f8899404b19887499c6a67babdc` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:52.279465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173800b0-5283-4789-ac1b-ec61c40c8fc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7f0b4f8899404b19887499c6a67babdc)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:52.280918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173800b0-5283-4789-ac1b-ec61c40c8fc2 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:52.282571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 576/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Tue Aug 9 11:07:52 2022] GET /identity/v3/domains/7f0b4f8899404b19887499c6a67babdc => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:52.288704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f5c9d-b586-48b5-b4a0-9e5fc0cc6c11 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:52.391249 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:52.394336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f5c9d-b586-48b5-b4a0-9e5fc0cc6c11 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:52.430736 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24c3e2-42e9-41a9-81e8-1c5b148ebc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:52.431329 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24c3e2-42e9-41a9-81e8-1c5b148ebc84 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:52.431631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24c3e2-42e9-41a9-81e8-1c5b148ebc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:52.431894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24c3e2-42e9-41a9-81e8-1c5b148ebc84 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:52.432528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24c3e2-42e9-41a9-81e8-1c5b148ebc84 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:52.433981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24c3e2-42e9-41a9-81e8-1c5b148ebc84 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:52.462999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 597/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Aug 9 11:07:52 2022] POST /identity/v3/projects => generated 361 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:07:54.494914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f60f7-fc2a-42c6-a9d6-82fa4f41e7b7 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:54.495666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f60f7-fc2a-42c6-a9d6-82fa4f41e7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:54.495666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f60f7-fc2a-42c6-a9d6-82fa4f41e7b7 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:54.497061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 577/1174] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:54.503971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5034eb9-73c0-4e32-9e6e-514e2e0e4e66 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:54.504481 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5034eb9-73c0-4e32-9e6e-514e2e0e4e66 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:54.504481 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5034eb9-73c0-4e32-9e6e-514e2e0e4e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:54.523437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e5034eb9-73c0-4e32-9e6e-514e2e0e4e66 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:54.524606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e5034eb9-73c0-4e32-9e6e-514e2e0e4e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:54.600028 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 598/1175] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:54.624489 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f60f7-fc2a-42c6-a9d6-82fa4f41e7b7 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:54.651651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:54.736192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f60f7-fc2a-42c6-a9d6-82fa4f41e7b7 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:54.774205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d648e5c1-931f-4679-84cf-9f8f7abbf748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:54.774838 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648e5c1-931f-4679-84cf-9f8f7abbf748 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:54.775104 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648e5c1-931f-4679-84cf-9f8f7abbf748 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:54.775367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648e5c1-931f-4679-84cf-9f8f7abbf748 None admin] PATH_INFO: `/v3/domains/7f0b4f8899404b19887499c6a67babdc` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:54.776603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648e5c1-931f-4679-84cf-9f8f7abbf748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7f0b4f8899404b19887499c6a67babdc)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:54.778086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d648e5c1-931f-4679-84cf-9f8f7abbf748 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:54.779673 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 578/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Tue Aug 9 11:07:54 2022] GET /identity/v3/domains/7f0b4f8899404b19887499c6a67babdc => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:54.786568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5034eb9-73c0-4e32-9e6e-514e2e0e4e66 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:54.880622 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:54.902296 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5034eb9-73c0-4e32-9e6e-514e2e0e4e66 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:54.939286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5857a-88ea-4262-b8fe-19afb3b5863a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:54.939905 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5857a-88ea-4262-b8fe-19afb3b5863a None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:54.940175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5857a-88ea-4262-b8fe-19afb3b5863a None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:54.940437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5857a-88ea-4262-b8fe-19afb3b5863a None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:54.941078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5857a-88ea-4262-b8fe-19afb3b5863a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:54.942526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5857a-88ea-4262-b8fe-19afb3b5863a None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:54.966929 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 599/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:07:54 2022] POST /identity/v3/users => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:07:56.989074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f00a3-2673-48f7-b032-78f99b74cae4 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:56.989700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f00a3-2673-48f7-b032-78f99b74cae4 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:56.989700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07f00a3-2673-48f7-b032-78f99b74cae4 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:56.991059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 579/1178] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:07:56.996458 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a096e2-3d81-4954-b52c-f3eed81b98c3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:56.996915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a096e2-3d81-4954-b52c-f3eed81b98c3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:56.997013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a096e2-3d81-4954-b52c-f3eed81b98c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:57.016560 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-53a096e2-3d81-4954-b52c-f3eed81b98c3 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:07:57.017810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-53a096e2-3d81-4954-b52c-f3eed81b98c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:07:57.088288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 600/1179] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:07:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:07:57.111268 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f00a3-2673-48f7-b032-78f99b74cae4 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:57.206557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:57.216839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07f00a3-2673-48f7-b032-78f99b74cae4 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:57.251270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacba94-a38c-4db2-933f-9a1245ba1a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:57.251825 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacba94-a38c-4db2-933f-9a1245ba1a53 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:57.252098 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacba94-a38c-4db2-933f-9a1245ba1a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:57.252706 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacba94-a38c-4db2-933f-9a1245ba1a53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:57.264442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacba94-a38c-4db2-933f-9a1245ba1a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-6dacba94-a38c-4db2-933f-9a1245ba1a53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:07:57.269062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:07:57.270289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:07:57.271223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:07:57.271223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:07:57.271223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:07:57.271223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:07:57.271223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:07:57.271223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:07:57.271223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:07:57.271223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:07:57.271223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:07:57.271223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:07:57.271223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:07:57.271223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:07:57.271223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 580/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:07:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:07:57.276514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a096e2-3d81-4954-b52c-f3eed81b98c3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:57.345211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:57.380540 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a096e2-3d81-4954-b52c-f3eed81b98c3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:57.414385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0ea48-ba90-4d61-af90-d8ac6e156c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:57.415009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0ea48-ba90-4d61-af90-d8ac6e156c2d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:57.415282 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0ea48-ba90-4d61-af90-d8ac6e156c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:57.415548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0ea48-ba90-4d61-af90-d8ac6e156c2d None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:57.416226 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0ea48-ba90-4d61-af90-d8ac6e156c2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:57.416531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0ea48-ba90-4d61-af90-d8ac6e156c2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:57.417952 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0ea48-ba90-4d61-af90-d8ac6e156c2d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:57.426478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 601/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:07:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:57.432731 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacba94-a38c-4db2-933f-9a1245ba1a53 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:57.539184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacba94-a38c-4db2-933f-9a1245ba1a53 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:57.575361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5799d-2b61-46af-9c61-40e32db9b0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:57.575985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5799d-2b61-46af-9c61-40e32db9b0aa None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:57.576254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5799d-2b61-46af-9c61-40e32db9b0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:57.576518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5799d-2b61-46af-9c61-40e32db9b0aa None admin] PATH_INFO: `/v3/users/d7e1383caa564edcb89c8c0fd2e5f30d` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:57.590877 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5799d-2b61-46af-9c61-40e32db9b0aa None admin] RBAC: Authorizing `identity:get_user(user_id=d7e1383caa564edcb89c8c0fd2e5f30d)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:57.592348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5799d-2b61-46af-9c61-40e32db9b0aa None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:57.594061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 581/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:07:57 2022] GET /identity/v3/users/d7e1383caa564edcb89c8c0fd2e5f30d => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:57.600345 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0ea48-ba90-4d61-af90-d8ac6e156c2d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:57.705721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0ea48-ba90-4d61-af90-d8ac6e156c2d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:57.734681 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:57.742219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5668fee-6977-4b94-84d6-999d7a4ff8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:57.742850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5668fee-6977-4b94-84d6-999d7a4ff8ac None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:57.743117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5668fee-6977-4b94-84d6-999d7a4ff8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:57.743379 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5668fee-6977-4b94-84d6-999d7a4ff8ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:57.813745 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5668fee-6977-4b94-84d6-999d7a4ff8ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:57.815187 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5668fee-6977-4b94-84d6-999d7a4ff8ac None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:57.917307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 602/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:07:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:07:57.923513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5799d-2b61-46af-9c61-40e32db9b0aa None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:57.936084 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:58.023019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5799d-2b61-46af-9c61-40e32db9b0aa None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:58.059028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b2fe5-719f-4f52-a65d-9bf8d8133d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:58.059643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b2fe5-719f-4f52-a65d-9bf8d8133d74 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:58.059910 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b2fe5-719f-4f52-a65d-9bf8d8133d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:58.060158 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b2fe5-719f-4f52-a65d-9bf8d8133d74 None admin] PATH_INFO: `/v3/projects/3f5409ac7e5940a5bb54ebd79c9e4169` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:58.061298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b2fe5-719f-4f52-a65d-9bf8d8133d74 None admin] RBAC: Authorizing `identity:get_project(project_id=3f5409ac7e5940a5bb54ebd79c9e4169)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:58.062774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b2fe5-719f-4f52-a65d-9bf8d8133d74 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:58.064500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 582/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:07:57 2022] GET /identity/v3/projects/3f5409ac7e5940a5bb54ebd79c9e4169 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:07:58.070954 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5668fee-6977-4b94-84d6-999d7a4ff8ac None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:07:58.100534 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:07:58.172443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5668fee-6977-4b94-84d6-999d7a4ff8ac None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:07:58.206887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278983ac-7056-417b-b213-a5f6faf14249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:07:58.207485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278983ac-7056-417b-b213-a5f6faf14249 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:07:58.207758 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278983ac-7056-417b-b213-a5f6faf14249 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:07:58.208023 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278983ac-7056-417b-b213-a5f6faf14249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:07:58.208741 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278983ac-7056-417b-b213-a5f6faf14249 None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=3f5409ac7e5940a5bb54ebd79c9e4169, user.id=d7e1383caa564edcb89c8c0fd2e5f30d) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:07:58.209033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278983ac-7056-417b-b213-a5f6faf14249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:07:58.210524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278983ac-7056-417b-b213-a5f6faf14249 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:07:58.215937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 603/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:07:58 2022] GET /identity/v3/role_assignments?user.id=d7e1383caa564edcb89c8c0fd2e5f30d&scope.project.id=3f5409ac7e5940a5bb54ebd79c9e4169&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:08:00.142522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453914b-8715-4047-a187-5ea21cae6672 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:00.143116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453914b-8715-4047-a187-5ea21cae6672 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:00.143116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453914b-8715-4047-a187-5ea21cae6672 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:00.144369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 583/1186] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:08:00.149783 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1529a88-a1fd-448b-8093-584829f19098 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:00.150221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1529a88-a1fd-448b-8093-584829f19098 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:00.150321 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1529a88-a1fd-448b-8093-584829f19098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:00.169528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e1529a88-a1fd-448b-8093-584829f19098 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:08:00.170746 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e1529a88-a1fd-448b-8093-584829f19098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:08:00.242953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 604/1187] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:08:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:08:00.265993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453914b-8715-4047-a187-5ea21cae6672 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:08:00.352227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:08:00.375646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453914b-8715-4047-a187-5ea21cae6672 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:08:00.410601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953f1aa-da5b-4bda-bea1-b44ea3053817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:08:00.411140 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953f1aa-da5b-4bda-bea1-b44ea3053817 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:00.411409 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953f1aa-da5b-4bda-bea1-b44ea3053817 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:00.411676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953f1aa-da5b-4bda-bea1-b44ea3053817 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:00.422187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2953f1aa-da5b-4bda-bea1-b44ea3053817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-2953f1aa-da5b-4bda-bea1-b44ea3053817 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:08:00.426859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:08:00.427987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:08:00.428850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:08:00.428850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:08:00.428850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:08:00.428850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:08:00.428850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:08:00.428850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:08:00.428850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:08:00.428850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:08:00.428850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:08:00.428850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:08:00.428850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:08:00.428850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:08:00.428850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 584/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:08:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:08:00.434724 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1529a88-a1fd-448b-8093-584829f19098 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:08:00.460239 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:08:00.538149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1529a88-a1fd-448b-8093-584829f19098 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:08:00.572175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624897a-9dd2-4b78-b4f3-40bbae0b5a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:08:00.572772 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624897a-9dd2-4b78-b4f3-40bbae0b5a3b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:00.573040 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624897a-9dd2-4b78-b4f3-40bbae0b5a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:00.573301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624897a-9dd2-4b78-b4f3-40bbae0b5a3b None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:00.573980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624897a-9dd2-4b78-b4f3-40bbae0b5a3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:08:00.574275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624897a-9dd2-4b78-b4f3-40bbae0b5a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:08:00.575634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624897a-9dd2-4b78-b4f3-40bbae0b5a3b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:08:00.583714 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 605/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:08:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:08:00.590093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953f1aa-da5b-4bda-bea1-b44ea3053817 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:08:00.692672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953f1aa-da5b-4bda-bea1-b44ea3053817 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:08:00.728722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780a9c3-f821-4036-bb59-062cd18a4bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:08:00.729351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780a9c3-f821-4036-bb59-062cd18a4bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:00.729650 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780a9c3-f821-4036-bb59-062cd18a4bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:00.729909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780a9c3-f821-4036-bb59-062cd18a4bf9 None admin] PATH_INFO: `/v3/users/d7e1383caa564edcb89c8c0fd2e5f30d` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:00.731093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780a9c3-f821-4036-bb59-062cd18a4bf9 None admin] RBAC: Authorizing `identity:get_user(user_id=d7e1383caa564edcb89c8c0fd2e5f30d)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:08:00.732542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780a9c3-f821-4036-bb59-062cd18a4bf9 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:08:00.734173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 585/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:08:00 2022] GET /identity/v3/users/d7e1383caa564edcb89c8c0fd2e5f30d => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:08:00.740480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624897a-9dd2-4b78-b4f3-40bbae0b5a3b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:08:00.829638 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:08:00.845138 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624897a-9dd2-4b78-b4f3-40bbae0b5a3b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:08:00.879592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654ec6e-647a-4349-bb0a-8b43b231bd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:08:00.880219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654ec6e-647a-4349-bb0a-8b43b231bd9d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:00.880500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654ec6e-647a-4349-bb0a-8b43b231bd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:00.880768 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654ec6e-647a-4349-bb0a-8b43b231bd9d None admin] PATH_INFO: `/v3/projects/3f5409ac7e5940a5bb54ebd79c9e4169` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:00.881987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654ec6e-647a-4349-bb0a-8b43b231bd9d None admin] RBAC: Authorizing `identity:get_project(project_id=3f5409ac7e5940a5bb54ebd79c9e4169)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:08:00.883428 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654ec6e-647a-4349-bb0a-8b43b231bd9d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:08:00.885089 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 606/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:08:00 2022] GET /identity/v3/projects/3f5409ac7e5940a5bb54ebd79c9e4169 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:08:00.891411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780a9c3-f821-4036-bb59-062cd18a4bf9 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:08:00.900588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:08:00.991139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780a9c3-f821-4036-bb59-062cd18a4bf9 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:08:01.025925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbb1db-8a16-445d-a13b-2944db9702aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:08:01.026571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbb1db-8a16-445d-a13b-2944db9702aa None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:01.026838 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbb1db-8a16-445d-a13b-2944db9702aa None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:01.027099 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbb1db-8a16-445d-a13b-2944db9702aa None admin] PATH_INFO: `/v3/projects/3f5409ac7e5940a5bb54ebd79c9e4169/users/d7e1383caa564edcb89c8c0fd2e5f30d/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:01.029007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbb1db-8a16-445d-a13b-2944db9702aa None admin] RBAC: Authorizing `identity:create_grant(project_id=3f5409ac7e5940a5bb54ebd79c9e4169, user_id=d7e1383caa564edcb89c8c0fd2e5f30d, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:08:01.030479 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbb1db-8a16-445d-a13b-2944db9702aa None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:08:01.044862 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 586/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:08:00 2022] PUT /identity/v3/projects/3f5409ac7e5940a5bb54ebd79c9e4169/users/d7e1383caa564edcb89c8c0fd2e5f30d/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:08:03.034280 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a1588-4aed-4d01-91a9-dae9b78aa78d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:03.034869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a1588-4aed-4d01-91a9-dae9b78aa78d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:03.034869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a1588-4aed-4d01-91a9-dae9b78aa78d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:03.036175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 607/1193] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:08:03.041379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f8d63-6ea5-4126-9682-b3d6c0b18004 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:03.041836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f8d63-6ea5-4126-9682-b3d6c0b18004 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:03.041942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f8d63-6ea5-4126-9682-b3d6c0b18004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:03.060449 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-614f8d63-6ea5-4126-9682-b3d6c0b18004 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:08:03.061722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-614f8d63-6ea5-4126-9682-b3d6c0b18004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:08:03.126040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:08:03.135692 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 587/1194] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:08:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:08:03.157902 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a1588-4aed-4d01-91a9-dae9b78aa78d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:08:03.263140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a1588-4aed-4d01-91a9-dae9b78aa78d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:08:03.295717 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71ed77-c78d-4f19-a076-52d570c3374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:08:03.296336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71ed77-c78d-4f19-a076-52d570c3374d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:03.296609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71ed77-c78d-4f19-a076-52d570c3374d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:03.296875 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71ed77-c78d-4f19-a076-52d570c3374d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:03.308192 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71ed77-c78d-4f19-a076-52d570c3374d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-ab71ed77-c78d-4f19-a076-52d570c3374d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:08:03.312776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:08:03.313874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:08:03.314950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:08:03.314950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:08:03.314950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:08:03.314950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:08:03.314950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:08:03.314950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:08:03.314950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:08:03.314950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:08:03.314950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:08:03.314950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:08:03.314950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:08:03.314950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:08:03.314950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 608/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:08:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:08:03.320345 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f8d63-6ea5-4126-9682-b3d6c0b18004 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:08:03.419907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f8d63-6ea5-4126-9682-b3d6c0b18004 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:08:03.454094 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fc375-9402-4bdb-884d-ef962ec9bdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:08:03.454679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fc375-9402-4bdb-884d-ef962ec9bdd0 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:03.454946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fc375-9402-4bdb-884d-ef962ec9bdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:03.455206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fc375-9402-4bdb-884d-ef962ec9bdd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:03.455857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fc375-9402-4bdb-884d-ef962ec9bdd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:08:03.456147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fc375-9402-4bdb-884d-ef962ec9bdd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:08:03.457534 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fc375-9402-4bdb-884d-ef962ec9bdd0 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:08:03.465608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 588/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:08:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:08:03.471844 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71ed77-c78d-4f19-a076-52d570c3374d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:08:03.488832 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:08:03.574536 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71ed77-c78d-4f19-a076-52d570c3374d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:08:03.608625 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619395d-e5ec-4dcb-a1c0-ec039fdfc34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:08:03.609246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619395d-e5ec-4dcb-a1c0-ec039fdfc34c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:03.609518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619395d-e5ec-4dcb-a1c0-ec039fdfc34c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:03.609814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619395d-e5ec-4dcb-a1c0-ec039fdfc34c None admin] PATH_INFO: `/v3/users/d7e1383caa564edcb89c8c0fd2e5f30d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:03.610969 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619395d-e5ec-4dcb-a1c0-ec039fdfc34c None admin] RBAC: Authorizing `identity:get_user(user_id=d7e1383caa564edcb89c8c0fd2e5f30d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:08:03.612403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619395d-e5ec-4dcb-a1c0-ec039fdfc34c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:08:03.614024 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 609/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Aug 9 11:08:03 2022] GET /identity/v3/users/d7e1383caa564edcb89c8c0fd2e5f30d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:08:03.620257 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fc375-9402-4bdb-884d-ef962ec9bdd0 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:08:03.679432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:08:03.724481 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fc375-9402-4bdb-884d-ef962ec9bdd0 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:08:03.760076 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f72e9-69c6-4c58-8904-e537cff858af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:08:03.760707 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f72e9-69c6-4c58-8904-e537cff858af None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:03.760983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f72e9-69c6-4c58-8904-e537cff858af None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:03.761247 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f72e9-69c6-4c58-8904-e537cff858af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:03.831141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f72e9-69c6-4c58-8904-e537cff858af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:08:03.832529 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f72e9-69c6-4c58-8904-e537cff858af None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:08:03.888880 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:08:03.933924 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 589/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:08:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:08:03.940236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619395d-e5ec-4dcb-a1c0-ec039fdfc34c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:08:04.026281 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:08:04.045604 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619395d-e5ec-4dcb-a1c0-ec039fdfc34c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:08:04.077648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7b908-1d75-47e8-a8dc-996d6f8b696b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:08:04.078341 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7b908-1d75-47e8-a8dc-996d6f8b696b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:04.078613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7b908-1d75-47e8-a8dc-996d6f8b696b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:04.078872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7b908-1d75-47e8-a8dc-996d6f8b696b None admin] PATH_INFO: `/v3/projects/3f5409ac7e5940a5bb54ebd79c9e4169` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:04.080000 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7b908-1d75-47e8-a8dc-996d6f8b696b None admin] RBAC: Authorizing `identity:get_project(project_id=3f5409ac7e5940a5bb54ebd79c9e4169)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:08:04.081525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7b908-1d75-47e8-a8dc-996d6f8b696b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:08:04.083184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 610/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Aug 9 11:08:03 2022] GET /identity/v3/projects/3f5409ac7e5940a5bb54ebd79c9e4169 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:08:04.090126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f72e9-69c6-4c58-8904-e537cff858af None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:08:04.192582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f72e9-69c6-4c58-8904-e537cff858af None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:08:04.226914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d1de1-67bf-4543-94c0-1661828f8546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:08:04.227503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d1de1-67bf-4543-94c0-1661828f8546 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:04.227764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d1de1-67bf-4543-94c0-1661828f8546 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:04.228024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d1de1-67bf-4543-94c0-1661828f8546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:04.228734 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d1de1-67bf-4543-94c0-1661828f8546 None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=3f5409ac7e5940a5bb54ebd79c9e4169, user.id=d7e1383caa564edcb89c8c0fd2e5f30d) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:08:04.229032 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d1de1-67bf-4543-94c0-1661828f8546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:08:04.230489 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d1de1-67bf-4543-94c0-1661828f8546 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:08:04.236345 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 590/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:08:04 2022] GET /identity/v3/role_assignments?user.id=d7e1383caa564edcb89c8c0fd2e5f30d&scope.project.id=3f5409ac7e5940a5bb54ebd79c9e4169&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:08:14.073470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=25 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:08:14.233638 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:08:59.648068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73247c-7ed0-4164-8bed-6e3435e939da None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:59.648669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73247c-7ed0-4164-8bed-6e3435e939da None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:59.648669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73247c-7ed0-4164-8bed-6e3435e939da None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:59.650120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 611/1201] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:08:59.655751 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8ee62-faa9-4ace-b816-c9f815dca24e None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:59.656316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8ee62-faa9-4ace-b816-c9f815dca24e None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:59.656316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8ee62-faa9-4ace-b816-c9f815dca24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:59.678923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-91f8ee62-faa9-4ace-b816-c9f815dca24e None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:08:59.680217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-91f8ee62-faa9-4ace-b816-c9f815dca24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:08:59.762900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 591/1202] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:08:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:08:59.788439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73247c-7ed0-4164-8bed-6e3435e939da None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:08:59.923360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73247c-7ed0-4164-8bed-6e3435e939da None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:08:59.967824 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef83962-8ddc-4136-a778-ef9b49621570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:08:59.968506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef83962-8ddc-4136-a778-ef9b49621570 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:08:59.968810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef83962-8ddc-4136-a778-ef9b49621570 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:08:59.969078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef83962-8ddc-4136-a778-ef9b49621570 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:08:59.984122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef83962-8ddc-4136-a778-ef9b49621570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:08:59.985879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef83962-8ddc-4136-a778-ef9b49621570 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-5ef83962-8ddc-4136-a778-ef9b49621570 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:09:00.003596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:00.004775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:09:00.006071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:09:00.006071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:00.006071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:00.006071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 612/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:00.011675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8ee62-faa9-4ace-b816-c9f815dca24e None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:00.143105 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8ee62-faa9-4ace-b816-c9f815dca24e None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:00.180141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:00.188189 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acc777-316e-4588-9c86-10b314c87e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:00.188849 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acc777-316e-4588-9c86-10b314c87e22 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:00.189128 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acc777-316e-4588-9c86-10b314c87e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:00.189480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acc777-316e-4588-9c86-10b314c87e22 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:00.190394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acc777-316e-4588-9c86-10b314c87e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:00.190713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acc777-316e-4588-9c86-10b314c87e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:00.192241 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acc777-316e-4588-9c86-10b314c87e22 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:00.208853 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 592/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:00.214830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef83962-8ddc-4136-a778-ef9b49621570 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:00.283773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:00.331092 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef83962-8ddc-4136-a778-ef9b49621570 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:00.369480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc9a8a-c339-442a-b49c-4ebe96ba2e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:00.370176 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc9a8a-c339-442a-b49c-4ebe96ba2e02 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:00.370498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc9a8a-c339-442a-b49c-4ebe96ba2e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:00.370787 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc9a8a-c339-442a-b49c-4ebe96ba2e02 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:00.371522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc9a8a-c339-442a-b49c-4ebe96ba2e02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:00.373070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc9a8a-c339-442a-b49c-4ebe96ba2e02 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:00.401734 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 613/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Aug 9 11:09:00 2022] POST /identity/v3/users => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:09:02.812078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995580c9-2d51-4e54-9855-4efd59a61af3 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:02.812720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995580c9-2d51-4e54-9855-4efd59a61af3 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:02.812720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995580c9-2d51-4e54-9855-4efd59a61af3 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:02.814098 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 593/1206] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:09:02.820498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91413d-793c-4a8a-afbb-5769b51d9c9b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:02.820992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91413d-793c-4a8a-afbb-5769b51d9c9b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:02.821145 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91413d-793c-4a8a-afbb-5769b51d9c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:02.841106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9c91413d-793c-4a8a-afbb-5769b51d9c9b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:09:02.842323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9c91413d-793c-4a8a-afbb-5769b51d9c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:09:02.925326 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 614/1207] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:09:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:09:02.955033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995580c9-2d51-4e54-9855-4efd59a61af3 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:03.069486 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995580c9-2d51-4e54-9855-4efd59a61af3 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:03.106994 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f25368-80b1-4dde-a218-eb38067063ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:03.107623 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f25368-80b1-4dde-a218-eb38067063ab None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:03.107908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f25368-80b1-4dde-a218-eb38067063ab None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:03.108157 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f25368-80b1-4dde-a218-eb38067063ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:03.120951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f25368-80b1-4dde-a218-eb38067063ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-35f25368-80b1-4dde-a218-eb38067063ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:09:03.126008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:03.127398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:03.130890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:03.130890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:03.130890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:03.130890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:03.130890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:09:03.130890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:09:03.130890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:09:03.130890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:09:03.130890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:09:03.130890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:09:03.130890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:09:03.130890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:03.130890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 594/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:09:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:03.133894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91413d-793c-4a8a-afbb-5769b51d9c9b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:03.180070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:03.262593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91413d-793c-4a8a-afbb-5769b51d9c9b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:03.302488 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33b61c-8a1f-4ea8-858f-861eb0e41ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:03.303100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33b61c-8a1f-4ea8-858f-861eb0e41ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:03.303368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33b61c-8a1f-4ea8-858f-861eb0e41ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:03.303629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33b61c-8a1f-4ea8-858f-861eb0e41ee0 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:03.304287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33b61c-8a1f-4ea8-858f-861eb0e41ee0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:03.304573 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33b61c-8a1f-4ea8-858f-861eb0e41ee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:03.305966 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d33b61c-8a1f-4ea8-858f-861eb0e41ee0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:03.315081 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 615/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:09:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:03.320741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f25368-80b1-4dde-a218-eb38067063ab None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:03.373470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:03.428992 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f25368-80b1-4dde-a218-eb38067063ab None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:03.468864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea735d-2645-4cb7-8fbe-c31449484e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:03.469560 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea735d-2645-4cb7-8fbe-c31449484e41 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:03.469804 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea735d-2645-4cb7-8fbe-c31449484e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:03.470066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea735d-2645-4cb7-8fbe-c31449484e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:03.483155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea735d-2645-4cb7-8fbe-c31449484e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:03.487810 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea735d-2645-4cb7-8fbe-c31449484e41 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-a1ea735d-2645-4cb7-8fbe-c31449484e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:09:03.503646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:03.506022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:09:03.507930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:09:03.507930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:03.507930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:03.507930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 595/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:03.510953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33b61c-8a1f-4ea8-858f-861eb0e41ee0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:03.615928 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:03.618518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33b61c-8a1f-4ea8-858f-861eb0e41ee0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:03.667648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81019ddb-3a65-4e5b-a7c2-97e4273f8b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:03.668253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81019ddb-3a65-4e5b-a7c2-97e4273f8b90 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:03.668526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81019ddb-3a65-4e5b-a7c2-97e4273f8b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:03.668796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81019ddb-3a65-4e5b-a7c2-97e4273f8b90 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:03.669517 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81019ddb-3a65-4e5b-a7c2-97e4273f8b90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:03.669856 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81019ddb-3a65-4e5b-a7c2-97e4273f8b90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:03.671169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81019ddb-3a65-4e5b-a7c2-97e4273f8b90 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:03.688732 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 616/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:09:03.695203 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea735d-2645-4cb7-8fbe-c31449484e41 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:03.813792 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea735d-2645-4cb7-8fbe-c31449484e41 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:03.815514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:03.857655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e271b8-17f6-40e3-a11f-0e6d30c8f955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:03.857655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e271b8-17f6-40e3-a11f-0e6d30c8f955 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:03.857655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e271b8-17f6-40e3-a11f-0e6d30c8f955 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:03.857655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e271b8-17f6-40e3-a11f-0e6d30c8f955 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:03.860903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e271b8-17f6-40e3-a11f-0e6d30c8f955 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:03.860903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e271b8-17f6-40e3-a11f-0e6d30c8f955 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-10e271b8-17f6-40e3-a11f-0e6d30c8f955 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:09:03.872329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:03.873553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:03.874575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:03.874575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:03.874575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:09:03.874575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:09:03.874575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:09:03.874575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:09:03.874575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:09:03.874575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:09:03.874575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:09:03.874575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:03.874575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 596/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:03.880045 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81019ddb-3a65-4e5b-a7c2-97e4273f8b90 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:04.008195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81019ddb-3a65-4e5b-a7c2-97e4273f8b90 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:04.058067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924c731-ccbf-4de1-84a0-8192ff5a2b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:04.058762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924c731-ccbf-4de1-84a0-8192ff5a2b1e None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:04.059028 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924c731-ccbf-4de1-84a0-8192ff5a2b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:04.059348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924c731-ccbf-4de1-84a0-8192ff5a2b1e None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:04.060163 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924c731-ccbf-4de1-84a0-8192ff5a2b1e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:04.060467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924c731-ccbf-4de1-84a0-8192ff5a2b1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:04.061916 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924c731-ccbf-4de1-84a0-8192ff5a2b1e None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:04.081722 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 617/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Aug 9 11:09:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:09:04.087902 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e271b8-17f6-40e3-a11f-0e6d30c8f955 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:04.207329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e271b8-17f6-40e3-a11f-0e6d30c8f955 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:04.247866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623ecb4-41c3-4ba2-854f-260095315757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:04.248673 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623ecb4-41c3-4ba2-854f-260095315757 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:04.249029 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623ecb4-41c3-4ba2-854f-260095315757 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:04.249395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623ecb4-41c3-4ba2-854f-260095315757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:04.283540 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:04.327678 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623ecb4-41c3-4ba2-854f-260095315757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:04.329158 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623ecb4-41c3-4ba2-854f-260095315757 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:04.437166 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 597/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:09:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:09:04.443428 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924c731-ccbf-4de1-84a0-8192ff5a2b1e None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:04.464566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:04.561199 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924c731-ccbf-4de1-84a0-8192ff5a2b1e None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:04.602288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723817a7-5d53-4401-91eb-9c27fa66cd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:04.602968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723817a7-5d53-4401-91eb-9c27fa66cd32 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:04.603241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723817a7-5d53-4401-91eb-9c27fa66cd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:04.603507 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723817a7-5d53-4401-91eb-9c27fa66cd32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:04.615646 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723817a7-5d53-4401-91eb-9c27fa66cd32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:04.617211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723817a7-5d53-4401-91eb-9c27fa66cd32 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-723817a7-5d53-4401-91eb-9c27fa66cd32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:09:04.634834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:04.636276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:09:04.637214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:09:04.637214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:04.637214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:04.637214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 618/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:04.642105 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623ecb4-41c3-4ba2-854f-260095315757 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:04.712503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:04.762781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623ecb4-41c3-4ba2-854f-260095315757 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:04.803015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c041326-00cf-4de7-96b9-5bc2ccd841bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:04.803796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c041326-00cf-4de7-96b9-5bc2ccd841bd None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:04.804146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c041326-00cf-4de7-96b9-5bc2ccd841bd None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:04.804415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c041326-00cf-4de7-96b9-5bc2ccd841bd None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:04.805061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c041326-00cf-4de7-96b9-5bc2ccd841bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:04.805351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c041326-00cf-4de7-96b9-5bc2ccd841bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:04.806805 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c041326-00cf-4de7-96b9-5bc2ccd841bd None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:04.820125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 598/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:04.824823 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723817a7-5d53-4401-91eb-9c27fa66cd32 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:04.900545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:04.938623 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723817a7-5d53-4401-91eb-9c27fa66cd32 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:04.976143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59682125-8ba5-4680-984c-f6857ff8e419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:04.976831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59682125-8ba5-4680-984c-f6857ff8e419 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:04.977108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59682125-8ba5-4680-984c-f6857ff8e419 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:04.977375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59682125-8ba5-4680-984c-f6857ff8e419 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:04.984669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59682125-8ba5-4680-984c-f6857ff8e419 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:04.986427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59682125-8ba5-4680-984c-f6857ff8e419 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:04.998616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-59682125-8ba5-4680-984c-f6857ff8e419 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:09:04.998616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:04.998616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:04.998616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:04.998616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:04.998616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:04.998616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:04.998616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:04.998616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:04.998616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:04.998616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:04.998616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:04.998616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:09:04.998616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:09:04.998616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:05.000143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:05.001672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:09:05.001672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:09:05.001672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:09:05.001672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:09:05.001672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:09:05.001672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:09:05.001672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:09:05.001672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:05.001672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 619/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:09:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:05.007138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c041326-00cf-4de7-96b9-5bc2ccd841bd None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:05.131766 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c041326-00cf-4de7-96b9-5bc2ccd841bd None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:05.157274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:05.170732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584601f0-9a8e-4f96-8560-64161314c723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:05.171617 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584601f0-9a8e-4f96-8560-64161314c723 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:05.172053 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584601f0-9a8e-4f96-8560-64161314c723 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:05.172483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584601f0-9a8e-4f96-8560-64161314c723 None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:05.173187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584601f0-9a8e-4f96-8560-64161314c723 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:05.173493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584601f0-9a8e-4f96-8560-64161314c723 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:05.175272 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584601f0-9a8e-4f96-8560-64161314c723 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:05.194126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 599/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:09:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:09:05.202648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59682125-8ba5-4680-984c-f6857ff8e419 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:05.327333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59682125-8ba5-4680-984c-f6857ff8e419 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:05.359883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:05.367968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec94db6-fdd4-45f8-a7ee-59897847ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:05.368736 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec94db6-fdd4-45f8-a7ee-59897847ecd7 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:05.369115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec94db6-fdd4-45f8-a7ee-59897847ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:05.369506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec94db6-fdd4-45f8-a7ee-59897847ecd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:05.370550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec94db6-fdd4-45f8-a7ee-59897847ecd7 None admin] RBAC: Adding query filter params (role.id=bcdb152b51e34826a39fc0f8c3d60664, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=a587c410fd8741f3b3858d21b9e4884d) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:05.371059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec94db6-fdd4-45f8-a7ee-59897847ecd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:05.372992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec94db6-fdd4-45f8-a7ee-59897847ecd7 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:05.379928 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 620/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:09:05 2022] GET /identity/v3/role_assignments?user.id=a587c410fd8741f3b3858d21b9e4884d&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=bcdb152b51e34826a39fc0f8c3d60664 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:07.487072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab91479-81ed-4859-8056-b95c7e683a73 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:07.487616 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab91479-81ed-4859-8056-b95c7e683a73 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:07.487616 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab91479-81ed-4859-8056-b95c7e683a73 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:07.488949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 600/1220] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:09:07.494773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266358ae-9726-4c5e-a142-30c191d31aaf None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:07.495300 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266358ae-9726-4c5e-a142-30c191d31aaf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:07.495300 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266358ae-9726-4c5e-a142-30c191d31aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:07.514917 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-266358ae-9726-4c5e-a142-30c191d31aaf None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:09:07.516149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-266358ae-9726-4c5e-a142-30c191d31aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:09:07.584692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 621/1221] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:09:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:09:07.608374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab91479-81ed-4859-8056-b95c7e683a73 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:07.720354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab91479-81ed-4859-8056-b95c7e683a73 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:07.763967 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d02f07-4e3c-4311-b287-aa6fbb86e8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:07.764557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d02f07-4e3c-4311-b287-aa6fbb86e8be None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:07.764855 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d02f07-4e3c-4311-b287-aa6fbb86e8be None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:07.765117 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d02f07-4e3c-4311-b287-aa6fbb86e8be None admin] PATH_INFO: `/v3/roles/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:07.777001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d02f07-4e3c-4311-b287-aa6fbb86e8be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-c6d02f07-4e3c-4311-b287-aa6fbb86e8be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:09:07.781748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:07.782949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:07.783900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:07.783900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:07.783900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:07.783900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:07.783900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:09:07.783900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:09:07.783900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:09:07.783900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:09:07.783900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:09:07.783900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:09:07.783900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:09:07.783900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:07.783900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 601/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:09:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:07.789260 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266358ae-9726-4c5e-a142-30c191d31aaf None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:07.900093 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266358ae-9726-4c5e-a142-30c191d31aaf None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:07.925353 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:07.937968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854d852-e040-43aa-be34-2e2cc7742acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:07.938670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854d852-e040-43aa-be34-2e2cc7742acb None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:07.939011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854d852-e040-43aa-be34-2e2cc7742acb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:07.939304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854d852-e040-43aa-be34-2e2cc7742acb None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:07.940038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854d852-e040-43aa-be34-2e2cc7742acb None admin] RBAC: Adding query filter params (name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:07.940360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854d852-e040-43aa-be34-2e2cc7742acb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:07.941870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854d852-e040-43aa-be34-2e2cc7742acb None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:07.951232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 622/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:09:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:07.957823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d02f07-4e3c-4311-b287-aa6fbb86e8be None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:08.007272 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:08.065398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d02f07-4e3c-4311-b287-aa6fbb86e8be None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:08.104135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe2aa3-0aab-4e53-9ce3-ef8158a8c540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:08.104929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe2aa3-0aab-4e53-9ce3-ef8158a8c540 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:08.105437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe2aa3-0aab-4e53-9ce3-ef8158a8c540 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:08.105878 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe2aa3-0aab-4e53-9ce3-ef8158a8c540 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:08.118818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe2aa3-0aab-4e53-9ce3-ef8158a8c540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:08.120578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe2aa3-0aab-4e53-9ce3-ef8158a8c540 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-8dbe2aa3-0aab-4e53-9ce3-ef8158a8c540 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:09:08.146363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:08.147651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:09:08.148867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:09:08.148867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:08.148867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:08.148867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 602/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:08.154709 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854d852-e040-43aa-be34-2e2cc7742acb None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:08.280053 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854d852-e040-43aa-be34-2e2cc7742acb None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:08.318671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7ab35-9f46-4617-bc60-7257189af050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:08.319191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7ab35-9f46-4617-bc60-7257189af050 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:08.319465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7ab35-9f46-4617-bc60-7257189af050 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:08.319728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7ab35-9f46-4617-bc60-7257189af050 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:08.320354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7ab35-9f46-4617-bc60-7257189af050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:08.320648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7ab35-9f46-4617-bc60-7257189af050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:08.322035 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7ab35-9f46-4617-bc60-7257189af050 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:08.334086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 623/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:08.339929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe2aa3-0aab-4e53-9ce3-ef8158a8c540 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:08.433399 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:08.440730 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe2aa3-0aab-4e53-9ce3-ef8158a8c540 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:08.482017 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df37be-c48a-48ed-a487-20dc9aff500d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:08.482398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df37be-c48a-48ed-a487-20dc9aff500d None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:08.482664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df37be-c48a-48ed-a487-20dc9aff500d None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:08.482922 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df37be-c48a-48ed-a487-20dc9aff500d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:08.491776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df37be-c48a-48ed-a487-20dc9aff500d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:08.493480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df37be-c48a-48ed-a487-20dc9aff500d None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-36df37be-c48a-48ed-a487-20dc9aff500d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:09:08.505713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:08.511615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:08.512646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:08.512646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:08.512646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:09:08.512646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:09:08.512646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:09:08.512646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:09:08.512646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:09:08.512646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:09:08.512646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:09:08.512646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:08.512646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 603/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:08.513248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7ab35-9f46-4617-bc60-7257189af050 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:08.563312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:08.618329 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7ab35-9f46-4617-bc60-7257189af050 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:08.653366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292f31b-1797-4e25-a2a9-72311a6cb810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:08.653995 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292f31b-1797-4e25-a2a9-72311a6cb810 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:08.654275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292f31b-1797-4e25-a2a9-72311a6cb810 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:08.654526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292f31b-1797-4e25-a2a9-72311a6cb810 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:08.655230 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292f31b-1797-4e25-a2a9-72311a6cb810 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:08.655522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292f31b-1797-4e25-a2a9-72311a6cb810 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:08.656940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292f31b-1797-4e25-a2a9-72311a6cb810 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:08.679369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 624/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Aug 9 11:09:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:08.681004 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df37be-c48a-48ed-a487-20dc9aff500d None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:08.782259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df37be-c48a-48ed-a487-20dc9aff500d None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:08.815620 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fcb22-7350-4ce3-9720-4487df3114f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:08.816236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fcb22-7350-4ce3-9720-4487df3114f9 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:08.816505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fcb22-7350-4ce3-9720-4487df3114f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:08.816778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fcb22-7350-4ce3-9720-4487df3114f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:08.827787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fcb22-7350-4ce3-9720-4487df3114f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:08.829269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fcb22-7350-4ce3-9720-4487df3114f9 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-3e8fcb22-7350-4ce3-9720-4487df3114f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:09:08.844525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:08.845806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:09:08.847094 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:09:08.847094 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:08.847094 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:08.847094 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 604/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:08.851956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292f31b-1797-4e25-a2a9-72311a6cb810 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:08.961027 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292f31b-1797-4e25-a2a9-72311a6cb810 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:08.963428 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:09.001758 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64714f0-8031-43c7-86e1-a9ce00670d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:09.002368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64714f0-8031-43c7-86e1-a9ce00670d31 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:09.002640 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64714f0-8031-43c7-86e1-a9ce00670d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:09.002904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64714f0-8031-43c7-86e1-a9ce00670d31 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:09.003537 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64714f0-8031-43c7-86e1-a9ce00670d31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:09.003833 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64714f0-8031-43c7-86e1-a9ce00670d31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:09.005250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64714f0-8031-43c7-86e1-a9ce00670d31 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:09.021303 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 625/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:09.022513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fcb22-7350-4ce3-9720-4487df3114f9 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:09.032407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:09.133240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fcb22-7350-4ce3-9720-4487df3114f9 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:09.168715 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190074f-870a-410c-bfdb-60df2d59589c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:09.169391 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190074f-870a-410c-bfdb-60df2d59589c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:09.169690 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190074f-870a-410c-bfdb-60df2d59589c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:09.169955 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190074f-870a-410c-bfdb-60df2d59589c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:09.176518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190074f-870a-410c-bfdb-60df2d59589c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:09.178049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190074f-870a-410c-bfdb-60df2d59589c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:09.188870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-d190074f-870a-410c-bfdb-60df2d59589c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:09:09.188870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:09.188870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:09.188870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:09.188870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:09.188870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:09.188870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:09.188870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:09.188870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:09.188870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:09.188870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:09.188870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:09.188870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:09:09.188870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:09:09.188870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:09.189944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:09.191036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:09:09.191036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:09:09.191036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:09:09.191036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:09:09.191036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:09:09.191036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:09:09.191036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:09:09.191036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:09.191036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 605/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:09:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:09:09.198263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64714f0-8031-43c7-86e1-a9ce00670d31 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:09.309754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64714f0-8031-43c7-86e1-a9ce00670d31 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:09.348331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d3ae7-7a3e-436f-9fba-4ba6f5f0d515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:09.349016 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d3ae7-7a3e-436f-9fba-4ba6f5f0d515 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:09.349285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d3ae7-7a3e-436f-9fba-4ba6f5f0d515 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:09.349568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d3ae7-7a3e-436f-9fba-4ba6f5f0d515 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:09.350400 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d3ae7-7a3e-436f-9fba-4ba6f5f0d515 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:09.350736 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d3ae7-7a3e-436f-9fba-4ba6f5f0d515 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:09.352138 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d3ae7-7a3e-436f-9fba-4ba6f5f0d515 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:09.364786 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 626/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:09:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:09.371003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190074f-870a-410c-bfdb-60df2d59589c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:09.439945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:09.483820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190074f-870a-410c-bfdb-60df2d59589c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:09.519040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df01fe-d1f3-4545-8e6f-98f38d0942a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:09.519732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df01fe-d1f3-4545-8e6f-98f38d0942a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:09.519949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df01fe-d1f3-4545-8e6f-98f38d0942a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:09.520511 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df01fe-d1f3-4545-8e6f-98f38d0942a3 None admin] PATH_INFO: `/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/a587c410fd8741f3b3858d21b9e4884d/roles/bcdb152b51e34826a39fc0f8c3d60664` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:09.537819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df01fe-d1f3-4545-8e6f-98f38d0942a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=166e5328bfae434ba19d12be2eaa7a1b, user_id=a587c410fd8741f3b3858d21b9e4884d, role_id=bcdb152b51e34826a39fc0f8c3d60664)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:09.539405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df01fe-d1f3-4545-8e6f-98f38d0942a3 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:09.553684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 606/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:09:09 2022] PUT /identity/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/a587c410fd8741f3b3858d21b9e4884d/roles/bcdb152b51e34826a39fc0f8c3d60664 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:09:11.746013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c06ae-b98b-4283-9a31-4a64dfaa5f7e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:11.746735 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c06ae-b98b-4283-9a31-4a64dfaa5f7e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:11.746735 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c06ae-b98b-4283-9a31-4a64dfaa5f7e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:11.747891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 627/1233] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:09:11.754084 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b09344-f9dd-4ae0-8437-ed33a04b5060 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:11.754554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b09344-f9dd-4ae0-8437-ed33a04b5060 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:11.754764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b09344-f9dd-4ae0-8437-ed33a04b5060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:11.775545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-59b09344-f9dd-4ae0-8437-ed33a04b5060 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:09:11.776756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-59b09344-f9dd-4ae0-8437-ed33a04b5060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:09:11.847314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 607/1234] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:09:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:09:11.873186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c06ae-b98b-4283-9a31-4a64dfaa5f7e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:11.902995 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:11.983436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c06ae-b98b-4283-9a31-4a64dfaa5f7e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:12.025542 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dc224-0eff-4785-a103-3b6db2234084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:12.026495 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dc224-0eff-4785-a103-3b6db2234084 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:12.026834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dc224-0eff-4785-a103-3b6db2234084 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:12.027288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dc224-0eff-4785-a103-3b6db2234084 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:12.038788 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dc224-0eff-4785-a103-3b6db2234084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-1c6dc224-0eff-4785-a103-3b6db2234084 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:09:12.043406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:12.044467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:12.045514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:12.045514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:12.045514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:12.045514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:12.045514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:09:12.045514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:09:12.045514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:09:12.045514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:09:12.045514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:09:12.045514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:09:12.045514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 11:09:12.045514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:12.045514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 628/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Aug 9 11:09:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:12.050958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b09344-f9dd-4ae0-8437-ed33a04b5060 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:12.108001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:12.168289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b09344-f9dd-4ae0-8437-ed33a04b5060 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:12.204265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6a765-52c0-4a7f-864f-b73f8a876293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:12.204871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6a765-52c0-4a7f-864f-b73f8a876293 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:12.205143 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6a765-52c0-4a7f-864f-b73f8a876293 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:12.205405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6a765-52c0-4a7f-864f-b73f8a876293 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:12.206104 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6a765-52c0-4a7f-864f-b73f8a876293 None admin] RBAC: Adding query filter params (name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:12.206389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6a765-52c0-4a7f-864f-b73f8a876293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:12.207820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6a765-52c0-4a7f-864f-b73f8a876293 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:12.217396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 608/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Aug 9 11:09:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:12.225659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dc224-0eff-4785-a103-3b6db2234084 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:12.316420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:12.333830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dc224-0eff-4785-a103-3b6db2234084 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:12.372793 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa9061-8602-4f4b-8b55-8faef827a217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:12.373442 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa9061-8602-4f4b-8b55-8faef827a217 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:12.373753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa9061-8602-4f4b-8b55-8faef827a217 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:12.374026 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa9061-8602-4f4b-8b55-8faef827a217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:12.384832 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa9061-8602-4f4b-8b55-8faef827a217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:12.386428 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa9061-8602-4f4b-8b55-8faef827a217 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-93fa9061-8602-4f4b-8b55-8faef827a217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:09:12.402763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:12.403972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:09:12.405041 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:09:12.405041 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:12.405041 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:12.405041 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 629/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:12.410925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6a765-52c0-4a7f-864f-b73f8a876293 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:12.530375 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6a765-52c0-4a7f-864f-b73f8a876293 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:12.539987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:12.567084 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82c6bf-9a5d-4ae2-9e60-c493eb067857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:12.567608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82c6bf-9a5d-4ae2-9e60-c493eb067857 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:12.567876 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82c6bf-9a5d-4ae2-9e60-c493eb067857 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:12.568138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82c6bf-9a5d-4ae2-9e60-c493eb067857 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:12.568772 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82c6bf-9a5d-4ae2-9e60-c493eb067857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:12.569064 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82c6bf-9a5d-4ae2-9e60-c493eb067857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:12.570475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82c6bf-9a5d-4ae2-9e60-c493eb067857 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:12.582274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 609/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:12.588818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa9061-8602-4f4b-8b55-8faef827a217 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:12.699606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa9061-8602-4f4b-8b55-8faef827a217 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:12.732550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed94523-7327-44d6-841e-80d73a3b2fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:12.733176 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed94523-7327-44d6-841e-80d73a3b2fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:12.733442 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed94523-7327-44d6-841e-80d73a3b2fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:12.733740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed94523-7327-44d6-841e-80d73a3b2fc8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:12.736594 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:12.742699 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed94523-7327-44d6-841e-80d73a3b2fc8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:12.744470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed94523-7327-44d6-841e-80d73a3b2fc8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-9ed94523-7327-44d6-841e-80d73a3b2fc8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:09:12.757675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:12.759167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:12.760154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:12.760154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:12.760154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:09:12.760154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:09:12.760154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:09:12.760154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:09:12.760154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:09:12.760154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:09:12.760154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:09:12.760154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:12.760154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 630/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:12.764681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82c6bf-9a5d-4ae2-9e60-c493eb067857 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:12.876543 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82c6bf-9a5d-4ae2-9e60-c493eb067857 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:12.912924 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab19d9-05ab-49fc-895b-fe727591c548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:12.913569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab19d9-05ab-49fc-895b-fe727591c548 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:12.913828 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab19d9-05ab-49fc-895b-fe727591c548 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:12.914089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab19d9-05ab-49fc-895b-fe727591c548 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:12.914814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab19d9-05ab-49fc-895b-fe727591c548 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:12.915103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab19d9-05ab-49fc-895b-fe727591c548 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:12.916554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab19d9-05ab-49fc-895b-fe727591c548 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:12.935976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 610/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Aug 9 11:09:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:12.943766 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed94523-7327-44d6-841e-80d73a3b2fc8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:13.048459 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed94523-7327-44d6-841e-80d73a3b2fc8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:13.084841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41ce14-e93e-4f62-8253-2fe1bc83e9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:13.085712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41ce14-e93e-4f62-8253-2fe1bc83e9ef None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:13.085933 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41ce14-e93e-4f62-8253-2fe1bc83e9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:13.086198 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41ce14-e93e-4f62-8253-2fe1bc83e9ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:13.152728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:13.159708 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41ce14-e93e-4f62-8253-2fe1bc83e9ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:13.161198 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41ce14-e93e-4f62-8253-2fe1bc83e9ef None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:13.279885 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 631/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:09:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 11:09:13.281127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab19d9-05ab-49fc-895b-fe727591c548 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:13.309126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:13.389604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab19d9-05ab-49fc-895b-fe727591c548 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:13.427533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4b4f6-a5f9-435a-a173-71ed93023568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:13.428099 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4b4f6-a5f9-435a-a173-71ed93023568 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:13.428273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4b4f6-a5f9-435a-a173-71ed93023568 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:13.428568 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4b4f6-a5f9-435a-a173-71ed93023568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:13.439186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4b4f6-a5f9-435a-a173-71ed93023568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:13.440693 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4b4f6-a5f9-435a-a173-71ed93023568 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-f5f4b4f6-a5f9-435a-a173-71ed93023568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:09:13.456667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:13.457870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:09:13.458788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:09:13.458788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:13.458788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:13.458788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 611/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:13.464009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41ce14-e93e-4f62-8253-2fe1bc83e9ef None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:13.572268 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:13.578889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41ce14-e93e-4f62-8253-2fe1bc83e9ef None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:13.616943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0b2c1-d78d-4147-b433-5a661f266755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:13.617561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0b2c1-d78d-4147-b433-5a661f266755 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:13.617868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0b2c1-d78d-4147-b433-5a661f266755 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:13.618137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0b2c1-d78d-4147-b433-5a661f266755 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:13.618774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0b2c1-d78d-4147-b433-5a661f266755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:13.619073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0b2c1-d78d-4147-b433-5a661f266755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:13.620539 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0b2c1-d78d-4147-b433-5a661f266755 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:13.638164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 632/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:13.639462 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4b4f6-a5f9-435a-a173-71ed93023568 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:13.724137 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:13.746404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4b4f6-a5f9-435a-a173-71ed93023568 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:13.784305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38943f7a-ed15-4831-a9eb-f66e0a50d004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:13.785023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38943f7a-ed15-4831-a9eb-f66e0a50d004 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:13.785232 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38943f7a-ed15-4831-a9eb-f66e0a50d004 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:13.785464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38943f7a-ed15-4831-a9eb-f66e0a50d004 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:13.794271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38943f7a-ed15-4831-a9eb-f66e0a50d004 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:13.795798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38943f7a-ed15-4831-a9eb-f66e0a50d004 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:13.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-38943f7a-ed15-4831-a9eb-f66e0a50d004 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:09:13.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:13.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:13.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:13.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:13.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:13.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:13.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:13.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:13.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:13.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:13.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:13.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:09:13.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:09:13.808089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:13.809052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:13.810021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:09:13.810021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:09:13.810021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:09:13.810021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:09:13.810021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:09:13.810021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:09:13.810021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:09:13.810021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:13.810021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 612/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:13.815621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0b2c1-d78d-4147-b433-5a661f266755 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:13.924625 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0b2c1-d78d-4147-b433-5a661f266755 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:13.967523 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f748f2-28dc-433a-bb78-69b839cae419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:13.968139 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f748f2-28dc-433a-bb78-69b839cae419 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:13.968410 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f748f2-28dc-433a-bb78-69b839cae419 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:13.968675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f748f2-28dc-433a-bb78-69b839cae419 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:13.969361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f748f2-28dc-433a-bb78-69b839cae419 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:13.969678 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f748f2-28dc-433a-bb78-69b839cae419 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:13.971107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f748f2-28dc-433a-bb78-69b839cae419 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:13.987409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 633/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:13.994080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38943f7a-ed15-4831-a9eb-f66e0a50d004 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:14.109533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38943f7a-ed15-4831-a9eb-f66e0a50d004 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:14.145641 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd52bcbb-61e0-418f-b0c2-dbdf119f4588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:14.146252 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52bcbb-61e0-418f-b0c2-dbdf119f4588 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:14.146521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52bcbb-61e0-418f-b0c2-dbdf119f4588 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:14.146785 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd52bcbb-61e0-418f-b0c2-dbdf119f4588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:14.147521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52bcbb-61e0-418f-b0c2-dbdf119f4588 None admin] RBAC: Adding query filter params (role.id=bcdb152b51e34826a39fc0f8c3d60664, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=a587c410fd8741f3b3858d21b9e4884d) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:14.147830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52bcbb-61e0-418f-b0c2-dbdf119f4588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:14.149469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd52bcbb-61e0-418f-b0c2-dbdf119f4588 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:14.168218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 613/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:09:13 2022] GET /identity/v3/role_assignments?user.id=a587c410fd8741f3b3858d21b9e4884d&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=bcdb152b51e34826a39fc0f8c3d60664 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:16.367373 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b4931-84fe-4e37-a586-6f4d5fb7ddf0 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:16.367997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b4931-84fe-4e37-a586-6f4d5fb7ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:16.367997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b4931-84fe-4e37-a586-6f4d5fb7ddf0 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:16.369517 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 634/1247] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:09:16.375768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0382efa-7151-443a-be05-7d231ac76468 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:16.376684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0382efa-7151-443a-be05-7d231ac76468 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:16.376938 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0382efa-7151-443a-be05-7d231ac76468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:16.383572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:16.397680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-c0382efa-7151-443a-be05-7d231ac76468 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:09:16.399010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c0382efa-7151-443a-be05-7d231ac76468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:09:16.470208 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 614/1248] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:09:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:09:16.493426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b4931-84fe-4e37-a586-6f4d5fb7ddf0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:16.513706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:16.607847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b4931-84fe-4e37-a586-6f4d5fb7ddf0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:16.649827 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1a2d7-5467-4162-b7ec-a1bd92cc82b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:16.650395 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1a2d7-5467-4162-b7ec-a1bd92cc82b3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:16.650805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1a2d7-5467-4162-b7ec-a1bd92cc82b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:16.651212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1a2d7-5467-4162-b7ec-a1bd92cc82b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:16.663444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1a2d7-5467-4162-b7ec-a1bd92cc82b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-f2a1a2d7-5467-4162-b7ec-a1bd92cc82b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:09:16.668489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:16.669694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:16.670651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:16.670651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:16.670651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:16.670651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:16.670651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:09:16.670651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:09:16.670651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:09:16.670651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:09:16.670651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:09:16.670651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:09:16.670651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:09:16.670651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:16.670651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 635/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:09:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:16.675951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0382efa-7151-443a-be05-7d231ac76468 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:16.791451 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0382efa-7151-443a-be05-7d231ac76468 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:16.827941 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:16.833841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473c94f-dc4c-4a6b-8a66-5d033c7e3505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:16.834461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473c94f-dc4c-4a6b-8a66-5d033c7e3505 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:16.834742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473c94f-dc4c-4a6b-8a66-5d033c7e3505 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:16.835060 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473c94f-dc4c-4a6b-8a66-5d033c7e3505 None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:16.835788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473c94f-dc4c-4a6b-8a66-5d033c7e3505 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:16.836125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473c94f-dc4c-4a6b-8a66-5d033c7e3505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:16.837663 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473c94f-dc4c-4a6b-8a66-5d033c7e3505 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:16.847167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 615/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:09:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:09:16.853424 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1a2d7-5467-4162-b7ec-a1bd92cc82b3 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:16.945525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:16.971868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1a2d7-5467-4162-b7ec-a1bd92cc82b3 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:17.012919 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebe21b-c9f2-417f-9476-4e00f3490fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:17.013568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe21b-c9f2-417f-9476-4e00f3490fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:17.013876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe21b-c9f2-417f-9476-4e00f3490fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:17.014140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebe21b-c9f2-417f-9476-4e00f3490fe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:17.025008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebe21b-c9f2-417f-9476-4e00f3490fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:17.026612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebe21b-c9f2-417f-9476-4e00f3490fe4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-f2ebe21b-c9f2-417f-9476-4e00f3490fe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:09:17.042567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:17.043944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:09:17.045159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:09:17.045159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:17.045159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:17.045159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 636/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:17.050681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473c94f-dc4c-4a6b-8a66-5d033c7e3505 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:17.162412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473c94f-dc4c-4a6b-8a66-5d033c7e3505 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:17.202101 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3383c78-1ed5-41fa-89d1-cf8b917d5a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:17.202890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3383c78-1ed5-41fa-89d1-cf8b917d5a2c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:17.203243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3383c78-1ed5-41fa-89d1-cf8b917d5a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:17.203877 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3383c78-1ed5-41fa-89d1-cf8b917d5a2c None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:17.204725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3383c78-1ed5-41fa-89d1-cf8b917d5a2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:17.205224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3383c78-1ed5-41fa-89d1-cf8b917d5a2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:17.207062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3383c78-1ed5-41fa-89d1-cf8b917d5a2c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:17.229096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 616/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:17.230547 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebe21b-c9f2-417f-9476-4e00f3490fe4 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:17.368161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebe21b-c9f2-417f-9476-4e00f3490fe4 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:17.396548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:17.405014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6117725-606d-4eed-af60-f2f8c731174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:17.405697 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6117725-606d-4eed-af60-f2f8c731174d None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:17.406035 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6117725-606d-4eed-af60-f2f8c731174d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:17.406225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6117725-606d-4eed-af60-f2f8c731174d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:17.414900 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6117725-606d-4eed-af60-f2f8c731174d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:17.416357 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6117725-606d-4eed-af60-f2f8c731174d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-a6117725-606d-4eed-af60-f2f8c731174d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:09:17.429544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:17.430680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:17.432126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:17.432126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:17.432126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:09:17.432126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:09:17.432126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:09:17.432126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:09:17.432126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:09:17.432126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:09:17.432126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:09:17.432126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:17.432126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 637/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:17.436878 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3383c78-1ed5-41fa-89d1-cf8b917d5a2c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:17.503264 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:17.552513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3383c78-1ed5-41fa-89d1-cf8b917d5a2c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:17.591811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8c0cf-215c-445a-893d-8cce1f5bdebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:17.592452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8c0cf-215c-445a-893d-8cce1f5bdebb None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:17.592745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8c0cf-215c-445a-893d-8cce1f5bdebb None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:17.593075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8c0cf-215c-445a-893d-8cce1f5bdebb None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:17.593857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8c0cf-215c-445a-893d-8cce1f5bdebb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:17.594156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8c0cf-215c-445a-893d-8cce1f5bdebb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:17.595799 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e8c0cf-215c-445a-893d-8cce1f5bdebb None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:17.615497 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 617/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Aug 9 11:09:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:17.621607 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6117725-606d-4eed-af60-f2f8c731174d None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:17.738044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6117725-606d-4eed-af60-f2f8c731174d None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:17.779110 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78160db5-bb8b-4afc-9dbc-1c863669858b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:17.779705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78160db5-bb8b-4afc-9dbc-1c863669858b None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:17.779983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78160db5-bb8b-4afc-9dbc-1c863669858b None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:17.780251 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78160db5-bb8b-4afc-9dbc-1c863669858b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:17.843694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:17.857333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78160db5-bb8b-4afc-9dbc-1c863669858b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:17.858841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78160db5-bb8b-4afc-9dbc-1c863669858b None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:17.972938 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 638/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:09:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:09:17.974320 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8c0cf-215c-445a-893d-8cce1f5bdebb None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:18.080245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8c0cf-215c-445a-893d-8cce1f5bdebb None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:18.094136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:18.115707 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc989f2-8c45-464c-bb8b-16bbc89389e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:18.116305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc989f2-8c45-464c-bb8b-16bbc89389e1 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:18.116570 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc989f2-8c45-464c-bb8b-16bbc89389e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:18.116832 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc989f2-8c45-464c-bb8b-16bbc89389e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:18.127704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc989f2-8c45-464c-bb8b-16bbc89389e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:18.129222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc989f2-8c45-464c-bb8b-16bbc89389e1 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-1cc989f2-8c45-464c-bb8b-16bbc89389e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:09:18.144749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:18.146460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:09:18.147405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:09:18.147405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:18.147405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:18.147405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 618/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:09:18.152122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78160db5-bb8b-4afc-9dbc-1c863669858b None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:18.253255 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:18.266953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78160db5-bb8b-4afc-9dbc-1c863669858b None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:18.305842 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b36f83-92be-4286-916e-c7db82a248a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:18.306429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b36f83-92be-4286-916e-c7db82a248a8 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:18.306701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b36f83-92be-4286-916e-c7db82a248a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:18.306967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b36f83-92be-4286-916e-c7db82a248a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:18.307606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b36f83-92be-4286-916e-c7db82a248a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:18.307904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b36f83-92be-4286-916e-c7db82a248a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:18.309270 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b36f83-92be-4286-916e-c7db82a248a8 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:18.322265 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 639/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:18.328050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc989f2-8c45-464c-bb8b-16bbc89389e1 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:18.440752 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc989f2-8c45-464c-bb8b-16bbc89389e1 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:18.483173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d44c5-d468-456c-ad8d-49477a78cf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:18.483834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d44c5-d468-456c-ad8d-49477a78cf11 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:18.484105 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d44c5-d468-456c-ad8d-49477a78cf11 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:18.484368 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d44c5-d468-456c-ad8d-49477a78cf11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:18.492164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d44c5-d468-456c-ad8d-49477a78cf11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:18.493759 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d44c5-d468-456c-ad8d-49477a78cf11 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:18.507603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-bc4d44c5-d468-456c-ad8d-49477a78cf11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:09:18.507603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:18.507603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:18.507603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:18.507603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:18.507603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:18.507603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:18.507603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:18.507603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:18.507603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:18.507603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:18.507603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:18.507603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:09:18.507603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:09:18.507603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:18.508822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:18.509981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:09:18.509981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:09:18.509981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:09:18.509981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:09:18.509981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:09:18.509981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:09:18.509981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:09:18.509981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:18.509981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 619/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:09:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:18.516723 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b36f83-92be-4286-916e-c7db82a248a8 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:18.636146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b36f83-92be-4286-916e-c7db82a248a8 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:18.674868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08311ee-6134-4c1c-8ea2-ce78b301a1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:18.675481 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08311ee-6134-4c1c-8ea2-ce78b301a1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:18.675753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08311ee-6134-4c1c-8ea2-ce78b301a1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:18.676016 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08311ee-6134-4c1c-8ea2-ce78b301a1b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:18.676753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08311ee-6134-4c1c-8ea2-ce78b301a1b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:18.677049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08311ee-6134-4c1c-8ea2-ce78b301a1b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:18.678614 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08311ee-6134-4c1c-8ea2-ce78b301a1b3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:18.692464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 640/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:09:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:18.699084 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d44c5-d468-456c-ad8d-49477a78cf11 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:18.729856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:18.815001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d44c5-d468-456c-ad8d-49477a78cf11 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:18.850747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10c448-d5f9-40af-8166-747a6d5c1c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:18.851349 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10c448-d5f9-40af-8166-747a6d5c1c37 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:18.851625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10c448-d5f9-40af-8166-747a6d5c1c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:18.851874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10c448-d5f9-40af-8166-747a6d5c1c37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:18.852591 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10c448-d5f9-40af-8166-747a6d5c1c37 None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=a587c410fd8741f3b3858d21b9e4884d) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:18.852890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10c448-d5f9-40af-8166-747a6d5c1c37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:18.854389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10c448-d5f9-40af-8166-747a6d5c1c37 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:18.862139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 620/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:09:18 2022] GET /identity/v3/role_assignments?user.id=a587c410fd8741f3b3858d21b9e4884d&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:21.122075 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d7065-35a5-4da1-8d4b-7dd91e98dfab None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:21.122626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d7065-35a5-4da1-8d4b-7dd91e98dfab None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:21.122626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d7065-35a5-4da1-8d4b-7dd91e98dfab None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:21.123946 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 641/1261] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:09:21.130254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedc247-a076-424f-a8a2-fb0fed741a90 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:21.130747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedc247-a076-424f-a8a2-fb0fed741a90 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:21.130833 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedc247-a076-424f-a8a2-fb0fed741a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:21.149478 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-1cedc247-a076-424f-a8a2-fb0fed741a90 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:09:21.150732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-1cedc247-a076-424f-a8a2-fb0fed741a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:09:21.221064 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 621/1262] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:09:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:09:21.253155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d7065-35a5-4da1-8d4b-7dd91e98dfab None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:21.264276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:21.367856 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d7065-35a5-4da1-8d4b-7dd91e98dfab None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:21.404645 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfe7cc-c9a2-4b72-be71-716adabc1e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:21.405220 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfe7cc-c9a2-4b72-be71-716adabc1e7c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:21.405475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfe7cc-c9a2-4b72-be71-716adabc1e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:21.405778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfe7cc-c9a2-4b72-be71-716adabc1e7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:21.415888 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfe7cc-c9a2-4b72-be71-716adabc1e7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-81bfe7cc-c9a2-4b72-be71-716adabc1e7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:09:21.420627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:21.421775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:21.423295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:21.423295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:21.423295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:21.423295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:21.423295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:09:21.423295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:09:21.423295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:09:21.423295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:09:21.423295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:09:21.423295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:09:21.423295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:09:21.423295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:21.423295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 642/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:09:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:21.429640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedc247-a076-424f-a8a2-fb0fed741a90 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:21.448488 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:21.531608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedc247-a076-424f-a8a2-fb0fed741a90 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:21.565372 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d8bee-a9da-47c1-8954-685780db326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:21.566101 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8bee-a9da-47c1-8954-685780db326f None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:21.566373 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8bee-a9da-47c1-8954-685780db326f None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:21.566639 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8bee-a9da-47c1-8954-685780db326f None admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:21.567324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d8bee-a9da-47c1-8954-685780db326f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:21.567625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d8bee-a9da-47c1-8954-685780db326f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:21.569030 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d8bee-a9da-47c1-8954-685780db326f None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:21.576798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 622/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:09:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:21.582742 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfe7cc-c9a2-4b72-be71-716adabc1e7c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:21.652478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:21.692450 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfe7cc-c9a2-4b72-be71-716adabc1e7c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:21.729576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85f1bf-2daa-4acf-8fa1-9a8dc008ffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:21.730236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85f1bf-2daa-4acf-8fa1-9a8dc008ffb2 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:21.730510 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85f1bf-2daa-4acf-8fa1-9a8dc008ffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:21.730777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85f1bf-2daa-4acf-8fa1-9a8dc008ffb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:21.741938 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85f1bf-2daa-4acf-8fa1-9a8dc008ffb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:21.743398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85f1bf-2daa-4acf-8fa1-9a8dc008ffb2 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-bd85f1bf-2daa-4acf-8fa1-9a8dc008ffb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:09:21.757872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:21.758898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:09:21.759805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:09:21.759805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:21.759805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:21.759805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 643/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 11:09:21.765215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d8bee-a9da-47c1-8954-685780db326f None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:21.845047 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:21.867819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d8bee-a9da-47c1-8954-685780db326f None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:21.903670 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd83705-2622-4291-ba92-314b3ac82c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:21.904265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd83705-2622-4291-ba92-314b3ac82c94 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:21.904535 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd83705-2622-4291-ba92-314b3ac82c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:21.904792 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd83705-2622-4291-ba92-314b3ac82c94 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:21.905455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd83705-2622-4291-ba92-314b3ac82c94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:21.905775 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd83705-2622-4291-ba92-314b3ac82c94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:21.907137 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd83705-2622-4291-ba92-314b3ac82c94 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:21.918933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 623/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:21.925208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85f1bf-2daa-4acf-8fa1-9a8dc008ffb2 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:22.030680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85f1bf-2daa-4acf-8fa1-9a8dc008ffb2 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:22.051008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:22.067133 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb9dbe-6cd5-4a34-bda1-3cddf903ccd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:22.067831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb9dbe-6cd5-4a34-bda1-3cddf903ccd0 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:22.068103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb9dbe-6cd5-4a34-bda1-3cddf903ccd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:22.068372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb9dbe-6cd5-4a34-bda1-3cddf903ccd0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:22.077107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb9dbe-6cd5-4a34-bda1-3cddf903ccd0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:22.078616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb9dbe-6cd5-4a34-bda1-3cddf903ccd0 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-64cb9dbe-6cd5-4a34-bda1-3cddf903ccd0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:09:22.090721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:22.091871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:22.093200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:22.093200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:22.093200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:09:22.093200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:09:22.093200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:09:22.093200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:09:22.093200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:09:22.093200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:09:22.093200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:09:22.093200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:22.093200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 644/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:22.097982 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd83705-2622-4291-ba92-314b3ac82c94 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:22.197211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd83705-2622-4291-ba92-314b3ac82c94 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:22.235200 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06893d1a-4b0f-43f0-9e75-bb8a73c0ef68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:22.236001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06893d1a-4b0f-43f0-9e75-bb8a73c0ef68 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:22.236223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06893d1a-4b0f-43f0-9e75-bb8a73c0ef68 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:22.236556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06893d1a-4b0f-43f0-9e75-bb8a73c0ef68 None admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:22.237431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06893d1a-4b0f-43f0-9e75-bb8a73c0ef68 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:22.237834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06893d1a-4b0f-43f0-9e75-bb8a73c0ef68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:22.239648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06893d1a-4b0f-43f0-9e75-bb8a73c0ef68 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:22.252371 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:22.264380 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 624/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Aug 9 11:09:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:22.270698 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb9dbe-6cd5-4a34-bda1-3cddf903ccd0 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:22.381387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb9dbe-6cd5-4a34-bda1-3cddf903ccd0 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:22.416250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c97e8c-5ba7-4fbc-9216-b65c4dcf7bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:22.416868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c97e8c-5ba7-4fbc-9216-b65c4dcf7bdb None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:22.417140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c97e8c-5ba7-4fbc-9216-b65c4dcf7bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:22.417400 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c97e8c-5ba7-4fbc-9216-b65c4dcf7bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:22.428209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c97e8c-5ba7-4fbc-9216-b65c4dcf7bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:22.429650 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c97e8c-5ba7-4fbc-9216-b65c4dcf7bdb None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-95c97e8c-5ba7-4fbc-9216-b65c4dcf7bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:09:22.443939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:22.445119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:09:22.446056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:09:22.446056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:22.446056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:22.446056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 645/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:22.451109 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06893d1a-4b0f-43f0-9e75-bb8a73c0ef68 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:22.556111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06893d1a-4b0f-43f0-9e75-bb8a73c0ef68 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:22.591438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b4b5e-ebb6-4a03-8805-254a0804bf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:22.592067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b4b5e-ebb6-4a03-8805-254a0804bf98 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:22.592318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b4b5e-ebb6-4a03-8805-254a0804bf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:22.592578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b4b5e-ebb6-4a03-8805-254a0804bf98 None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:22.593218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b4b5e-ebb6-4a03-8805-254a0804bf98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:22.593510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b4b5e-ebb6-4a03-8805-254a0804bf98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:22.594931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b4b5e-ebb6-4a03-8805-254a0804bf98 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:22.606605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 625/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:22.612484 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c97e8c-5ba7-4fbc-9216-b65c4dcf7bdb None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:22.649409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:22.724318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c97e8c-5ba7-4fbc-9216-b65c4dcf7bdb None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:22.759779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd458c-1223-4999-b30b-63e00fc27701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:22.760439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd458c-1223-4999-b30b-63e00fc27701 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:22.760716 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd458c-1223-4999-b30b-63e00fc27701 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:22.760982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd458c-1223-4999-b30b-63e00fc27701 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:22.770231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd458c-1223-4999-b30b-63e00fc27701 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:22.771666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd458c-1223-4999-b30b-63e00fc27701 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:22.783271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-34fd458c-1223-4999-b30b-63e00fc27701 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:09:22.783271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:22.783271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:22.783271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:22.783271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:22.783271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:22.783271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:22.783271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:22.783271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:22.783271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:22.783271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:22.783271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:22.783271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:09:22.783271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:09:22.783271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:22.784244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:22.785248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:09:22.785248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:09:22.785248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:09:22.785248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:09:22.785248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:09:22.785248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:09:22.785248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:09:22.785248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:22.785248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 646/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:09:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:22.790639 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b4b5e-ebb6-4a03-8805-254a0804bf98 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:22.855732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:22.901112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b4b5e-ebb6-4a03-8805-254a0804bf98 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:22.936678 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21979ca9-f37f-44cd-8547-846d3fbe24be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:22.937284 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21979ca9-f37f-44cd-8547-846d3fbe24be None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:22.937554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21979ca9-f37f-44cd-8547-846d3fbe24be None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:22.937849 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21979ca9-f37f-44cd-8547-846d3fbe24be None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:22.938542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21979ca9-f37f-44cd-8547-846d3fbe24be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:22.938840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21979ca9-f37f-44cd-8547-846d3fbe24be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:22.940305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21979ca9-f37f-44cd-8547-846d3fbe24be None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:22.954263 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 626/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:09:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:22.962023 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd458c-1223-4999-b30b-63e00fc27701 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:23.072207 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:23.082798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd458c-1223-4999-b30b-63e00fc27701 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:23.119442 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52b50b-a016-4e9c-bdae-4db611b0c82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:23.120111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52b50b-a016-4e9c-bdae-4db611b0c82d None admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:23.120384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52b50b-a016-4e9c-bdae-4db611b0c82d None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:23.120653 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52b50b-a016-4e9c-bdae-4db611b0c82d None admin] PATH_INFO: `/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/a587c410fd8741f3b3858d21b9e4884d/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:23.122700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52b50b-a016-4e9c-bdae-4db611b0c82d None admin] RBAC: Authorizing `identity:create_grant(project_id=166e5328bfae434ba19d12be2eaa7a1b, user_id=a587c410fd8741f3b3858d21b9e4884d, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:23.124126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52b50b-a016-4e9c-bdae-4db611b0c82d None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:23.143359 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 647/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Aug 9 11:09:22 2022] PUT /identity/v3/projects/166e5328bfae434ba19d12be2eaa7a1b/users/a587c410fd8741f3b3858d21b9e4884d/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:09:25.135779 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110cb6f-6484-4c86-8df6-22d45bc45520 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:25.136378 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110cb6f-6484-4c86-8df6-22d45bc45520 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:25.136378 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110cb6f-6484-4c86-8df6-22d45bc45520 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:25.138152 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 627/1274] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:09:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:09:25.145876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eebea3-9c35-4372-aa85-46b95b604692 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:25.146313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eebea3-9c35-4372-aa85-46b95b604692 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:25.146400 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eebea3-9c35-4372-aa85-46b95b604692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:25.168155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d7eebea3-9c35-4372-aa85-46b95b604692 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:09:25.170169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d7eebea3-9c35-4372-aa85-46b95b604692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:09:25.250216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 648/1275] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:09:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:09:25.274298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110cb6f-6484-4c86-8df6-22d45bc45520 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:25.394311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110cb6f-6484-4c86-8df6-22d45bc45520 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:25.411396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:25.428920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa4e08-d57b-4fa4-9f55-516d0dcbcc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:25.429519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa4e08-d57b-4fa4-9f55-516d0dcbcc4e None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:25.429812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa4e08-d57b-4fa4-9f55-516d0dcbcc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:25.430076 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa4e08-d57b-4fa4-9f55-516d0dcbcc4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:25.440402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa4e08-d57b-4fa4-9f55-516d0dcbcc4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-e4aa4e08-d57b-4fa4-9f55-516d0dcbcc4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 11:09:25.445119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:25.446193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:25.447155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:25.447155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:25.447155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:25.447155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:25.447155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 11:09:25.447155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 11:09:25.447155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 11:09:25.447155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 11:09:25.447155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 11:09:25.447155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 11:09:25.447155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 11:09:25.447155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:25.447155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 628/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Aug 9 11:09:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:25.454486 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eebea3-9c35-4372-aa85-46b95b604692 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:25.544348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:25.564254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eebea3-9c35-4372-aa85-46b95b604692 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:25.606262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fae4a-0f98-4acb-a243-06f193fe1041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:25.606864 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fae4a-0f98-4acb-a243-06f193fe1041 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:25.607114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fae4a-0f98-4acb-a243-06f193fe1041 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:25.607376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fae4a-0f98-4acb-a243-06f193fe1041 None admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:25.608057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fae4a-0f98-4acb-a243-06f193fe1041 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:25.608353 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fae4a-0f98-4acb-a243-06f193fe1041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:25.609747 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fae4a-0f98-4acb-a243-06f193fe1041 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:25.619785 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 649/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Aug 9 11:09:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:25.626676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa4e08-d57b-4fa4-9f55-516d0dcbcc4e None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:25.741603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa4e08-d57b-4fa4-9f55-516d0dcbcc4e None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:25.777315 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ec46-c86d-49e7-9035-0f84641f6b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:25.777985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ec46-c86d-49e7-9035-0f84641f6b53 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:25.778229 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ec46-c86d-49e7-9035-0f84641f6b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:25.778518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ec46-c86d-49e7-9035-0f84641f6b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:25.789732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9ec46-c86d-49e7-9035-0f84641f6b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:25.791202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9ec46-c86d-49e7-9035-0f84641f6b53 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-d4d9ec46-c86d-49e7-9035-0f84641f6b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:09:25.805901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:25.807080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:09:25.808151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:09:25.808151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:25.808151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:25.808151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 629/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:25.813011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fae4a-0f98-4acb-a243-06f193fe1041 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:25.920490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fae4a-0f98-4acb-a243-06f193fe1041 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:25.956341 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149be97-c423-4d55-ab6d-471c3ea9484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:25.956948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149be97-c423-4d55-ab6d-471c3ea9484c None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:25.957215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149be97-c423-4d55-ab6d-471c3ea9484c None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:25.957482 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149be97-c423-4d55-ab6d-471c3ea9484c None admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:25.958197 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149be97-c423-4d55-ab6d-471c3ea9484c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:25.958491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149be97-c423-4d55-ab6d-471c3ea9484c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:25.959850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149be97-c423-4d55-ab6d-471c3ea9484c None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:25.972654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 650/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:09:25.979131 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ec46-c86d-49e7-9035-0f84641f6b53 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:26.014622 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:26.088271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ec46-c86d-49e7-9035-0f84641f6b53 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:26.123753 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73a5fa-c79d-430e-a647-ad6c7dbdbecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:26.124373 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a5fa-c79d-430e-a647-ad6c7dbdbecf None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:26.124634 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a5fa-c79d-430e-a647-ad6c7dbdbecf None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:26.124892 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73a5fa-c79d-430e-a647-ad6c7dbdbecf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:26.133142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73a5fa-c79d-430e-a647-ad6c7dbdbecf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:26.134615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73a5fa-c79d-430e-a647-ad6c7dbdbecf None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-be73a5fa-c79d-430e-a647-ad6c7dbdbecf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 11:09:26.145932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:26.147461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:26.148721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:26.148721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:26.148721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 11:09:26.148721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 11:09:26.148721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 11:09:26.148721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 11:09:26.148721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 11:09:26.148721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 11:09:26.148721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 11:09:26.148721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:26.148721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 630/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:26.153599 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149be97-c423-4d55-ab6d-471c3ea9484c None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:26.159238 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:26.283770 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149be97-c423-4d55-ab6d-471c3ea9484c None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:26.322350 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461856c2-6eb8-46a4-af72-a28ba5682da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:26.322924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461856c2-6eb8-46a4-af72-a28ba5682da9 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:26.323201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461856c2-6eb8-46a4-af72-a28ba5682da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:26.323467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461856c2-6eb8-46a4-af72-a28ba5682da9 None admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:26.324212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461856c2-6eb8-46a4-af72-a28ba5682da9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:26.324513 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461856c2-6eb8-46a4-af72-a28ba5682da9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:26.325956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461856c2-6eb8-46a4-af72-a28ba5682da9 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:26.344105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 651/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Aug 9 11:09:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:26.350172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73a5fa-c79d-430e-a647-ad6c7dbdbecf None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:26.447808 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:26.460639 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73a5fa-c79d-430e-a647-ad6c7dbdbecf None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:26.501648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc0343-c192-455a-86f1-679db1068671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:26.502254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc0343-c192-455a-86f1-679db1068671 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:26.502523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc0343-c192-455a-86f1-679db1068671 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:26.502779 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc0343-c192-455a-86f1-679db1068671 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:26.583711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc0343-c192-455a-86f1-679db1068671 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:26.585137 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dc0343-c192-455a-86f1-679db1068671 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:26.685772 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:26.699437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 631/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Aug 9 11:09:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 11:09:26.705814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461856c2-6eb8-46a4-af72-a28ba5682da9 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:26.775146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:26.816329 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461856c2-6eb8-46a4-af72-a28ba5682da9 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:26.852266 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa508-dc49-42c5-8568-d3d95d4b4da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:26.852764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa508-dc49-42c5-8568-d3d95d4b4da1 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:26.853034 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa508-dc49-42c5-8568-d3d95d4b4da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:26.853297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5aa508-dc49-42c5-8568-d3d95d4b4da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:26.863340 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aa508-dc49-42c5-8568-d3d95d4b4da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:26.864847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5aa508-dc49-42c5-8568-d3d95d4b4da1 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-bc5aa508-dc49-42c5-8568-d3d95d4b4da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 11:09:26.878941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:26.880111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 11:09:26.881236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 11:09:26.881236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 11:09:26.881236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:26.881236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 652/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:26.886331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc0343-c192-455a-86f1-679db1068671 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:26.991172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc0343-c192-455a-86f1-679db1068671 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:27.028491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f205278-877a-4338-933f-893ca714c20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:27.029087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f205278-877a-4338-933f-893ca714c20c None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:27.029356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f205278-877a-4338-933f-893ca714c20c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:27.029658 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f205278-877a-4338-933f-893ca714c20c None admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:27.030282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f205278-877a-4338-933f-893ca714c20c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:27.030581 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f205278-877a-4338-933f-893ca714c20c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:27.031953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f205278-877a-4338-933f-893ca714c20c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:27.043331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 632/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Aug 9 11:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:27.049511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa508-dc49-42c5-8568-d3d95d4b4da1 None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:27.154892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5aa508-dc49-42c5-8568-d3d95d4b4da1 None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:27.168791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:27.192461 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe599ec-1a3e-4200-90d7-8f4ef13310ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:27.193084 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe599ec-1a3e-4200-90d7-8f4ef13310ba None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:27.193351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe599ec-1a3e-4200-90d7-8f4ef13310ba None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:27.193638 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe599ec-1a3e-4200-90d7-8f4ef13310ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:27.200868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe599ec-1a3e-4200-90d7-8f4ef13310ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:27.202837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe599ec-1a3e-4200-90d7-8f4ef13310ba None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:27.215773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application [None req-1fe599ec-1a3e-4200-90d7-8f4ef13310ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:09:27.215773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:27.215773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:27.215773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:27.215773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:27.215773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:27.215773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:27.215773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:27.215773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:27.215773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:27.215773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:27.215773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:27.215773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 11:09:27.215773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 11:09:27.215773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:27.216789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:27.217739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 11:09:27.217739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 11:09:27.217739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 11:09:27.217739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 11:09:27.217739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 11:09:27.217739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 11:09:27.217739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 11:09:27.217739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: ERROR keystone.server.flask.application Aug 09 11:09:27.217739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 653/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Aug 9 11:09:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:27.224312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f205278-877a-4338-933f-893ca714c20c None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:27.280398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:27.333864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f205278-877a-4338-933f-893ca714c20c None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:27.368931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ec1a4-545f-41fd-9712-7d3f401729fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:27.369531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec1a4-545f-41fd-9712-7d3f401729fd None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:27.369824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec1a4-545f-41fd-9712-7d3f401729fd None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:27.370090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec1a4-545f-41fd-9712-7d3f401729fd None admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:27.370774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ec1a4-545f-41fd-9712-7d3f401729fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:27.371073 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ec1a4-545f-41fd-9712-7d3f401729fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:27.372495 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ec1a4-545f-41fd-9712-7d3f401729fd None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:27.386622 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 633/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Aug 9 11:09:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:27.396279 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe599ec-1a3e-4200-90d7-8f4ef13310ba None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:27.502003 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe599ec-1a3e-4200-90d7-8f4ef13310ba None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:27.536554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e97d98-85f5-4872-9eec-3d076b6563b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:27.537151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e97d98-85f5-4872-9eec-3d076b6563b3 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:27.537417 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e97d98-85f5-4872-9eec-3d076b6563b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:27.537700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e97d98-85f5-4872-9eec-3d076b6563b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:27.538418 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e97d98-85f5-4872-9eec-3d076b6563b3 None admin] RBAC: Adding query filter params (role.id=b70a2607f0e949d4ae213cbc724713e6, scope.project.id=166e5328bfae434ba19d12be2eaa7a1b, user.id=a587c410fd8741f3b3858d21b9e4884d) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:27.538715 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e97d98-85f5-4872-9eec-3d076b6563b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:27.540130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e97d98-85f5-4872-9eec-3d076b6563b3 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:27.546379 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 654/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Aug 9 11:09:27 2022] GET /identity/v3/role_assignments?user.id=a587c410fd8741f3b3858d21b9e4884d&scope.project.id=166e5328bfae434ba19d12be2eaa7a1b&role.id=b70a2607f0e949d4ae213cbc724713e6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:29.553000 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afed8c5-db69-4574-9b8b-63dbd46ae18b None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:29.553557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afed8c5-db69-4574-9b8b-63dbd46ae18b None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:29.553557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afed8c5-db69-4574-9b8b-63dbd46ae18b None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:29.554908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 634/1288] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:09:29.560963 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94f9f4-a443-4c3a-89e4-1024af8dccda None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:29.561694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94f9f4-a443-4c3a-89e4-1024af8dccda None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:29.561788 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94f9f4-a443-4c3a-89e4-1024af8dccda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:29.581527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0b94f9f4-a443-4c3a-89e4-1024af8dccda None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:09:29.582863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0b94f9f4-a443-4c3a-89e4-1024af8dccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:09:29.614389 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:29.656160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 655/1289] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:09:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:09:29.678780 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afed8c5-db69-4574-9b8b-63dbd46ae18b None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:29.784410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afed8c5-db69-4574-9b8b-63dbd46ae18b None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:29.795405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:29.820481 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626ca52-4a92-4c2a-bf9b-2cda73501db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:29.821102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626ca52-4a92-4c2a-bf9b-2cda73501db7 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:29.821378 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626ca52-4a92-4c2a-bf9b-2cda73501db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:29.821654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626ca52-4a92-4c2a-bf9b-2cda73501db7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:29.822243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626ca52-4a92-4c2a-bf9b-2cda73501db7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:29.823614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626ca52-4a92-4c2a-bf9b-2cda73501db7 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-c626ca52-4a92-4c2a-bf9b-2cda73501db7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:29.832338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:29.833662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:29.834679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:29.834679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:29.834679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:29.834679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:29.834679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:29.834679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:29.834679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:29.834679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:29.834679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:29.834679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:29.834679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:09:29.834679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:09:29.834679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:09:29.834679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:29.834679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 635/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Aug 9 11:09:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:29.839805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94f9f4-a443-4c3a-89e4-1024af8dccda None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:29.944583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94f9f4-a443-4c3a-89e4-1024af8dccda None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:29.981063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45da8cd-c63d-4d24-964b-89e971b42a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:29.981669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45da8cd-c63d-4d24-964b-89e971b42a92 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:29.981988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45da8cd-c63d-4d24-964b-89e971b42a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:29.982253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45da8cd-c63d-4d24-964b-89e971b42a92 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:29.982873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45da8cd-c63d-4d24-964b-89e971b42a92 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:29.983165 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45da8cd-c63d-4d24-964b-89e971b42a92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:29.984535 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45da8cd-c63d-4d24-964b-89e971b42a92 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:29.989992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 656/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Aug 9 11:09:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:29.996140 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626ca52-4a92-4c2a-bf9b-2cda73501db7 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:30.105909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626ca52-4a92-4c2a-bf9b-2cda73501db7 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:30.141983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253340c8-ef3d-4206-9468-0d1349968699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:30.142581 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253340c8-ef3d-4206-9468-0d1349968699 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:30.142847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253340c8-ef3d-4206-9468-0d1349968699 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:30.143107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253340c8-ef3d-4206-9468-0d1349968699 None admin] PATH_INFO: `/v3/services` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:30.143730 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253340c8-ef3d-4206-9468-0d1349968699 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:30.144015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253340c8-ef3d-4206-9468-0d1349968699 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:30.145432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253340c8-ef3d-4206-9468-0d1349968699 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:30.150365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 636/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Aug 9 11:09:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:32.133683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21af1f-942a-4cf8-aeb6-035d80368bb1 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:32.134266 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21af1f-942a-4cf8-aeb6-035d80368bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:32.134266 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21af1f-942a-4cf8-aeb6-035d80368bb1 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:32.135597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 657/1293] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:09:32.140858 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198e50a-57b9-4fcb-bd27-26bdba79ba61 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:32.141295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198e50a-57b9-4fcb-bd27-26bdba79ba61 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:32.141386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198e50a-57b9-4fcb-bd27-26bdba79ba61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:32.160517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-6198e50a-57b9-4fcb-bd27-26bdba79ba61 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:09:32.161865 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6198e50a-57b9-4fcb-bd27-26bdba79ba61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:09:32.193375 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:32.240160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 637/1294] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:09:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:09:32.263797 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21af1f-942a-4cf8-aeb6-035d80368bb1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:32.298265 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:32.380748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21af1f-942a-4cf8-aeb6-035d80368bb1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:32.420699 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a036616-c64e-4593-87be-4f07fc14d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:32.421219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a036616-c64e-4593-87be-4f07fc14d101 None admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:32.421489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a036616-c64e-4593-87be-4f07fc14d101 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:32.421780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a036616-c64e-4593-87be-4f07fc14d101 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:32.422418 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a036616-c64e-4593-87be-4f07fc14d101 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:32.423789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a036616-c64e-4593-87be-4f07fc14d101 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:32.442898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 658/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Aug 9 11:09:32 2022] POST /identity/v3/services => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:09:34.451610 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4490a93-443d-47a9-a728-7037f6b48211 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:34.452223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4490a93-443d-47a9-a728-7037f6b48211 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:34.452223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4490a93-443d-47a9-a728-7037f6b48211 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:34.453507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 638/1296] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:09:34.459333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9124a4d-db27-4788-8f52-361633608688 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:34.459833 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9124a4d-db27-4788-8f52-361633608688 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:34.459960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9124a4d-db27-4788-8f52-361633608688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:34.479262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b9124a4d-db27-4788-8f52-361633608688 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:09:34.480481 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b9124a4d-db27-4788-8f52-361633608688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:09:34.560153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 659/1297] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:09:34 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:09:34.583020 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4490a93-443d-47a9-a728-7037f6b48211 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:34.688680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4490a93-443d-47a9-a728-7037f6b48211 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:34.723988 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982091b7-c75b-4057-b133-dddd5e8e58f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:34.724508 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982091b7-c75b-4057-b133-dddd5e8e58f6 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:34.724776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982091b7-c75b-4057-b133-dddd5e8e58f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:34.725034 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982091b7-c75b-4057-b133-dddd5e8e58f6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:34.725609 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982091b7-c75b-4057-b133-dddd5e8e58f6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:34.727004 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982091b7-c75b-4057-b133-dddd5e8e58f6 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-982091b7-c75b-4057-b133-dddd5e8e58f6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:34.735898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:34.737086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:34.737973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:34.737973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:34.737973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:34.737973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:34.737973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:34.737973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:34.737973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:34.737973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:34.737973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:34.737973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:34.737973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:09:34.737973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:09:34.737973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:09:34.737973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:34.737973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 639/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Aug 9 11:09:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:34.743494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9124a4d-db27-4788-8f52-361633608688 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:34.763018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:34.845654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9124a4d-db27-4788-8f52-361633608688 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:34.881906 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc195faa-a319-480e-beaa-89d144e8b44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:34.882523 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc195faa-a319-480e-beaa-89d144e8b44f None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:34.882790 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc195faa-a319-480e-beaa-89d144e8b44f None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:34.883050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc195faa-a319-480e-beaa-89d144e8b44f None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:34.883678 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc195faa-a319-480e-beaa-89d144e8b44f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:34.883972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc195faa-a319-480e-beaa-89d144e8b44f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:34.885327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc195faa-a319-480e-beaa-89d144e8b44f None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:34.890959 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 660/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Aug 9 11:09:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:34.897466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982091b7-c75b-4057-b133-dddd5e8e58f6 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:34.931086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:35.001031 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982091b7-c75b-4057-b133-dddd5e8e58f6 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:35.039112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bdc49-4c3e-4684-92fd-eaa20ff36b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:35.039698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bdc49-4c3e-4684-92fd-eaa20ff36b57 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:35.039969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bdc49-4c3e-4684-92fd-eaa20ff36b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:35.040227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bdc49-4c3e-4684-92fd-eaa20ff36b57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:35.040915 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bdc49-4c3e-4684-92fd-eaa20ff36b57 None admin] RBAC: Adding query filter params (interface=public, service_id=ea7d5338b2964e14a649d9f30694b968, region_id=RegionOne) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:35.041210 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bdc49-4c3e-4684-92fd-eaa20ff36b57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:35.042598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bdc49-4c3e-4684-92fd-eaa20ff36b57 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:35.047754 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 640/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Aug 9 11:09:34 2022] GET /identity/v3/endpoints?service_id=ea7d5338b2964e14a649d9f30694b968&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:35.053782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc195faa-a319-480e-beaa-89d144e8b44f None admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:35.142144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:35.161922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc195faa-a319-480e-beaa-89d144e8b44f None admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:35.197447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99624ce9-1530-485e-aa1f-7170681283f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:35.198075 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99624ce9-1530-485e-aa1f-7170681283f4 None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:35.198348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99624ce9-1530-485e-aa1f-7170681283f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:35.198615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99624ce9-1530-485e-aa1f-7170681283f4 None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:35.199264 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99624ce9-1530-485e-aa1f-7170681283f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:35.200607 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99624ce9-1530-485e-aa1f-7170681283f4 None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:35.208241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 661/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Aug 9 11:09:35 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:09:37.181505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0f91e-7183-4d89-88c9-7f2d8dc15eee None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:37.182136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0f91e-7183-4d89-88c9-7f2d8dc15eee None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:37.182136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0f91e-7183-4d89-88c9-7f2d8dc15eee None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:37.183390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 641/1302] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:09:37.188655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f4800-6d20-40cb-a947-3ee4fd158539 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:37.189101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f4800-6d20-40cb-a947-3ee4fd158539 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:37.189191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f4800-6d20-40cb-a947-3ee4fd158539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:37.209414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-855f4800-6d20-40cb-a947-3ee4fd158539 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:09:37.210657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-855f4800-6d20-40cb-a947-3ee4fd158539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:09:37.282190 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 662/1303] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:09:37 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 11:09:37.306822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0f91e-7183-4d89-88c9-7f2d8dc15eee None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:37.412492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:37.420524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0f91e-7183-4d89-88c9-7f2d8dc15eee None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:37.458732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f40b5-a6ef-4e08-bccd-0c4b594be835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:37.459264 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f40b5-a6ef-4e08-bccd-0c4b594be835 None admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:37.459534 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f40b5-a6ef-4e08-bccd-0c4b594be835 None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:37.459794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f40b5-a6ef-4e08-bccd-0c4b594be835 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:37.460368 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f40b5-a6ef-4e08-bccd-0c4b594be835 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:37.461779 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f40b5-a6ef-4e08-bccd-0c4b594be835 None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application [None req-f35f40b5-a6ef-4e08-bccd-0c4b594be835 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 11:09:37.470643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 11:09:37.471652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 11:09:37.472605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 11:09:37.472605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application with Lock( Aug 09 11:09:37.472605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 11:09:37.472605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self._enter() Aug 09 11:09:37.472605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 11:09:37.472605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 11:09:37.472605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 11:09:37.472605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application return self.creator() Aug 09 11:09:37.472605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 11:09:37.472605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application created_value = creator( Aug 09 11:09:37.472605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 11:09:37.472605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 11:09:37.472605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 11:09:37.472605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: ERROR keystone.server.flask.application Aug 09 11:09:37.472605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 642/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Aug 9 11:09:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 11:09:37.479250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f4800-6d20-40cb-a947-3ee4fd158539 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:37.557260 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:37.582517 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f4800-6d20-40cb-a947-3ee4fd158539 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:37.619784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9142bc0-c0c8-4f45-a6b7-f4d4da9cd4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:37.620382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9142bc0-c0c8-4f45-a6b7-f4d4da9cd4cc None admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:37.620651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9142bc0-c0c8-4f45-a6b7-f4d4da9cd4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:37.620913 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9142bc0-c0c8-4f45-a6b7-f4d4da9cd4cc None admin] PATH_INFO: `/v3/services` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:37.621533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9142bc0-c0c8-4f45-a6b7-f4d4da9cd4cc None admin] RBAC: Adding query filter params (name=placement) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:09:37.621864 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9142bc0-c0c8-4f45-a6b7-f4d4da9cd4cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:37.623218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9142bc0-c0c8-4f45-a6b7-f4d4da9cd4cc None admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:37.628772 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 663/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Aug 9 11:09:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:09:37.635054 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f40b5-a6ef-4e08-bccd-0c4b594be835 None admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:09:37.745691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f40b5-a6ef-4e08-bccd-0c4b594be835 None admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:09:37.780629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16effa-83d2-43ce-af8d-5549d191369c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:09:37.781220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16effa-83d2-43ce-af8d-5549d191369c None admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:09:37.781487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16effa-83d2-43ce-af8d-5549d191369c None admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:09:37.781770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16effa-83d2-43ce-af8d-5549d191369c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:09:37.782416 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16effa-83d2-43ce-af8d-5549d191369c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:09:37.783789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16effa-83d2-43ce-af8d-5549d191369c None admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:09:37.807666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 643/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:09:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:09:47.625600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=30 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:09:47.802993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:42.554245 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b4327-f925-4333-977a-df403223d453 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:42.554725 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b4327-f925-4333-977a-df403223d453 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:42.555192 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b4327-f925-4333-977a-df403223d453 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:42.557742 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 664/1307] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:10:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:10:42.566764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8f174-5390-4f05-a716-8e83530bf40c None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:42.567178 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8f174-5390-4f05-a716-8e83530bf40c None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:42.567613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8f174-5390-4f05-a716-8e83530bf40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:42.673979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-acc8f174-5390-4f05-a716-8e83530bf40c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:10:42.675220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-acc8f174-5390-4f05-a716-8e83530bf40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:42.841741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 644/1308] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:10:42.894511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c0475-e3f0-436b-9bc6-f1f2291cb674 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:42.894820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c0475-e3f0-436b-9bc6-f1f2291cb674 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:42.895516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c0475-e3f0-436b-9bc6-f1f2291cb674 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:42.897222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 665/1309] 10.222.0.15 () {54 vars in 965 bytes} [Tue Aug 9 11:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:10:42.904059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccafacd-19bd-413a-a452-2ef5b36a3d82 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:42.904374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccafacd-19bd-413a-a452-2ef5b36a3d82 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:42.904708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccafacd-19bd-413a-a452-2ef5b36a3d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:42.995795 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-dccafacd-19bd-413a-a452-2ef5b36a3d82 None None] MFA Rules not processed for user `0ee3889add1541418ccda24268831979`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:10:42.996907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-dccafacd-19bd-413a-a452-2ef5b36a3d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:43.019467 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:43.080091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 645/1310] 10.222.0.15 () {58 vars in 1062 bytes} [Tue Aug 9 11:10:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:10:43.089235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c0475-e3f0-436b-9bc6-f1f2291cb674 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:10:43.090988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c22c0475-e3f0-436b-9bc6-f1f2291cb674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:43.212860 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c0475-e3f0-436b-9bc6-f1f2291cb674 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:10:43.291356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea6ce3-a458-4f27-8351-f37dc7a682b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:10:43.291859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea6ce3-a458-4f27-8351-f37dc7a682b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:43.292140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea6ce3-a458-4f27-8351-f37dc7a682b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:43.292399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea6ce3-a458-4f27-8351-f37dc7a682b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:43.294011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b1ea6ce3-a458-4f27-8351-f37dc7a682b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:43.350610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:43.411094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea6ce3-a458-4f27-8351-f37dc7a682b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:10:43.412535 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea6ce3-a458-4f27-8351-f37dc7a682b0 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:10:43.432584 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 666/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:10:45.739306 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa67d8-eb5b-4e1a-b08c-aab53afb19e7 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:45.739928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa67d8-eb5b-4e1a-b08c-aab53afb19e7 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:45.739928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa67d8-eb5b-4e1a-b08c-aab53afb19e7 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:45.741227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 646/1312] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:10:45.747396 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d06170-d856-463d-b99e-fb40321bcfaa None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:45.748020 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d06170-d856-463d-b99e-fb40321bcfaa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:45.748020 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d06170-d856-463d-b99e-fb40321bcfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:45.840903 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-90d06170-d856-463d-b99e-fb40321bcfaa None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:10:45.842148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-90d06170-d856-463d-b99e-fb40321bcfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:45.947773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 667/1313] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:10:45.986254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa67d8-eb5b-4e1a-b08c-aab53afb19e7 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:10:45.987917 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f5aa67d8-eb5b-4e1a-b08c-aab53afb19e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:46.103357 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa67d8-eb5b-4e1a-b08c-aab53afb19e7 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:10:46.175420 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:46.178457 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4ef6e-561a-45e8-9b7b-752415fe925b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:10:46.179405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4ef6e-561a-45e8-9b7b-752415fe925b service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:46.179849 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4ef6e-561a-45e8-9b7b-752415fe925b service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:46.180118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4ef6e-561a-45e8-9b7b-752415fe925b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:46.182130 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-92c4ef6e-561a-45e8-9b7b-752415fe925b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:46.300730 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4ef6e-561a-45e8-9b7b-752415fe925b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:10:46.302568 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4ef6e-561a-45e8-9b7b-752415fe925b service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:10:46.321706 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 647/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:10:48.674030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22f321-b28a-4d68-a6e2-2d25968399f5 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:48.674571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22f321-b28a-4d68-a6e2-2d25968399f5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:48.674571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22f321-b28a-4d68-a6e2-2d25968399f5 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:48.675923 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 668/1315] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:10:48.681559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250bd3c-73b4-490c-a269-3ba125cf8dd1 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:48.682140 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250bd3c-73b4-490c-a269-3ba125cf8dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:48.682140 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250bd3c-73b4-490c-a269-3ba125cf8dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:48.755253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-0250bd3c-73b4-490c-a269-3ba125cf8dd1 None None] MFA Rules not processed for user `736a7588742742e5ab57503902970713`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:10:48.756418 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0250bd3c-73b4-490c-a269-3ba125cf8dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:48.815155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:48.863216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 648/1316] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:10:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:10:48.915639 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fc362-c07f-4e01-88f0-05f367e2e2e6 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:48.915876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fc362-c07f-4e01-88f0-05f367e2e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:48.916184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fc362-c07f-4e01-88f0-05f367e2e2e6 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:48.917612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 669/1317] 10.222.0.15 () {54 vars in 965 bytes} [Tue Aug 9 11:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:10:48.924138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84894a-3a2c-4b4a-b4af-93afa1db810d None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:48.924421 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84894a-3a2c-4b4a-b4af-93afa1db810d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:48.924709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84894a-3a2c-4b4a-b4af-93afa1db810d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:49.006916 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-7c84894a-3a2c-4b4a-b4af-93afa1db810d None None] MFA Rules not processed for user `0ee3889add1541418ccda24268831979`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:10:49.008088 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7c84894a-3a2c-4b4a-b4af-93afa1db810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:49.084697 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 649/1318] 10.222.0.15 () {58 vars in 1062 bytes} [Tue Aug 9 11:10:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:10:49.094013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fc362-c07f-4e01-88f0-05f367e2e2e6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:10:49.095546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b96fc362-c07f-4e01-88f0-05f367e2e2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:49.105646 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:49.204889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fc362-c07f-4e01-88f0-05f367e2e2e6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:10:49.281127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b1a5d-0433-425e-b48e-3ee027edb697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:10:49.281659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b1a5d-0433-425e-b48e-3ee027edb697 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:49.281943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b1a5d-0433-425e-b48e-3ee027edb697 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:49.282215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b1a5d-0433-425e-b48e-3ee027edb697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:49.283816 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-764b1a5d-0433-425e-b48e-3ee027edb697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:49.348482 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:49.397066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b1a5d-0433-425e-b48e-3ee027edb697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:10:49.398583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b1a5d-0433-425e-b48e-3ee027edb697 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:10:49.417275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 670/1319] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:10:49 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:10:52.404878 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cc969-e45b-43ac-ae1b-753b1a74eb37 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:52.405513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cc969-e45b-43ac-ae1b-753b1a74eb37 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:52.405513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cc969-e45b-43ac-ae1b-753b1a74eb37 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:52.407038 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 650/1320] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:10:52.413459 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2496e-9ff0-42a0-842a-0466f10d4764 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:52.414032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2496e-9ff0-42a0-842a-0466f10d4764 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:52.414195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2496e-9ff0-42a0-842a-0466f10d4764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:52.498852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d7f2496e-9ff0-42a0-842a-0466f10d4764 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:10:52.501154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d7f2496e-9ff0-42a0-842a-0466f10d4764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:52.619583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 671/1321] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:10:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:10:52.658975 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cc969-e45b-43ac-ae1b-753b1a74eb37 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:10:52.660470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fc3cc969-e45b-43ac-ae1b-753b1a74eb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:52.712610 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:52.767875 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cc969-e45b-43ac-ae1b-753b1a74eb37 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:10:52.843494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc777e1b-d4fb-4119-acd3-1e7cb7b8a009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:10:52.844087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc777e1b-d4fb-4119-acd3-1e7cb7b8a009 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:52.844360 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc777e1b-d4fb-4119-acd3-1e7cb7b8a009 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:52.844624 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc777e1b-d4fb-4119-acd3-1e7cb7b8a009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:52.846246 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-dc777e1b-d4fb-4119-acd3-1e7cb7b8a009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:52.944106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:52.958141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc777e1b-d4fb-4119-acd3-1e7cb7b8a009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:10:52.959600 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc777e1b-d4fb-4119-acd3-1e7cb7b8a009 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:10:52.978029 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 651/1322] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:10:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:10:55.685398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c05a6-13a4-4794-83da-5a76abf42393 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:55.686020 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c05a6-13a4-4794-83da-5a76abf42393 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:55.686020 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c05a6-13a4-4794-83da-5a76abf42393 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:55.687306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 672/1323] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:10:55.692648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cac537-bd2c-4bfc-8ab7-a5b90d33c072 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:55.693106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cac537-bd2c-4bfc-8ab7-a5b90d33c072 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:55.693221 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cac537-bd2c-4bfc-8ab7-a5b90d33c072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:55.761531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-55cac537-bd2c-4bfc-8ab7-a5b90d33c072 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:10:55.762707 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-55cac537-bd2c-4bfc-8ab7-a5b90d33c072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:55.874367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 652/1324] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:10:55.911233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c05a6-13a4-4794-83da-5a76abf42393 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:10:55.912779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-023c05a6-13a4-4794-83da-5a76abf42393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:55.934822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:56.028724 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c05a6-13a4-4794-83da-5a76abf42393 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:10:56.106910 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769b568-eb4d-4135-ae86-e338bd37b886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:10:56.107541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769b568-eb4d-4135-ae86-e338bd37b886 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:56.107812 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769b568-eb4d-4135-ae86-e338bd37b886 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:56.108075 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769b568-eb4d-4135-ae86-e338bd37b886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:56.109812 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3769b568-eb4d-4135-ae86-e338bd37b886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:56.185067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:56.236508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769b568-eb4d-4135-ae86-e338bd37b886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:10:56.237995 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769b568-eb4d-4135-ae86-e338bd37b886 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:10:56.262678 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 673/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:10:58.371142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6074d-bd42-4a70-9978-69f72f7a12f3 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:58.371683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6074d-bd42-4a70-9978-69f72f7a12f3 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:58.371683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6074d-bd42-4a70-9978-69f72f7a12f3 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:58.372876 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 653/1326] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:10:58.379129 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a1385-61a1-4b61-8945-7a5bee5fdd5e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:58.379761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a1385-61a1-4b61-8945-7a5bee5fdd5e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:58.379761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a1385-61a1-4b61-8945-7a5bee5fdd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:58.463527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bd4a1385-61a1-4b61-8945-7a5bee5fdd5e None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:10:58.464762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bd4a1385-61a1-4b61-8945-7a5bee5fdd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:58.582597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 674/1327] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:10:58.620446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6074d-bd42-4a70-9978-69f72f7a12f3 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:10:58.622120 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-bff6074d-bd42-4a70-9978-69f72f7a12f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:58.681826 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:58.739338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6074d-bd42-4a70-9978-69f72f7a12f3 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:10:58.827210 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be6004-b4b8-4bfa-89e8-7dc845514dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:10:58.827805 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be6004-b4b8-4bfa-89e8-7dc845514dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:10:58.828072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be6004-b4b8-4bfa-89e8-7dc845514dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:10:58.828328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be6004-b4b8-4bfa-89e8-7dc845514dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:10:58.830043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d6be6004-b4b8-4bfa-89e8-7dc845514dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:10:58.957598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:10:58.960517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be6004-b4b8-4bfa-89e8-7dc845514dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:10:58.962253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be6004-b4b8-4bfa-89e8-7dc845514dc7 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:10:58.983369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 654/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:01.065989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a13b10-0efb-44b5-9587-6d204f33b8cb None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:01.066807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a13b10-0efb-44b5-9587-6d204f33b8cb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:01.066807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a13b10-0efb-44b5-9587-6d204f33b8cb None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:01.067893 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 675/1329] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:11:01.076865 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93995c-a97b-4ac8-ba77-22c64b1e8b39 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:01.077432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93995c-a97b-4ac8-ba77-22c64b1e8b39 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:01.077865 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93995c-a97b-4ac8-ba77-22c64b1e8b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:01.168821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-8a93995c-a97b-4ac8-ba77-22c64b1e8b39 None None] MFA Rules not processed for user `736a7588742742e5ab57503902970713`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:01.170128 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8a93995c-a97b-4ac8-ba77-22c64b1e8b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:01.312233 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 655/1330] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:01 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:01.351336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a13b10-0efb-44b5-9587-6d204f33b8cb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:01.352878 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e2a13b10-0efb-44b5-9587-6d204f33b8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:01.388352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:01.492740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a13b10-0efb-44b5-9587-6d204f33b8cb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:01.576071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220ad02-9b0b-4809-935a-d66863153f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:01.576708 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220ad02-9b0b-4809-935a-d66863153f63 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:01.576988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220ad02-9b0b-4809-935a-d66863153f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:01.577260 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220ad02-9b0b-4809-935a-d66863153f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:01.578989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a220ad02-9b0b-4809-935a-d66863153f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:01.663890 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:01.701996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220ad02-9b0b-4809-935a-d66863153f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:01.703433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220ad02-9b0b-4809-935a-d66863153f63 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:01.723395 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 676/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:11:01 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:04.026830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448063ba-bc7a-4efa-883e-2910a1def60a None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:04.027622 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448063ba-bc7a-4efa-883e-2910a1def60a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:04.027622 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448063ba-bc7a-4efa-883e-2910a1def60a None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:04.029167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 656/1332] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:04.034511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea30286-54ec-49b7-9a13-3322b7e272cc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:04.034980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea30286-54ec-49b7-9a13-3322b7e272cc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:04.035078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea30286-54ec-49b7-9a13-3322b7e272cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:04.104324 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-dea30286-54ec-49b7-9a13-3322b7e272cc None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:04.105535 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dea30286-54ec-49b7-9a13-3322b7e272cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:04.205580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 677/1333] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:04.243001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448063ba-bc7a-4efa-883e-2910a1def60a None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:04.244546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-448063ba-bc7a-4efa-883e-2910a1def60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:04.319618 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:04.356179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448063ba-bc7a-4efa-883e-2910a1def60a None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:04.434164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209368b-6818-4e44-bf3c-2aea673609cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:04.434762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209368b-6818-4e44-bf3c-2aea673609cd service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:04.435032 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209368b-6818-4e44-bf3c-2aea673609cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:04.435289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209368b-6818-4e44-bf3c-2aea673609cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:04.436882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9209368b-6818-4e44-bf3c-2aea673609cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:04.554159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209368b-6818-4e44-bf3c-2aea673609cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:04.555604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209368b-6818-4e44-bf3c-2aea673609cd service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:04.565613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:04.575062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 657/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:11:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:06.596570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1a227-f506-4bc3-ae2c-b8e12c66c00a None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:06.597358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1a227-f506-4bc3-ae2c-b8e12c66c00a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:06.597358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1a227-f506-4bc3-ae2c-b8e12c66c00a None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:06.599596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 678/1335] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:06.605110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9072f-f64d-4683-99c4-36e581585ff2 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:06.605564 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9072f-f64d-4683-99c4-36e581585ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:06.605677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9072f-f64d-4683-99c4-36e581585ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:06.675198 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-79f9072f-f64d-4683-99c4-36e581585ff2 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:06.676431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-79f9072f-f64d-4683-99c4-36e581585ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:06.776827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 658/1336] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:06.820740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1a227-f506-4bc3-ae2c-b8e12c66c00a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:06.822330 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-52d1a227-f506-4bc3-ae2c-b8e12c66c00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:06.864698 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:06.930738 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1a227-f506-4bc3-ae2c-b8e12c66c00a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:07.004820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a0150-c500-455d-a2ac-2da238fc88d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:07.005422 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a0150-c500-455d-a2ac-2da238fc88d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:07.005692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a0150-c500-455d-a2ac-2da238fc88d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:07.005982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a0150-c500-455d-a2ac-2da238fc88d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:07.007583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f17a0150-c500-455d-a2ac-2da238fc88d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:07.094148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:07.123267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a0150-c500-455d-a2ac-2da238fc88d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:07.125067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a0150-c500-455d-a2ac-2da238fc88d4 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:07.143392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 679/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:11:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:09.626010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fda2b6-7a5f-4d43-bd04-fb5ebdeb5c57 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:09.627059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fda2b6-7a5f-4d43-bd04-fb5ebdeb5c57 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:09.627059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fda2b6-7a5f-4d43-bd04-fb5ebdeb5c57 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:09.627925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 659/1338] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:09.633889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbb9db-6577-43ab-a7f2-ff871a648dba None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:09.634413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbb9db-6577-43ab-a7f2-ff871a648dba None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:09.634413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbb9db-6577-43ab-a7f2-ff871a648dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:09.712629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2acbb9db-6577-43ab-a7f2-ff871a648dba None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:09.713884 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2acbb9db-6577-43ab-a7f2-ff871a648dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:09.844140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 680/1339] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:09.889161 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fda2b6-7a5f-4d43-bd04-fb5ebdeb5c57 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:09.890797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-12fda2b6-7a5f-4d43-bd04-fb5ebdeb5c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:09.982285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:10.021340 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fda2b6-7a5f-4d43-bd04-fb5ebdeb5c57 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:10.117261 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749df90-5eae-481a-a6bf-a17e5f4b132e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:10.117788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749df90-5eae-481a-a6bf-a17e5f4b132e service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:10.118060 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749df90-5eae-481a-a6bf-a17e5f4b132e service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:10.118352 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749df90-5eae-481a-a6bf-a17e5f4b132e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:10.120071 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c749df90-5eae-481a-a6bf-a17e5f4b132e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:10.250487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749df90-5eae-481a-a6bf-a17e5f4b132e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:10.252258 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749df90-5eae-481a-a6bf-a17e5f4b132e service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:10.274984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 660/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:11:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:14.486833 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcf295-4652-4c18-9573-3814edac608b None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:14.487358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcf295-4652-4c18-9573-3814edac608b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:14.487358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcf295-4652-4c18-9573-3814edac608b None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:14.488771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 681/1341] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:14.494582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e97cb5-4bd8-4230-8e21-20bbabb38254 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:14.495031 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e97cb5-4bd8-4230-8e21-20bbabb38254 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:14.495206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e97cb5-4bd8-4230-8e21-20bbabb38254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:14.501275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:14.561158 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-94e97cb5-4bd8-4230-8e21-20bbabb38254 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:14.562393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-94e97cb5-4bd8-4230-8e21-20bbabb38254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:14.661242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 661/1342] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:11:14.700232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcf295-4652-4c18-9573-3814edac608b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:14.701821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dffcf295-4652-4c18-9573-3814edac608b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:14.756075 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:14.811429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcf295-4652-4c18-9573-3814edac608b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:14.885672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596dc0c-208e-4a3a-90ff-4d4801c0bee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:14.886275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596dc0c-208e-4a3a-90ff-4d4801c0bee1 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:14.886547 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596dc0c-208e-4a3a-90ff-4d4801c0bee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:14.886809 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596dc0c-208e-4a3a-90ff-4d4801c0bee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:14.888378 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0596dc0c-208e-4a3a-90ff-4d4801c0bee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:14.983097 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:15.001272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596dc0c-208e-4a3a-90ff-4d4801c0bee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:15.003127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596dc0c-208e-4a3a-90ff-4d4801c0bee1 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:15.023133 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 682/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:17.663975 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df661db-77c1-466e-94d6-098234f6d6c0 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:17.664622 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df661db-77c1-466e-94d6-098234f6d6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:17.664622 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df661db-77c1-466e-94d6-098234f6d6c0 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:17.665934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 662/1344] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:17.672082 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b134b-3a11-4620-8e01-917b99e6b42a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:17.672673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b134b-3a11-4620-8e01-917b99e6b42a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:17.672673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b134b-3a11-4620-8e01-917b99e6b42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:17.750101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-035b134b-3a11-4620-8e01-917b99e6b42a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:17.751247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-035b134b-3a11-4620-8e01-917b99e6b42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:17.854199 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 683/1345] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:17.891912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df661db-77c1-466e-94d6-098234f6d6c0 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:17.893485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7df661db-77c1-466e-94d6-098234f6d6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:17.988760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:18.008676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df661db-77c1-466e-94d6-098234f6d6c0 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:18.087182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69e77c-a53b-49c9-b69b-4d6caec09b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:18.087802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69e77c-a53b-49c9-b69b-4d6caec09b89 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:18.088070 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69e77c-a53b-49c9-b69b-4d6caec09b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:18.088331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69e77c-a53b-49c9-b69b-4d6caec09b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:18.090094 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8a69e77c-a53b-49c9-b69b-4d6caec09b89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:18.208331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69e77c-a53b-49c9-b69b-4d6caec09b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:18.209929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69e77c-a53b-49c9-b69b-4d6caec09b89 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:18.231612 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 663/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:11:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:22.295018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c633a-a03b-42ee-b803-43ce09666742 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:22.295585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c633a-a03b-42ee-b803-43ce09666742 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:22.295585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c633a-a03b-42ee-b803-43ce09666742 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:22.296983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 684/1347] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:22.302642 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b6180-9421-460e-a587-c437786a9689 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:22.303153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b6180-9421-460e-a587-c437786a9689 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:22.303264 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b6180-9421-460e-a587-c437786a9689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:22.319540 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:22.378127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-cc2b6180-9421-460e-a587-c437786a9689 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:22.379477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-cc2b6180-9421-460e-a587-c437786a9689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:22.509739 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 664/1348] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:22.556476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c633a-a03b-42ee-b803-43ce09666742 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:22.558226 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1a9c633a-a03b-42ee-b803-43ce09666742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:22.622731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:22.680327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c633a-a03b-42ee-b803-43ce09666742 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:22.761268 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d88cc-19d2-4999-8677-beb91e1d0630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:22.761924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d88cc-19d2-4999-8677-beb91e1d0630 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:22.762190 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d88cc-19d2-4999-8677-beb91e1d0630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:22.762456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d88cc-19d2-4999-8677-beb91e1d0630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:22.764776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b43d88cc-19d2-4999-8677-beb91e1d0630 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:22.895115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:22.899905 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d88cc-19d2-4999-8677-beb91e1d0630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:22.901363 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d88cc-19d2-4999-8677-beb91e1d0630 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:22.930589 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 685/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:27.954265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc90e2a-fcf1-455a-9ff3-ed721c35d74e None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:27.966059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc90e2a-fcf1-455a-9ff3-ed721c35d74e None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:27.966463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc90e2a-fcf1-455a-9ff3-ed721c35d74e None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:27.971602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 665/1350] 10.222.0.15 () {54 vars in 921 bytes} [Tue Aug 9 11:11:27 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:27.975531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021f49e-b234-40c4-b24c-0813ee714575 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:27.976015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021f49e-b234-40c4-b24c-0813ee714575 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:27.976109 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021f49e-b234-40c4-b24c-0813ee714575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:28.071948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4021f49e-b234-40c4-b24c-0813ee714575 None None] MFA Rules not processed for user `a587c410fd8741f3b3858d21b9e4884d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:28.073143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4021f49e-b234-40c4-b24c-0813ee714575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:28.207175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 686/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Aug 9 11:11:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:32.327732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b547d-57f4-4ac3-873b-0075c0393d21 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:32.327732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b547d-57f4-4ac3-873b-0075c0393d21 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:32.328382 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b547d-57f4-4ac3-873b-0075c0393d21 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:32.329426 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 666/1352] 10.222.0.15 () {54 vars in 921 bytes} [Tue Aug 9 11:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:32.334671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e85b3-b66c-423f-81aa-490bddfb45be None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:32.335177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e85b3-b66c-423f-81aa-490bddfb45be None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:32.335271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e85b3-b66c-423f-81aa-490bddfb45be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:32.390626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:32.416821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6d8e85b3-b66c-423f-81aa-490bddfb45be None None] MFA Rules not processed for user `a587c410fd8741f3b3858d21b9e4884d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:32.418096 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6d8e85b3-b66c-423f-81aa-490bddfb45be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:32.505106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=59 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:32.537334 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 687/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Aug 9 11:11:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:33.917380 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ea1bc-dc59-42ce-b766-4fa7f22dc023 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:33.918006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ea1bc-dc59-42ce-b766-4fa7f22dc023 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:33.918006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ea1bc-dc59-42ce-b766-4fa7f22dc023 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:33.919260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 667/1354] 10.222.0.15 () {54 vars in 921 bytes} [Tue Aug 9 11:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:33.924294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baeb62-75d3-415c-8c62-d7088c3e2c39 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:33.924780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baeb62-75d3-415c-8c62-d7088c3e2c39 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:33.925020 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baeb62-75d3-415c-8c62-d7088c3e2c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:34.007212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a2baeb62-75d3-415c-8c62-d7088c3e2c39 None None] MFA Rules not processed for user `a587c410fd8741f3b3858d21b9e4884d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:34.008435 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a2baeb62-75d3-415c-8c62-d7088c3e2c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:34.054846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:34.128509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 688/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Aug 9 11:11:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:37.499831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716ebc8-4f45-4172-a69d-38af76cd2ad6 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:37.500707 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716ebc8-4f45-4172-a69d-38af76cd2ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:37.501124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716ebc8-4f45-4172-a69d-38af76cd2ad6 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:37.505485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 668/1356] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:37.508179 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a424e71-5f78-47a6-9864-547278f863a5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:37.508651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a424e71-5f78-47a6-9864-547278f863a5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:37.508748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a424e71-5f78-47a6-9864-547278f863a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:37.588507 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5a424e71-5f78-47a6-9864-547278f863a5 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:37.590784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5a424e71-5f78-47a6-9864-547278f863a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:37.707149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 689/1357] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:37.760957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266f404-a1b2-483c-ab8e-7c3feceb67f4 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:37.761991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266f404-a1b2-483c-ab8e-7c3feceb67f4 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:37.762510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266f404-a1b2-483c-ab8e-7c3feceb67f4 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:37.764586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 669/1358] 10.222.0.15 () {54 vars in 962 bytes} [Tue Aug 9 11:11:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:37.774527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361db8b-2d6c-4dbd-a0b8-0f15d1723d4f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:37.775413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361db8b-2d6c-4dbd-a0b8-0f15d1723d4f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:37.775904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361db8b-2d6c-4dbd-a0b8-0f15d1723d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:37.795065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:37.865593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6361db8b-2d6c-4dbd-a0b8-0f15d1723d4f None None] MFA Rules not processed for user `881030d7605b40879762d1c199362ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:37.866920 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6361db8b-2d6c-4dbd-a0b8-0f15d1723d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:37.990697 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 690/1359] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Aug 9 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:37.998718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266f404-a1b2-483c-ab8e-7c3feceb67f4 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:38.000231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5266f404-a1b2-483c-ab8e-7c3feceb67f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:38.167179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266f404-a1b2-483c-ab8e-7c3feceb67f4 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:38.263011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:38.307315 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058490c-3f89-4b50-bddf-1c9b0c2f7243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:38.308120 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058490c-3f89-4b50-bddf-1c9b0c2f7243 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:38.308492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058490c-3f89-4b50-bddf-1c9b0c2f7243 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:38.308861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058490c-3f89-4b50-bddf-1c9b0c2f7243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:38.310666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b058490c-3f89-4b50-bddf-1c9b0c2f7243 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:38.412178 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058490c-3f89-4b50-bddf-1c9b0c2f7243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:38.414564 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058490c-3f89-4b50-bddf-1c9b0c2f7243 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:38.449651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 670/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:40.685052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d839b-bfcb-4327-bc6e-fe11a9c84c06 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:40.685600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d839b-bfcb-4327-bc6e-fe11a9c84c06 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:40.685600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d839b-bfcb-4327-bc6e-fe11a9c84c06 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:40.689781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 691/1361] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:40.692346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e34cc4-9f76-4050-a695-2acc203e8d36 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:40.692783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e34cc4-9f76-4050-a695-2acc203e8d36 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:40.692897 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e34cc4-9f76-4050-a695-2acc203e8d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:40.769890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-e2e34cc4-9f76-4050-a695-2acc203e8d36 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:40.771116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e2e34cc4-9f76-4050-a695-2acc203e8d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:40.811354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:40.886860 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 671/1362] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:40.933305 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d839b-bfcb-4327-bc6e-fe11a9c84c06 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:40.934931 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6d3d839b-bfcb-4327-bc6e-fe11a9c84c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:41.006501 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:41.103514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d839b-bfcb-4327-bc6e-fe11a9c84c06 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:41.243208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcd1a8-84f8-491c-ac73-88b3e4074778 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:41.243820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcd1a8-84f8-491c-ac73-88b3e4074778 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:41.244088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcd1a8-84f8-491c-ac73-88b3e4074778 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:41.244352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcd1a8-84f8-491c-ac73-88b3e4074778 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:41.245976 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a3bcd1a8-84f8-491c-ac73-88b3e4074778 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:41.271220 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:41.358005 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcd1a8-84f8-491c-ac73-88b3e4074778 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:41.360971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcd1a8-84f8-491c-ac73-88b3e4074778 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:41.394651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 692/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:43.789604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099ef33-0fbd-4780-8315-e32d704114ee None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:43.790504 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099ef33-0fbd-4780-8315-e32d704114ee None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:43.790504 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099ef33-0fbd-4780-8315-e32d704114ee None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:43.795620 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 672/1364] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:43.798167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ada5d4-a684-4847-825a-7d7b74d40d7c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:43.798692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ada5d4-a684-4847-825a-7d7b74d40d7c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:43.798692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ada5d4-a684-4847-825a-7d7b74d40d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:43.907030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-15ada5d4-a684-4847-825a-7d7b74d40d7c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:43.909203 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-15ada5d4-a684-4847-825a-7d7b74d40d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:44.097292 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:44.108287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 693/1365] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:11:44.156440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa92c96-8019-4647-8b8c-0d7453aa725d None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:44.156927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa92c96-8019-4647-8b8c-0d7453aa725d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:44.157431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa92c96-8019-4647-8b8c-0d7453aa725d None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:44.160283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 673/1366] 10.222.0.15 () {54 vars in 962 bytes} [Tue Aug 9 11:11:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:44.166348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9acf87-4c4b-4658-a601-ee78e4de808f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:44.166749 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9acf87-4c4b-4658-a601-ee78e4de808f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:44.167127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9acf87-4c4b-4658-a601-ee78e4de808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:44.259688 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0f9acf87-4c4b-4658-a601-ee78e4de808f None None] MFA Rules not processed for user `881030d7605b40879762d1c199362ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:44.261066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0f9acf87-4c4b-4658-a601-ee78e4de808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:44.413818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 694/1367] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Aug 9 11:11:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:11:44.422672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa92c96-8019-4647-8b8c-0d7453aa725d None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:44.424375 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-cfa92c96-8019-4647-8b8c-0d7453aa725d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:44.615688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa92c96-8019-4647-8b8c-0d7453aa725d None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:44.640667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:44.753305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3540d95-ffe6-4ade-81c8-8d1b3bd41cea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:44.753998 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540d95-ffe6-4ade-81c8-8d1b3bd41cea service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:44.754357 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540d95-ffe6-4ade-81c8-8d1b3bd41cea service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:44.754735 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540d95-ffe6-4ade-81c8-8d1b3bd41cea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:44.756731 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e3540d95-ffe6-4ade-81c8-8d1b3bd41cea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:44.877787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3540d95-ffe6-4ade-81c8-8d1b3bd41cea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:44.879619 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3540d95-ffe6-4ade-81c8-8d1b3bd41cea service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:44.900397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 674/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:11:46.574588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17defc5-5586-443c-bbe1-8747117f7b29 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:46.575370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17defc5-5586-443c-bbe1-8747117f7b29 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:46.575370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17defc5-5586-443c-bbe1-8747117f7b29 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:46.576766 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 695/1369] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:11:46.582799 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6b0c7-ff21-4cd7-a855-f3f32b0e0cbc None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:46.583560 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6b0c7-ff21-4cd7-a855-f3f32b0e0cbc None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:46.583560 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6b0c7-ff21-4cd7-a855-f3f32b0e0cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:46.616046 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:46.655518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-2bc6b0c7-ff21-4cd7-a855-f3f32b0e0cbc None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:46.656738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2bc6b0c7-ff21-4cd7-a855-f3f32b0e0cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:46.770182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 675/1370] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:11:47.130946 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2745189-78f6-4220-87a3-18b88e19dcf4 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:47.131319 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2745189-78f6-4220-87a3-18b88e19dcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:47.131553 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2745189-78f6-4220-87a3-18b88e19dcf4 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:47.133758 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 696/1371] 10.222.0.15 () {54 vars in 964 bytes} [Tue Aug 9 11:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:47.139437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4decd-5334-4289-b4ba-58153ff75ab7 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:47.139844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4decd-5334-4289-b4ba-58153ff75ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:47.140270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4decd-5334-4289-b4ba-58153ff75ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:47.239914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-33c4decd-5334-4289-b4ba-58153ff75ab7 None None] MFA Rules not processed for user `097822b9d7954dd0b27e9f650b6e36f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:47.241195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-33c4decd-5334-4289-b4ba-58153ff75ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:47.302743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:47.343175 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 676/1372] 10.222.0.15 () {58 vars in 1061 bytes} [Tue Aug 9 11:11:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:47.351294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2745189-78f6-4220-87a3-18b88e19dcf4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:47.353062 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d2745189-78f6-4220-87a3-18b88e19dcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:47.418169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:47.485755 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2745189-78f6-4220-87a3-18b88e19dcf4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:47.580825 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50438231-b86e-4827-8095-fbd8c303ca2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:47.583361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50438231-b86e-4827-8095-fbd8c303ca2b service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:47.583906 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50438231-b86e-4827-8095-fbd8c303ca2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:47.584685 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50438231-b86e-4827-8095-fbd8c303ca2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:47.588233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-50438231-b86e-4827-8095-fbd8c303ca2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:47.773262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:47.783120 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bed14-2535-4ec2-9544-d0b46fe2a9c6 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:47.784032 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bed14-2535-4ec2-9544-d0b46fe2a9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:47.784032 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bed14-2535-4ec2-9544-d0b46fe2a9c6 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:47.786152 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 677/1373] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:11:47.789882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50438231-b86e-4827-8095-fbd8c303ca2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:47.791448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50438231-b86e-4827-8095-fbd8c303ca2b service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:47.792234 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4d54e-c1b3-4c2a-ada5-0c7e3a93d17a None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:47.793227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4d54e-c1b3-4c2a-ada5-0c7e3a93d17a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:47.793565 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4d54e-c1b3-4c2a-ada5-0c7e3a93d17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:47.812938 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 697/1374] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:47.873823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-6cf4d54e-c1b3-4c2a-ada5-0c7e3a93d17a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:47.875146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6cf4d54e-c1b3-4c2a-ada5-0c7e3a93d17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:48.019726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 678/1375] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:48.086325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50438231-b86e-4827-8095-fbd8c303ca2b service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:48.087807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-50438231-b86e-4827-8095-fbd8c303ca2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:48.214203 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50438231-b86e-4827-8095-fbd8c303ca2b service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:48.377332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:48.401179 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ea7c4-e215-4cd0-81e1-ecc89a5186b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:48.402261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ea7c4-e215-4cd0-81e1-ecc89a5186b2 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:48.402733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ea7c4-e215-4cd0-81e1-ecc89a5186b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:48.403206 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ea7c4-e215-4cd0-81e1-ecc89a5186b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:48.406554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-639ea7c4-e215-4cd0-81e1-ecc89a5186b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:48.555532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ea7c4-e215-4cd0-81e1-ecc89a5186b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:48.557208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ea7c4-e215-4cd0-81e1-ecc89a5186b2 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:48.579599 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 698/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:50.734472 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d5cc4-9ff2-4644-885f-484c29f1663d None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:50.735016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d5cc4-9ff2-4644-885f-484c29f1663d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:50.735016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d5cc4-9ff2-4644-885f-484c29f1663d None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:50.736374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 679/1377] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:50.742338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391381-47f0-4ea4-b6f8-462e02153488 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:50.742859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391381-47f0-4ea4-b6f8-462e02153488 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:50.742859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391381-47f0-4ea4-b6f8-462e02153488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:50.817188 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-23391381-47f0-4ea4-b6f8-462e02153488 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:50.818559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-23391381-47f0-4ea4-b6f8-462e02153488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:50.900860 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:50.959784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 699/1378] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:51.007213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d5cc4-9ff2-4644-885f-484c29f1663d None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:51.009250 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f81d5cc4-9ff2-4644-885f-484c29f1663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:51.073366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:51.184360 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d5cc4-9ff2-4644-885f-484c29f1663d None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:51.332921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22262d-cb7b-4e45-a905-7db285c88591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:51.333525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22262d-cb7b-4e45-a905-7db285c88591 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:51.333822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22262d-cb7b-4e45-a905-7db285c88591 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:51.334333 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22262d-cb7b-4e45-a905-7db285c88591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:51.336396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9c22262d-cb7b-4e45-a905-7db285c88591 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:51.367218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:51.487446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22262d-cb7b-4e45-a905-7db285c88591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:51.489498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22262d-cb7b-4e45-a905-7db285c88591 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:51.516193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 680/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:53.628897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2d798-b897-4f60-9c59-dcd54518b147 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:53.630009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2d798-b897-4f60-9c59-dcd54518b147 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:53.630009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2d798-b897-4f60-9c59-dcd54518b147 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:53.631303 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 700/1380] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:11:53.637029 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086445f-22ff-42bc-af05-d3cc83217960 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:53.637667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086445f-22ff-42bc-af05-d3cc83217960 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:53.637667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086445f-22ff-42bc-af05-d3cc83217960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:53.724515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-8086445f-22ff-42bc-af05-d3cc83217960 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:53.725734 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8086445f-22ff-42bc-af05-d3cc83217960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:53.829174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:53.843398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 681/1381] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:11:53.888043 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2d798-b897-4f60-9c59-dcd54518b147 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:53.889541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-78e2d798-b897-4f60-9c59-dcd54518b147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:54.061355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2d798-b897-4f60-9c59-dcd54518b147 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:54.118921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:54.204741 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6074b-8dc0-4c75-b9d7-35f0f1065b13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:54.205592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6074b-8dc0-4c75-b9d7-35f0f1065b13 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:54.205988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6074b-8dc0-4c75-b9d7-35f0f1065b13 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:54.206367 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6074b-8dc0-4c75-b9d7-35f0f1065b13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:54.208448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5eb6074b-8dc0-4c75-b9d7-35f0f1065b13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:54.330605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6074b-8dc0-4c75-b9d7-35f0f1065b13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:54.332870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6074b-8dc0-4c75-b9d7-35f0f1065b13 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:54.354753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 701/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:56.510551 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f1e71-5b43-47d5-a55a-a2c3b18cebfd None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:56.511339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f1e71-5b43-47d5-a55a-a2c3b18cebfd None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:56.511990 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f1e71-5b43-47d5-a55a-a2c3b18cebfd None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:56.515733 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 682/1383] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:56.521826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dc7c7-822d-4114-8daf-99699d99c982 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:56.522387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dc7c7-822d-4114-8daf-99699d99c982 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:56.522387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dc7c7-822d-4114-8daf-99699d99c982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:56.606546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-934dc7c7-822d-4114-8daf-99699d99c982 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:56.607893 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-934dc7c7-822d-4114-8daf-99699d99c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:56.610411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:56.749557 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 702/1384] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:11:56.810947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f1e71-5b43-47d5-a55a-a2c3b18cebfd None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:11:56.813167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e15f1e71-5b43-47d5-a55a-a2c3b18cebfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:57.047005 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f1e71-5b43-47d5-a55a-a2c3b18cebfd None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:11:57.142616 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:11:57.218509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a888b41-a179-45ae-b0cf-c94173de2f06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:11:57.219172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a888b41-a179-45ae-b0cf-c94173de2f06 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:57.219434 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a888b41-a179-45ae-b0cf-c94173de2f06 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:57.219701 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a888b41-a179-45ae-b0cf-c94173de2f06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:57.221466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6a888b41-a179-45ae-b0cf-c94173de2f06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:57.338513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a888b41-a179-45ae-b0cf-c94173de2f06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:11:57.341215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a888b41-a179-45ae-b0cf-c94173de2f06 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:11:57.368224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 683/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:11:59.763340 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43650ef-15da-4c84-806e-ad17b563cba1 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:59.764120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43650ef-15da-4c84-806e-ad17b563cba1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:59.764120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43650ef-15da-4c84-806e-ad17b563cba1 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:59.765543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 703/1386] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:11:59.771530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f57981-29e8-45e3-adc2-c59a55c59e06 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:11:59.772051 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f57981-29e8-45e3-adc2-c59a55c59e06 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:11:59.772051 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f57981-29e8-45e3-adc2-c59a55c59e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:11:59.855812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-b9f57981-29e8-45e3-adc2-c59a55c59e06 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:11:59.857466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b9f57981-29e8-45e3-adc2-c59a55c59e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:11:59.894582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:00.004644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 684/1387] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:00.064962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43650ef-15da-4c84-806e-ad17b563cba1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:00.067051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f43650ef-15da-4c84-806e-ad17b563cba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:00.310200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:00.350754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43650ef-15da-4c84-806e-ad17b563cba1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:00.524287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033b732-a727-48ac-a363-3b4a24636cb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:00.524933 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033b732-a727-48ac-a363-3b4a24636cb5 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:00.525221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033b732-a727-48ac-a363-3b4a24636cb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:00.525488 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033b732-a727-48ac-a363-3b4a24636cb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:00.527251 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8033b732-a727-48ac-a363-3b4a24636cb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:00.693981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033b732-a727-48ac-a363-3b4a24636cb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:00.696591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033b732-a727-48ac-a363-3b4a24636cb5 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:00.706817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:00.729986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 704/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:03.076078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05299956-4a41-455a-a7e6-7b8c6522e257 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.076946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05299956-4a41-455a-a7e6-7b8c6522e257 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.076946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05299956-4a41-455a-a7e6-7b8c6522e257 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.078493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 685/1389] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:03.085055 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7d658-e09e-4fd2-8a00-875b93c26eb4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.085930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7d658-e09e-4fd2-8a00-875b93c26eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.085930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7d658-e09e-4fd2-8a00-875b93c26eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.188406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-75f7d658-e09e-4fd2-8a00-875b93c26eb4 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:03.189790 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-75f7d658-e09e-4fd2-8a00-875b93c26eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:03.352008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325cda0-897d-4b41-a1cf-e1c0c167f150 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.352266 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325cda0-897d-4b41-a1cf-e1c0c167f150 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.352439 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325cda0-897d-4b41-a1cf-e1c0c167f150 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.353864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 686/1390] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:03.358925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 705/1391] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:03.359597 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a641b2-cbc2-4dd0-9d04-a7cb3b400e02 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.359944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a641b2-cbc2-4dd0-9d04-a7cb3b400e02 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.360220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a641b2-cbc2-4dd0-9d04-a7cb3b400e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.410521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7d658-e09e-4fd2-8a00-875b93c26eb4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:03.412344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-75f7d658-e09e-4fd2-8a00-875b93c26eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:03.447886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-c2a641b2-cbc2-4dd0-9d04-a7cb3b400e02 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:03.449406 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c2a641b2-cbc2-4dd0-9d04-a7cb3b400e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:03.506950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:03.569237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7d658-e09e-4fd2-8a00-875b93c26eb4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:03.591450 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 687/1392] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:03.689494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fc0ec-6b52-41fe-99b5-f33a6c9d9ea3 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.689955 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fc0ec-6b52-41fe-99b5-f33a6c9d9ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.690314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fc0ec-6b52-41fe-99b5-f33a6c9d9ea3 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.692646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 688/1393] 10.222.0.15 () {54 vars in 967 bytes} [Tue Aug 9 11:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:03.699345 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bd38a-4441-4623-b99a-124db79ee638 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.699646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bd38a-4441-4623-b99a-124db79ee638 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.699886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bd38a-4441-4623-b99a-124db79ee638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.710524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:03.719906 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3484b0-1f26-47c1-9e16-a4195be4d903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:03.720530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3484b0-1f26-47c1-9e16-a4195be4d903 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:03.720806 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3484b0-1f26-47c1-9e16-a4195be4d903 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:03.721075 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3484b0-1f26-47c1-9e16-a4195be4d903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:03.722801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cf3484b0-1f26-47c1-9e16-a4195be4d903 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:03.824831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:03.831623 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-ea4bd38a-4441-4623-b99a-124db79ee638 None None] MFA Rules not processed for user `5356835ef79c458bbfa7d6adafd0cb36`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:03.832948 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ea4bd38a-4441-4623-b99a-124db79ee638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:03.860026 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3484b0-1f26-47c1-9e16-a4195be4d903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:03.863036 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3484b0-1f26-47c1-9e16-a4195be4d903 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:03.891306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 706/1394] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:12:03.960975 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 689/1395] 10.222.0.15 () {58 vars in 1064 bytes} [Tue Aug 9 11:12:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:03.970143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3484b0-1f26-47c1-9e16-a4195be4d903 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:03.971480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cf3484b0-1f26-47c1-9e16-a4195be4d903 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:04.068904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3484b0-1f26-47c1-9e16-a4195be4d903 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:04.184879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1156801-cb70-46a2-a69b-8b0626dcb52e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5356835ef79c458bbfa7d6adafd0cb36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:04.185869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1156801-cb70-46a2-a69b-8b0626dcb52e service glance] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:04.186416 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1156801-cb70-46a2-a69b-8b0626dcb52e service glance] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:04.186702 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1156801-cb70-46a2-a69b-8b0626dcb52e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:04.188397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a1156801-cb70-46a2-a69b-8b0626dcb52e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:04.243732 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:04.314159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1156801-cb70-46a2-a69b-8b0626dcb52e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:04.315834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1156801-cb70-46a2-a69b-8b0626dcb52e service glance] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:04.337758 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 707/1396] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:05.146289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0708ec4-d77e-4b81-8261-c2b4ecb6fc14 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:05.147159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0708ec4-d77e-4b81-8261-c2b4ecb6fc14 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:05.147159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0708ec4-d77e-4b81-8261-c2b4ecb6fc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:05.235235 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-b0708ec4-d77e-4b81-8261-c2b4ecb6fc14 None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:05.236726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b0708ec4-d77e-4b81-8261-c2b4ecb6fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:05.317989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:05.381408 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 690/1397] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Aug 9 11:12:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:12:05.436583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364a74f-77ba-4a1f-ae27-af7854d9f608 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:05.437403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364a74f-77ba-4a1f-ae27-af7854d9f608 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:05.437403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364a74f-77ba-4a1f-ae27-af7854d9f608 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:05.439354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 708/1398] 10.222.0.15 () {54 vars in 943 bytes} [Tue Aug 9 11:12:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:05.448226 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff5c2d-3da5-4987-b471-136b08b4efa5 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:05.448797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff5c2d-3da5-4987-b471-136b08b4efa5 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:05.449445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff5c2d-3da5-4987-b471-136b08b4efa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:05.603019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-bfff5c2d-3da5-4987-b471-136b08b4efa5 None None] MFA Rules not processed for user `557b8757098e4777965d782d1ce5f97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:05.605130 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-bfff5c2d-3da5-4987-b471-136b08b4efa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:05.825440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 691/1399] 10.222.0.15 () {58 vars in 1040 bytes} [Tue Aug 9 11:12:05 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:05.841229 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364a74f-77ba-4a1f-ae27-af7854d9f608 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:05.844019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4364a74f-77ba-4a1f-ae27-af7854d9f608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:06.065888 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364a74f-77ba-4a1f-ae27-af7854d9f608 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:06.089695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:06.210215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee91851-7c71-464b-b683-e46d6e5b48db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:06.210944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee91851-7c71-464b-b683-e46d6e5b48db service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:06.211325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee91851-7c71-464b-b683-e46d6e5b48db service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:06.211703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee91851-7c71-464b-b683-e46d6e5b48db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:06.213860 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4ee91851-7c71-464b-b683-e46d6e5b48db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:06.339337 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee91851-7c71-464b-b683-e46d6e5b48db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:06.342611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee91851-7c71-464b-b683-e46d6e5b48db service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:06.358755 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 709/1400] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:12:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:12:06.482080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf48806-098d-42b6-b7dd-b35e3df522d0 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:06.499323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf48806-098d-42b6-b7dd-b35e3df522d0 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:06.499323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf48806-098d-42b6-b7dd-b35e3df522d0 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:06.499323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 692/1401] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:12:06 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:06.505104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553ad60-617f-470c-9891-3741d8f5d91b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:06.506026 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553ad60-617f-470c-9891-3741d8f5d91b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:06.507024 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553ad60-617f-470c-9891-3741d8f5d91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:06.602799 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:06.611826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d553ad60-617f-470c-9891-3741d8f5d91b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:06.613058 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d553ad60-617f-470c-9891-3741d8f5d91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:06.760413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 710/1402] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:06.809439 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf48806-098d-42b6-b7dd-b35e3df522d0 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:06.811729 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-abf48806-098d-42b6-b7dd-b35e3df522d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:06.845556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:07.075154 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf48806-098d-42b6-b7dd-b35e3df522d0 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:07.239670 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:07.283318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e8638-0931-4d58-99eb-90d4b591dcc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:07.284328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e8638-0931-4d58-99eb-90d4b591dcc8 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:07.284746 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e8638-0931-4d58-99eb-90d4b591dcc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:07.285225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e8638-0931-4d58-99eb-90d4b591dcc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:07.288149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-041e8638-0931-4d58-99eb-90d4b591dcc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:07.427977 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e8638-0931-4d58-99eb-90d4b591dcc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:07.430954 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e8638-0931-4d58-99eb-90d4b591dcc8 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:07.453281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 693/1403] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:10.360100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff1ebf-180a-4bb4-a675-17b929c06d5a None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:10.360902 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff1ebf-180a-4bb4-a675-17b929c06d5a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:10.361037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff1ebf-180a-4bb4-a675-17b929c06d5a None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:10.363535 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 711/1404] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:12:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:10.372802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f08ee-6398-4d8b-abb5-a5ce2e4887cc None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:10.373916 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f08ee-6398-4d8b-abb5-a5ce2e4887cc None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:10.374262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f08ee-6398-4d8b-abb5-a5ce2e4887cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:10.527296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-881f08ee-6398-4d8b-abb5-a5ce2e4887cc None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:10.529414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-881f08ee-6398-4d8b-abb5-a5ce2e4887cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:10.697460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:10.748979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 694/1405] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:10.805051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff1ebf-180a-4bb4-a675-17b929c06d5a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:10.806792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a7ff1ebf-180a-4bb4-a675-17b929c06d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:10.968094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:11.009053 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff1ebf-180a-4bb4-a675-17b929c06d5a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:11.218875 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4a463-ada4-4a9d-93ae-e6495af04000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:11.220661 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4a463-ada4-4a9d-93ae-e6495af04000 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:11.221041 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4a463-ada4-4a9d-93ae-e6495af04000 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:11.221372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4a463-ada4-4a9d-93ae-e6495af04000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:11.224229 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2fd4a463-ada4-4a9d-93ae-e6495af04000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:11.360598 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:11.364148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4a463-ada4-4a9d-93ae-e6495af04000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:11.365972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4a463-ada4-4a9d-93ae-e6495af04000 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:11.397947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 712/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:13.517996 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e65e1-a332-4f2f-ae15-887f74916777 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:13.518933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e65e1-a332-4f2f-ae15-887f74916777 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:13.518933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e65e1-a332-4f2f-ae15-887f74916777 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:13.521245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 695/1407] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:12:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:13.526943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1d3a8-136d-4a21-9228-134faca5c652 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:13.527787 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1d3a8-136d-4a21-9228-134faca5c652 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:13.527787 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1d3a8-136d-4a21-9228-134faca5c652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:13.613318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4cc1d3a8-136d-4a21-9228-134faca5c652 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:13.614607 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4cc1d3a8-136d-4a21-9228-134faca5c652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:13.772224 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 713/1408] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:13.849133 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e65e1-a332-4f2f-ae15-887f74916777 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:13.851200 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d91e65e1-a332-4f2f-ae15-887f74916777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:14.121736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e65e1-a332-4f2f-ae15-887f74916777 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:14.203602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:14.311530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301664d7-3dc6-4f14-bb26-11cd4378c064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:14.312267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301664d7-3dc6-4f14-bb26-11cd4378c064 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:14.312613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301664d7-3dc6-4f14-bb26-11cd4378c064 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:14.312932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301664d7-3dc6-4f14-bb26-11cd4378c064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:14.314658 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-301664d7-3dc6-4f14-bb26-11cd4378c064 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:14.434143 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301664d7-3dc6-4f14-bb26-11cd4378c064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:14.435786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301664d7-3dc6-4f14-bb26-11cd4378c064 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:14.462697 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 696/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:23.770134 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=71 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:24.459549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=79 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:30.009063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53817d32-3838-4408-b788-5e3e036f7a9e None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:30.009739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53817d32-3838-4408-b788-5e3e036f7a9e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:30.009739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53817d32-3838-4408-b788-5e3e036f7a9e None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:30.011384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 714/1410] 10.222.0.15 () {54 vars in 918 bytes} [Tue Aug 9 11:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:30.017354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4921f-83e2-4d17-b6a0-01d8d29d4b0d None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:30.017974 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4921f-83e2-4d17-b6a0-01d8d29d4b0d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:30.017974 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4921f-83e2-4d17-b6a0-01d8d29d4b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:30.110008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-c1c4921f-83e2-4d17-b6a0-01d8d29d4b0d None None] MFA Rules not processed for user `a587c410fd8741f3b3858d21b9e4884d`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:30.112151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c1c4921f-83e2-4d17-b6a0-01d8d29d4b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:30.284585 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 697/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Aug 9 11:12:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:30.301363 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0ce1b-4b07-485d-a24a-bdae663b58ee None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:30.301770 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0ce1b-4b07-485d-a24a-bdae663b58ee None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:30.302116 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0ce1b-4b07-485d-a24a-bdae663b58ee None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:30.303710 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 715/1412] 10.222.0.15 () {54 vars in 918 bytes} [Tue Aug 9 11:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:30.309559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36293930-f277-4438-9f79-0ab7c858644c None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:30.309978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36293930-f277-4438-9f79-0ab7c858644c None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:30.310292 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36293930-f277-4438-9f79-0ab7c858644c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:30.395834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:30.399874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-36293930-f277-4438-9f79-0ab7c858644c None None] MFA Rules not processed for user `881030d7605b40879762d1c199362ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:30.401889 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-36293930-f277-4438-9f79-0ab7c858644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:30.536934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 698/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Aug 9 11:12:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:33.189994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba07f50-4dd3-4b0d-a94e-81cff05ac033 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:33.190644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba07f50-4dd3-4b0d-a94e-81cff05ac033 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:33.190644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba07f50-4dd3-4b0d-a94e-81cff05ac033 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:33.192080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:33.198994 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28aba2-39a2-43c8-bac1-95ef098ace7e None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:33.199626 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28aba2-39a2-43c8-bac1-95ef098ace7e None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:33.199751 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28aba2-39a2-43c8-bac1-95ef098ace7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:33.283015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-ec28aba2-39a2-43c8-bac1-95ef098ace7e None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:33.284299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ec28aba2-39a2-43c8-bac1-95ef098ace7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:33.348237 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:33.398582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:33.443509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba07f50-4dd3-4b0d-a94e-81cff05ac033 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:33.445045 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6ba07f50-4dd3-4b0d-a94e-81cff05ac033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:33.648800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba07f50-4dd3-4b0d-a94e-81cff05ac033 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:33.735594 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:33.785152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc09ba-5df4-4130-bcf2-ad36c041d320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:33.785841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc09ba-5df4-4130-bcf2-ad36c041d320 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:33.786136 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc09ba-5df4-4130-bcf2-ad36c041d320 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:33.786477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc09ba-5df4-4130-bcf2-ad36c041d320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:33.788188 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-83cc09ba-5df4-4130-bcf2-ad36c041d320 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:33.893371 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc09ba-5df4-4130-bcf2-ad36c041d320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:33.895050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc09ba-5df4-4130-bcf2-ad36c041d320 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:33.916438 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 717/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:34.872991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070005f-d6e7-4e60-a373-8d29fe8257f7 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:34.873913 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070005f-d6e7-4e60-a373-8d29fe8257f7 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:34.873913 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070005f-d6e7-4e60-a373-8d29fe8257f7 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:34.875470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:34.881170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a730f87-f263-46ad-83ec-c272760451a0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:34.881781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a730f87-f263-46ad-83ec-c272760451a0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:34.881781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a730f87-f263-46ad-83ec-c272760451a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:34.965983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3a730f87-f263-46ad-83ec-c272760451a0 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:34.967363 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3a730f87-f263-46ad-83ec-c272760451a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:34.997156 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:35.072513 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:35.226533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070005f-d6e7-4e60-a373-8d29fe8257f7 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:35.228025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b070005f-d6e7-4e60-a373-8d29fe8257f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:35.433755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070005f-d6e7-4e60-a373-8d29fe8257f7 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:35.484667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:35.559736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec2695-32b8-4dd4-9fac-6d58838c3fad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:35.560497 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec2695-32b8-4dd4-9fac-6d58838c3fad service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:35.560873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec2695-32b8-4dd4-9fac-6d58838c3fad service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:35.561227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec2695-32b8-4dd4-9fac-6d58838c3fad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:35.563056 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-46ec2695-32b8-4dd4-9fac-6d58838c3fad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:35.666043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec2695-32b8-4dd4-9fac-6d58838c3fad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:35.667734 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec2695-32b8-4dd4-9fac-6d58838c3fad service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:35.689282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 701/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:36.609305 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27529e30-f45c-4112-8082-f5fcc5e4a6c0 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:36.609947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27529e30-f45c-4112-8082-f5fcc5e4a6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:36.609947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27529e30-f45c-4112-8082-f5fcc5e4a6c0 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:36.611472 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:36.617580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d5935-06c3-49df-ad91-ecbd4e0e25c3 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:36.618244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d5935-06c3-49df-ad91-ecbd4e0e25c3 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:36.618244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d5935-06c3-49df-ad91-ecbd4e0e25c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:36.682743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:36.714412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-f18d5935-06c3-49df-ad91-ecbd4e0e25c3 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:36.715660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f18d5935-06c3-49df-ad91-ecbd4e0e25c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:36.826311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:36.979346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27529e30-f45c-4112-8082-f5fcc5e4a6c0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:36.981077 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-27529e30-f45c-4112-8082-f5fcc5e4a6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:37.174423 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27529e30-f45c-4112-8082-f5fcc5e4a6c0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:37.189273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:37.303718 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c99351-71cd-48b4-8266-b357cb64921f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:37.304357 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c99351-71cd-48b4-8266-b357cb64921f service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:37.304633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c99351-71cd-48b4-8266-b357cb64921f service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:37.304898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c99351-71cd-48b4-8266-b357cb64921f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:37.306603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a7c99351-71cd-48b4-8266-b357cb64921f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:37.429775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c99351-71cd-48b4-8266-b357cb64921f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:37.431298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c99351-71cd-48b4-8266-b357cb64921f service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:37.451530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 720/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:38.354684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e207b9f-7262-487b-b25a-2a9fc5458fe5 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:38.355312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e207b9f-7262-487b-b25a-2a9fc5458fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:38.355312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e207b9f-7262-487b-b25a-2a9fc5458fe5 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:38.356603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:38.362779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb254b9-7ae4-40af-9afd-d2cf9874d4d0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:38.363582 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb254b9-7ae4-40af-9afd-d2cf9874d4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:38.363582 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb254b9-7ae4-40af-9afd-d2cf9874d4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:38.389887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:38.464957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6cb254b9-7ae4-40af-9afd-d2cf9874d4d0 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:38.466328 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6cb254b9-7ae4-40af-9afd-d2cf9874d4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:38.579564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:38.731826 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e207b9f-7262-487b-b25a-2a9fc5458fe5 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:38.733424 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-4e207b9f-7262-487b-b25a-2a9fc5458fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:38.860460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:38.903363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e207b9f-7262-487b-b25a-2a9fc5458fe5 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:39.035854 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03daf378-b87b-4b7e-9543-1de4eaf6b3e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:39.036501 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03daf378-b87b-4b7e-9543-1de4eaf6b3e4 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:39.036771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03daf378-b87b-4b7e-9543-1de4eaf6b3e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:39.037034 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03daf378-b87b-4b7e-9543-1de4eaf6b3e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:39.038808 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-03daf378-b87b-4b7e-9543-1de4eaf6b3e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:39.128793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:39.150547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03daf378-b87b-4b7e-9543-1de4eaf6b3e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:39.154126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03daf378-b87b-4b7e-9543-1de4eaf6b3e4 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:39.177849 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 704/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:40.096442 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822418f-18d1-4513-8ce2-ecf2dd7167fa None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:40.097344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822418f-18d1-4513-8ce2-ecf2dd7167fa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:40.097344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822418f-18d1-4513-8ce2-ecf2dd7167fa None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:40.098903 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:40.104915 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b63c2e-676e-4e0c-9e32-2bfbcd48340d None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:40.105523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b63c2e-676e-4e0c-9e32-2bfbcd48340d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:40.105523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b63c2e-676e-4e0c-9e32-2bfbcd48340d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:40.199459 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-d4b63c2e-676e-4e0c-9e32-2bfbcd48340d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:40.200764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d4b63c2e-676e-4e0c-9e32-2bfbcd48340d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:40.319894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:40.471885 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822418f-18d1-4513-8ce2-ecf2dd7167fa None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:40.473418 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5822418f-18d1-4513-8ce2-ecf2dd7167fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:40.574148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:40.656375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822418f-18d1-4513-8ce2-ecf2dd7167fa None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:40.827559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe084f4-5b8b-46dd-98f7-11f3648e924a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:40.828624 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe084f4-5b8b-46dd-98f7-11f3648e924a service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:40.829114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe084f4-5b8b-46dd-98f7-11f3648e924a service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:40.829593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe084f4-5b8b-46dd-98f7-11f3648e924a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:40.832922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-abe084f4-5b8b-46dd-98f7-11f3648e924a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:40.892110 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:40.941158 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe084f4-5b8b-46dd-98f7-11f3648e924a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:40.942874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe084f4-5b8b-46dd-98f7-11f3648e924a service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:40.963778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 723/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:41.825563 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74128e2-9054-4c33-bb23-d1a3b1ad0dfa None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:41.826404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74128e2-9054-4c33-bb23-d1a3b1ad0dfa None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:41.826546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74128e2-9054-4c33-bb23-d1a3b1ad0dfa None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:41.827910 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:41.834506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4ef75-b317-4988-84cc-27e50bba87cc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:41.835344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4ef75-b317-4988-84cc-27e50bba87cc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:41.835344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4ef75-b317-4988-84cc-27e50bba87cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:41.924585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7af4ef75-b317-4988-84cc-27e50bba87cc None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:41.925951 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7af4ef75-b317-4988-84cc-27e50bba87cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:42.051819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:12:42.202334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74128e2-9054-4c33-bb23-d1a3b1ad0dfa None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:42.203781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d74128e2-9054-4c33-bb23-d1a3b1ad0dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:42.258724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:42.364708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74128e2-9054-4c33-bb23-d1a3b1ad0dfa None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:42.502474 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab79dc-6547-4d2a-8dc4-cc9ebc1edc24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:42.503474 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab79dc-6547-4d2a-8dc4-cc9ebc1edc24 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:42.503923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab79dc-6547-4d2a-8dc4-cc9ebc1edc24 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:42.504397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab79dc-6547-4d2a-8dc4-cc9ebc1edc24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:42.507150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-31ab79dc-6547-4d2a-8dc4-cc9ebc1edc24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:42.520509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:42.671742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab79dc-6547-4d2a-8dc4-cc9ebc1edc24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:42.673379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab79dc-6547-4d2a-8dc4-cc9ebc1edc24 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:42.694611 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 707/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:43.549776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d05ca-60e5-40de-b3e7-c2b92abe1749 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:43.550652 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d05ca-60e5-40de-b3e7-c2b92abe1749 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:43.550652 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d05ca-60e5-40de-b3e7-c2b92abe1749 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:43.552178 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:43.558074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3fb1f-f00f-431d-9962-c74cb3ff9073 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:43.558684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3fb1f-f00f-431d-9962-c74cb3ff9073 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:43.558684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3fb1f-f00f-431d-9962-c74cb3ff9073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:43.643607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-93d3fb1f-f00f-431d-9962-c74cb3ff9073 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:43.644840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-93d3fb1f-f00f-431d-9962-c74cb3ff9073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:43.723939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:43.759786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:12:44.041936 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d05ca-60e5-40de-b3e7-c2b92abe1749 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:44.043457 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c27d05ca-60e5-40de-b3e7-c2b92abe1749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:44.063730 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:44.212514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d05ca-60e5-40de-b3e7-c2b92abe1749 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:44.310585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:44.339841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156e78f-408f-45eb-bc9c-84aaf5a789ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:44.340602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156e78f-408f-45eb-bc9c-84aaf5a789ec service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:44.340935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156e78f-408f-45eb-bc9c-84aaf5a789ec service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:44.341250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156e78f-408f-45eb-bc9c-84aaf5a789ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:44.343051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9156e78f-408f-45eb-bc9c-84aaf5a789ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:44.445445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156e78f-408f-45eb-bc9c-84aaf5a789ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:44.447665 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156e78f-408f-45eb-bc9c-84aaf5a789ec service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:44.477295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 726/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:45.322136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a2f18-3f8e-498c-b994-b37dbec05520 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:45.323033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a2f18-3f8e-498c-b994-b37dbec05520 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:45.323033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a2f18-3f8e-498c-b994-b37dbec05520 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:45.324634 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:45.330508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74916c-f6c8-49a9-ad98-55aa4da8cba4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:45.331124 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74916c-f6c8-49a9-ad98-55aa4da8cba4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:45.331124 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74916c-f6c8-49a9-ad98-55aa4da8cba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:45.419545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3f74916c-f6c8-49a9-ad98-55aa4da8cba4 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:45.420717 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3f74916c-f6c8-49a9-ad98-55aa4da8cba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:45.467629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:45.539984 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:45.734895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a2f18-3f8e-498c-b994-b37dbec05520 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:45.737608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-732a2f18-3f8e-498c-b994-b37dbec05520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:45.990283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a2f18-3f8e-498c-b994-b37dbec05520 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:46.050959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:46.149374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e976ecf-0630-4fe1-af6b-ee667a4f2148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:46.150460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e976ecf-0630-4fe1-af6b-ee667a4f2148 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:46.150939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e976ecf-0630-4fe1-af6b-ee667a4f2148 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:46.151407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e976ecf-0630-4fe1-af6b-ee667a4f2148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:46.154517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2e976ecf-0630-4fe1-af6b-ee667a4f2148 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:46.298604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e976ecf-0630-4fe1-af6b-ee667a4f2148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:46.300392 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e976ecf-0630-4fe1-af6b-ee667a4f2148 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:46.321307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 710/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:47.173195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebf0b2-1f3a-4e2f-8eb3-41b5306db049 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:47.173836 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebf0b2-1f3a-4e2f-8eb3-41b5306db049 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:47.173836 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebf0b2-1f3a-4e2f-8eb3-41b5306db049 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:47.175211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:47.181087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e76f3-98fa-4b07-aedd-4a1b2b46621f None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:47.181941 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e76f3-98fa-4b07-aedd-4a1b2b46621f None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:47.182136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e76f3-98fa-4b07-aedd-4a1b2b46621f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:47.270396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-0b0e76f3-98fa-4b07-aedd-4a1b2b46621f None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:47.271736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0b0e76f3-98fa-4b07-aedd-4a1b2b46621f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:47.274213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:47.384191 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:12:47.536118 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebf0b2-1f3a-4e2f-8eb3-41b5306db049 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:47.537769 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f1ebf0b2-1f3a-4e2f-8eb3-41b5306db049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:47.714617 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebf0b2-1f3a-4e2f-8eb3-41b5306db049 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:47.748363 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:47.861098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74011ee4-c32f-4734-bc4f-9d9b1e2a4eb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:47.861742 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74011ee4-c32f-4734-bc4f-9d9b1e2a4eb8 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:47.862010 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74011ee4-c32f-4734-bc4f-9d9b1e2a4eb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:47.862268 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74011ee4-c32f-4734-bc4f-9d9b1e2a4eb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:47.863921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-74011ee4-c32f-4734-bc4f-9d9b1e2a4eb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:47.960148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74011ee4-c32f-4734-bc4f-9d9b1e2a4eb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:47.961769 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74011ee4-c32f-4734-bc4f-9d9b1e2a4eb8 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:47.980495 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 729/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:49.911308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5b015-6389-4b64-9d3e-36287e6ea6c5 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:49.912155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5b015-6389-4b64-9d3e-36287e6ea6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:49.912155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5b015-6389-4b64-9d3e-36287e6ea6c5 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:49.913240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:49.919230 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbedc20-95a4-4b89-ae19-ff5908b5699d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:49.920033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbedc20-95a4-4b89-ae19-ff5908b5699d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:49.920219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbedc20-95a4-4b89-ae19-ff5908b5699d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:49.965248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:49.991724 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8dbedc20-95a4-4b89-ae19-ff5908b5699d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:49.992950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8dbedc20-95a4-4b89-ae19-ff5908b5699d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:50.098701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:50.138681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5b015-6389-4b64-9d3e-36287e6ea6c5 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:50.140241 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3bb5b015-6389-4b64-9d3e-36287e6ea6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:50.399114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5b015-6389-4b64-9d3e-36287e6ea6c5 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:50.453968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:50.514522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774cba8-6ffd-45b9-ab9a-f47b36fe4ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:50.515274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774cba8-6ffd-45b9-ab9a-f47b36fe4ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:50.515641 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774cba8-6ffd-45b9-ab9a-f47b36fe4ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:50.515995 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774cba8-6ffd-45b9-ab9a-f47b36fe4ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:50.517889 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5774cba8-6ffd-45b9-ab9a-f47b36fe4ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:50.652880 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774cba8-6ffd-45b9-ab9a-f47b36fe4ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:50.655497 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774cba8-6ffd-45b9-ab9a-f47b36fe4ca0 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:50.689355 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 713/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:52.895724 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498ca36-aac5-4ac1-9a32-c3bda5b1e965 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:52.896484 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498ca36-aac5-4ac1-9a32-c3bda5b1e965 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:52.896703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498ca36-aac5-4ac1-9a32-c3bda5b1e965 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:52.898234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:52.905508 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835d2b7-8150-483f-8064-300eccf13123 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:52.906174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835d2b7-8150-483f-8064-300eccf13123 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:52.906484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835d2b7-8150-483f-8064-300eccf13123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:53.021221 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-8835d2b7-8150-483f-8064-300eccf13123 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:53.023317 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8835d2b7-8150-483f-8064-300eccf13123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:53.047760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:53.143861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:53.184162 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498ca36-aac5-4ac1-9a32-c3bda5b1e965 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:53.185769 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a498ca36-aac5-4ac1-9a32-c3bda5b1e965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:53.341148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498ca36-aac5-4ac1-9a32-c3bda5b1e965 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:53.354810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:53.426312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29e58f-598a-4dad-a7a2-bce6084abfa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:53.427015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29e58f-598a-4dad-a7a2-bce6084abfa8 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:53.427314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29e58f-598a-4dad-a7a2-bce6084abfa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:53.427487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29e58f-598a-4dad-a7a2-bce6084abfa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:53.429175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1f29e58f-598a-4dad-a7a2-bce6084abfa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:53.558645 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29e58f-598a-4dad-a7a2-bce6084abfa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:53.560112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29e58f-598a-4dad-a7a2-bce6084abfa8 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:53.580434 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 732/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:55.969757 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fbd28-395a-42bd-9671-c66ae6ee3e74 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:55.970488 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fbd28-395a-42bd-9671-c66ae6ee3e74 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:55.970488 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fbd28-395a-42bd-9671-c66ae6ee3e74 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:55.971649 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:12:55.980150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58c2c-7f5c-4102-bfb1-a4239772ff49 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:55.980781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58c2c-7f5c-4102-bfb1-a4239772ff49 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:55.980781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58c2c-7f5c-4102-bfb1-a4239772ff49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:56.038987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:56.061122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9ae58c2c-7f5c-4102-bfb1-a4239772ff49 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:56.062577 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9ae58c2c-7f5c-4102-bfb1-a4239772ff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:56.173485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:56.214512 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fbd28-395a-42bd-9671-c66ae6ee3e74 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:56.216096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-719fbd28-395a-42bd-9671-c66ae6ee3e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:56.339357 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fbd28-395a-42bd-9671-c66ae6ee3e74 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:56.383693 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:56.422803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46403a27-82ee-4e68-89b9-d50ea481f050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:56.423412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46403a27-82ee-4e68-89b9-d50ea481f050 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:56.423685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46403a27-82ee-4e68-89b9-d50ea481f050 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:56.423951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46403a27-82ee-4e68-89b9-d50ea481f050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:56.425571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-46403a27-82ee-4e68-89b9-d50ea481f050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:56.539150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46403a27-82ee-4e68-89b9-d50ea481f050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:56.540605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46403a27-82ee-4e68-89b9-d50ea481f050 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:56.559716 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 716/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:12:58.705057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976d759-180f-4f93-ac04-f836769008e2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:58.705771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976d759-180f-4f93-ac04-f836769008e2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:58.705771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976d759-180f-4f93-ac04-f836769008e2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:58.707022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:12:58.713033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc0203-2e32-46e8-a6cc-9b6e5bb55619 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:58.713911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc0203-2e32-46e8-a6cc-9b6e5bb55619 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:58.713911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc0203-2e32-46e8-a6cc-9b6e5bb55619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:58.784792 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-3abc0203-2e32-46e8-a6cc-9b6e5bb55619 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:12:58.785944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3abc0203-2e32-46e8-a6cc-9b6e5bb55619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:58.808319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:58.890187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:12:58.930914 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976d759-180f-4f93-ac04-f836769008e2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:12:58.932531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5976d759-180f-4f93-ac04-f836769008e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:59.065035 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976d759-180f-4f93-ac04-f836769008e2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:12:59.092752 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:12:59.155156 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea27715-c19f-482e-8073-4d62b992ecb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:12:59.155750 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27715-c19f-482e-8073-4d62b992ecb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:12:59.156048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27715-c19f-482e-8073-4d62b992ecb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:12:59.156309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27715-c19f-482e-8073-4d62b992ecb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:12:59.157963 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fea27715-c19f-482e-8073-4d62b992ecb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:12:59.286297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea27715-c19f-482e-8073-4d62b992ecb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:12:59.287841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea27715-c19f-482e-8073-4d62b992ecb5 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:12:59.311235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 735/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:13:01.430374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01b979-3752-4b7c-bb1e-4d78acc55abc None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:01.430991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01b979-3752-4b7c-bb1e-4d78acc55abc None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:01.431126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01b979-3752-4b7c-bb1e-4d78acc55abc None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:01.432522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:01.438616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee3f0e-ef77-4b1a-a15a-4262a55603a1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:01.439139 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee3f0e-ef77-4b1a-a15a-4262a55603a1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:01.439139 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee3f0e-ef77-4b1a-a15a-4262a55603a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:01.515925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:01.519940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-10ee3f0e-ef77-4b1a-a15a-4262a55603a1 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:01.521872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-10ee3f0e-ef77-4b1a-a15a-4262a55603a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:01.632780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:13:01.672767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01b979-3752-4b7c-bb1e-4d78acc55abc None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:01.674413 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-da01b979-3752-4b7c-bb1e-4d78acc55abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:01.806835 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01b979-3752-4b7c-bb1e-4d78acc55abc None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:01.874450 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:01.904692 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865e4a3-fce7-4a93-bc1b-93235bec2b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:01.905296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865e4a3-fce7-4a93-bc1b-93235bec2b67 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:01.905561 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865e4a3-fce7-4a93-bc1b-93235bec2b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:01.905854 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865e4a3-fce7-4a93-bc1b-93235bec2b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:01.907567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d865e4a3-fce7-4a93-bc1b-93235bec2b67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:02.028993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865e4a3-fce7-4a93-bc1b-93235bec2b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:02.030544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865e4a3-fce7-4a93-bc1b-93235bec2b67 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:02.050250 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 719/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:13:04.195895 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a181c-80b5-4a6e-ad32-e0ba0fe07d28 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:04.196712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a181c-80b5-4a6e-ad32-e0ba0fe07d28 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:04.196712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a181c-80b5-4a6e-ad32-e0ba0fe07d28 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:04.199022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:04.207673 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4f39a-5fbc-4734-beca-01482ffdc00a None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:04.208306 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4f39a-5fbc-4734-beca-01482ffdc00a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:04.208419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4f39a-5fbc-4734-beca-01482ffdc00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:04.285574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-09b4f39a-5fbc-4734-beca-01482ffdc00a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:04.287269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-09b4f39a-5fbc-4734-beca-01482ffdc00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:04.319811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:04.393599 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:13:04.433020 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a181c-80b5-4a6e-ad32-e0ba0fe07d28 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:04.435096 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0e5a181c-80b5-4a6e-ad32-e0ba0fe07d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:04.580546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a181c-80b5-4a6e-ad32-e0ba0fe07d28 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:04.620469 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:04.669948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4cab7-4f85-45d4-b41c-edc8b5c7f9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:04.670568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4cab7-4f85-45d4-b41c-edc8b5c7f9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:04.670845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4cab7-4f85-45d4-b41c-edc8b5c7f9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:04.671117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4cab7-4f85-45d4-b41c-edc8b5c7f9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:04.672734 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-eda4cab7-4f85-45d4-b41c-edc8b5c7f9b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:04.796761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4cab7-4f85-45d4-b41c-edc8b5c7f9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:04.798246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4cab7-4f85-45d4-b41c-edc8b5c7f9b9 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:04.818704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 738/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:13:06.925861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e9b45-689b-43e5-9ea0-7ef9a9712bc1 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:06.926848 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e9b45-689b-43e5-9ea0-7ef9a9712bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:06.926848 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e9b45-689b-43e5-9ea0-7ef9a9712bc1 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:06.928432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:06.934810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108f836-1c3f-47d7-858c-b2324105dda4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:06.935401 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108f836-1c3f-47d7-858c-b2324105dda4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:06.935401 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108f836-1c3f-47d7-858c-b2324105dda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:07.012121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f108f836-1c3f-47d7-858c-b2324105dda4 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:07.013377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f108f836-1c3f-47d7-858c-b2324105dda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:07.023159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:07.120650 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:13:07.160350 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e9b45-689b-43e5-9ea0-7ef9a9712bc1 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:07.163187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fe8e9b45-689b-43e5-9ea0-7ef9a9712bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:07.306406 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e9b45-689b-43e5-9ea0-7ef9a9712bc1 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:07.373375 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:07.395503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370400e-d87d-4ba2-bc0a-863414337b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:07.396299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370400e-d87d-4ba2-bc0a-863414337b72 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:07.396660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370400e-d87d-4ba2-bc0a-863414337b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:07.397012 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370400e-d87d-4ba2-bc0a-863414337b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:07.399012 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a370400e-d87d-4ba2-bc0a-863414337b72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:07.544734 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370400e-d87d-4ba2-bc0a-863414337b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:07.546471 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370400e-d87d-4ba2-bc0a-863414337b72 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:07.566716 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 722/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:13:09.718103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f73b3-6378-449a-bebb-7a081dbfa4a4 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:09.719019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f73b3-6378-449a-bebb-7a081dbfa4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:09.719019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f73b3-6378-449a-bebb-7a081dbfa4a4 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:09.720010 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:09.726383 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08297c2b-a289-477e-a92e-1356a48a8fdb None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:09.727182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08297c2b-a289-477e-a92e-1356a48a8fdb None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:09.727341 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08297c2b-a289-477e-a92e-1356a48a8fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:09.802692 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-08297c2b-a289-477e-a92e-1356a48a8fdb None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:09.804082 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-08297c2b-a289-477e-a92e-1356a48a8fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:09.846565 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:09.928613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:13:09.968397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f73b3-6378-449a-bebb-7a081dbfa4a4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:09.970163 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-264f73b3-6378-449a-bebb-7a081dbfa4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:10.121524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f73b3-6378-449a-bebb-7a081dbfa4a4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:10.171677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:10.212345 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057a8bf-9a35-4247-bd4c-ca6a0dd74db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:10.212954 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057a8bf-9a35-4247-bd4c-ca6a0dd74db9 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:10.213239 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057a8bf-9a35-4247-bd4c-ca6a0dd74db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:10.213506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057a8bf-9a35-4247-bd4c-ca6a0dd74db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:10.215180 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9057a8bf-9a35-4247-bd4c-ca6a0dd74db9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:10.340855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057a8bf-9a35-4247-bd4c-ca6a0dd74db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:10.342444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057a8bf-9a35-4247-bd4c-ca6a0dd74db9 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:10.362618 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 741/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:13:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:13:12.436058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f24860-01b9-4f98-bec2-0d81cdb491fd None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:12.436651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f24860-01b9-4f98-bec2-0d81cdb491fd None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:12.436651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f24860-01b9-4f98-bec2-0d81cdb491fd None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:12.437871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:12.443866 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bcab6-6b97-414f-bcc8-1c4f0de4d771 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:12.444387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bcab6-6b97-414f-bcc8-1c4f0de4d771 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:12.444387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bcab6-6b97-414f-bcc8-1c4f0de4d771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:12.520492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a33bcab6-6b97-414f-bcc8-1c4f0de4d771 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:12.521757 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a33bcab6-6b97-414f-bcc8-1c4f0de4d771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:12.543955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:12.636780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:13:12.674425 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f24860-01b9-4f98-bec2-0d81cdb491fd None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:12.675987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b5f24860-01b9-4f98-bec2-0d81cdb491fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:12.796610 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f24860-01b9-4f98-bec2-0d81cdb491fd None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:12.877661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:12.886176 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c0c95-2086-4740-bb39-ae58ebb3b324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:12.886785 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0c95-2086-4740-bb39-ae58ebb3b324 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:12.887058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0c95-2086-4740-bb39-ae58ebb3b324 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:12.887324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0c95-2086-4740-bb39-ae58ebb3b324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:12.888951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-166c0c95-2086-4740-bb39-ae58ebb3b324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:13.009110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c0c95-2086-4740-bb39-ae58ebb3b324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:13.010621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c0c95-2086-4740-bb39-ae58ebb3b324 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:13.034844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 725/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:13:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:13:15.084795 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c6b09-63dd-4519-ac2f-b79e0bcf6475 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:15.085485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c6b09-63dd-4519-ac2f-b79e0bcf6475 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:15.085485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c6b09-63dd-4519-ac2f-b79e0bcf6475 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:15.086722 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:15.092459 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f3fb2-8fe7-457f-af5b-a80256e9e4e9 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:15.093007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f3fb2-8fe7-457f-af5b-a80256e9e4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:15.093007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f3fb2-8fe7-457f-af5b-a80256e9e4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:15.195172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-cc7f3fb2-8fe7-457f-af5b-a80256e9e4e9 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:15.196431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-cc7f3fb2-8fe7-457f-af5b-a80256e9e4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:15.254731 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:15.312262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:13:15.349945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c6b09-63dd-4519-ac2f-b79e0bcf6475 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:15.351547 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-053c6b09-63dd-4519-ac2f-b79e0bcf6475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:15.472240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c6b09-63dd-4519-ac2f-b79e0bcf6475 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:15.531086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:15.564397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2458a1-b93a-49f5-b222-cca6aa38e4c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:15.565065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2458a1-b93a-49f5-b222-cca6aa38e4c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:15.565383 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2458a1-b93a-49f5-b222-cca6aa38e4c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:15.565763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2458a1-b93a-49f5-b222-cca6aa38e4c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:15.567984 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-da2458a1-b93a-49f5-b222-cca6aa38e4c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:15.709438 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2458a1-b93a-49f5-b222-cca6aa38e4c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:15.710994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2458a1-b93a-49f5-b222-cca6aa38e4c5 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:15.733524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 744/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:13:25.310146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=22 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:25.730525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=66 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:35.861911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed725c-628c-43f2-9b8d-6ed4bab9a9dd None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:35.862829 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed725c-628c-43f2-9b8d-6ed4bab9a9dd None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:35.862829 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed725c-628c-43f2-9b8d-6ed4bab9a9dd None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:35.864325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 727/1471] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:35.872165 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c63064-b091-433f-a0a3-92fa6fa0a7f9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:35.872676 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c63064-b091-433f-a0a3-92fa6fa0a7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:35.873079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c63064-b091-433f-a0a3-92fa6fa0a7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:35.973477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-46c63064-b091-433f-a0a3-92fa6fa0a7f9 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:35.974893 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-46c63064-b091-433f-a0a3-92fa6fa0a7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:36.088466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 745/1472] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:13:36.183165 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d24d6-0b4a-402c-882a-33938fd4c0f9 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:36.183565 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d24d6-0b4a-402c-882a-33938fd4c0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:36.183930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d24d6-0b4a-402c-882a-33938fd4c0f9 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:36.185521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 728/1473] 10.222.0.15 () {54 vars in 967 bytes} [Tue Aug 9 11:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 11:13:36.191376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1522896-e590-43e9-b7db-07142873dde8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:36.191753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1522896-e590-43e9-b7db-07142873dde8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:36.192174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1522896-e590-43e9-b7db-07142873dde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:36.278205 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c1522896-e590-43e9-b7db-07142873dde8 None None] MFA Rules not processed for user `5356835ef79c458bbfa7d6adafd0cb36`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:36.279575 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c1522896-e590-43e9-b7db-07142873dde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:36.303889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:36.372813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 746/1474] 10.222.0.15 () {58 vars in 1064 bytes} [Tue Aug 9 11:13:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:13:36.382262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d24d6-0b4a-402c-882a-33938fd4c0f9 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:36.383960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f14d24d6-0b4a-402c-882a-33938fd4c0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:36.502831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d24d6-0b4a-402c-882a-33938fd4c0f9 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:36.586134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89a5d7-dcc8-4e12-9fec-d9fb78ce1a17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5356835ef79c458bbfa7d6adafd0cb36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:36.586742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89a5d7-dcc8-4e12-9fec-d9fb78ce1a17 service glance] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:36.587006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89a5d7-dcc8-4e12-9fec-d9fb78ce1a17 service glance] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:36.587269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89a5d7-dcc8-4e12-9fec-d9fb78ce1a17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:36.588912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-1b89a5d7-dcc8-4e12-9fec-d9fb78ce1a17 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:36.646390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:36.711239 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89a5d7-dcc8-4e12-9fec-d9fb78ce1a17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:36.712709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89a5d7-dcc8-4e12-9fec-d9fb78ce1a17 service glance] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:36.733320 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 729/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:13:38.892595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dcc10-e9ec-4bbb-92ef-b59f08b40057 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:38.893179 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dcc10-e9ec-4bbb-92ef-b59f08b40057 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:38.893179 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dcc10-e9ec-4bbb-92ef-b59f08b40057 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:38.894585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 747/1476] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:38.900900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28437a0-d1a0-43e0-8d7b-fc8e971ab214 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:38.901549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28437a0-d1a0-43e0-8d7b-fc8e971ab214 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:38.901549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28437a0-d1a0-43e0-8d7b-fc8e971ab214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:39.010447 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-a28437a0-d1a0-43e0-8d7b-fc8e971ab214 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:39.012467 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a28437a0-d1a0-43e0-8d7b-fc8e971ab214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:39.169103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 730/1477] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:13:39.193196 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dcc10-e9ec-4bbb-92ef-b59f08b40057 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:39.196046 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d75dcc10-e9ec-4bbb-92ef-b59f08b40057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:39.372647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dcc10-e9ec-4bbb-92ef-b59f08b40057 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:39.427081 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:39.475992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c44412-feba-4788-8e9c-88eeddce125e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:39.476612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c44412-feba-4788-8e9c-88eeddce125e admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:39.476882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c44412-feba-4788-8e9c-88eeddce125e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:39.477147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c44412-feba-4788-8e9c-88eeddce125e admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:39.477821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c44412-feba-4788-8e9c-88eeddce125e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:39.479679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-66c44412-feba-4788-8e9c-88eeddce125e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:13:39.479679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: warnings.warn(msg) Aug 09 11:13:39.479679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: Aug 09 11:13:39.480834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c44412-feba-4788-8e9c-88eeddce125e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:39.507034 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 748/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Aug 9 11:13:39 2022] GET /identity/v3/projects => generated 2553 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:13:41.593645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1f51e-be5f-4cba-89d5-016f5dbedafc None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:41.594342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1f51e-be5f-4cba-89d5-016f5dbedafc None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:41.594342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1f51e-be5f-4cba-89d5-016f5dbedafc None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:41.595710 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 731/1479] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:41.602275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fbf06-e9d1-431f-8782-6425cc9890fc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:41.602893 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fbf06-e9d1-431f-8782-6425cc9890fc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:41.602893 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fbf06-e9d1-431f-8782-6425cc9890fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:41.683327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-363fbf06-e9d1-431f-8782-6425cc9890fc None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:41.684592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-363fbf06-e9d1-431f-8782-6425cc9890fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:41.799144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 749/1480] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:13:41.845168 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1f51e-be5f-4cba-89d5-016f5dbedafc None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:41.847534 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6cb1f51e-be5f-4cba-89d5-016f5dbedafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:41.859084 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:42.013188 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1f51e-be5f-4cba-89d5-016f5dbedafc None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:42.105674 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:42.142342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f4bde-9a04-4dec-9616-84de818ac798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:42.142951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f4bde-9a04-4dec-9616-84de818ac798 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:42.143221 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f4bde-9a04-4dec-9616-84de818ac798 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:42.143484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f4bde-9a04-4dec-9616-84de818ac798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:42.145140 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ce7f4bde-9a04-4dec-9616-84de818ac798 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:42.282880 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f4bde-9a04-4dec-9616-84de818ac798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:42.284511 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f4bde-9a04-4dec-9616-84de818ac798 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:42.305836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 732/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:13:44.611399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcd41e-cf02-4f24-b0bf-95a33dcf8f76 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:44.612100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcd41e-cf02-4f24-b0bf-95a33dcf8f76 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:44.612100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcd41e-cf02-4f24-b0bf-95a33dcf8f76 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:44.613277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 750/1482] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:44.619810 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff22279-1425-4243-98a4-ab934a5a75ea None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:44.620308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff22279-1425-4243-98a4-ab934a5a75ea None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:44.620733 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff22279-1425-4243-98a4-ab934a5a75ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:44.694166 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-0ff22279-1425-4243-98a4-ab934a5a75ea None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:44.695446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0ff22279-1425-4243-98a4-ab934a5a75ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:44.764414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:44.849965 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 733/1483] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:13:44.912087 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcd41e-cf02-4f24-b0bf-95a33dcf8f76 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:44.913735 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2adcd41e-cf02-4f24-b0bf-95a33dcf8f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:44.939856 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:45.029567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcd41e-cf02-4f24-b0bf-95a33dcf8f76 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:45.103482 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363308d-7b1a-4972-8fad-437098a3c412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:45.104093 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363308d-7b1a-4972-8fad-437098a3c412 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:45.104367 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363308d-7b1a-4972-8fad-437098a3c412 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:45.104633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363308d-7b1a-4972-8fad-437098a3c412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:45.106288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9363308d-7b1a-4972-8fad-437098a3c412 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:45.190602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:45.232639 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363308d-7b1a-4972-8fad-437098a3c412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:45.234153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9363308d-7b1a-4972-8fad-437098a3c412 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:45.255256 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 751/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:13:47.366106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62afa55-e427-4d75-a2fa-a83688b93e81 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:47.366929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62afa55-e427-4d75-a2fa-a83688b93e81 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:47.366929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62afa55-e427-4d75-a2fa-a83688b93e81 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:47.368242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 734/1485] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:47.375547 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e4b5d-ef0d-4b8b-9568-79e3746fd49e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:47.376091 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e4b5d-ef0d-4b8b-9568-79e3746fd49e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:47.376517 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e4b5d-ef0d-4b8b-9568-79e3746fd49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:47.601451 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-565e4b5d-ef0d-4b8b-9568-79e3746fd49e None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:47.602906 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-565e4b5d-ef0d-4b8b-9568-79e3746fd49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:47.720404 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 752/1486] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:13:47.761392 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62afa55-e427-4d75-a2fa-a83688b93e81 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:47.763203 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d62afa55-e427-4d75-a2fa-a83688b93e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:47.882523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62afa55-e427-4d75-a2fa-a83688b93e81 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:47.965612 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:47.967961 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1754b-0bcc-4a9a-a255-0be66ac4f683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:47.968872 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1754b-0bcc-4a9a-a255-0be66ac4f683 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:47.969365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1754b-0bcc-4a9a-a255-0be66ac4f683 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:47.969770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1754b-0bcc-4a9a-a255-0be66ac4f683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:47.972519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ccb1754b-0bcc-4a9a-a255-0be66ac4f683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:48.095572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1754b-0bcc-4a9a-a255-0be66ac4f683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:48.097016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1754b-0bcc-4a9a-a255-0be66ac4f683 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:48.115149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 735/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:13:50.417243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68715e6-0c4b-4d96-8036-b9e7045646ac None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:50.417851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68715e6-0c4b-4d96-8036-b9e7045646ac None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:50.418239 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68715e6-0c4b-4d96-8036-b9e7045646ac None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:50.420805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 753/1488] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:13:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:50.427871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb2b2f-bf92-47a8-bf94-c9aa132112e1 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:50.428491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb2b2f-bf92-47a8-bf94-c9aa132112e1 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:50.428491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb2b2f-bf92-47a8-bf94-c9aa132112e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:50.502339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-e8bb2b2f-bf92-47a8-bf94-c9aa132112e1 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:50.503596 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e8bb2b2f-bf92-47a8-bf94-c9aa132112e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:50.559654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:50.605044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 736/1489] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:13:50.646463 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68715e6-0c4b-4d96-8036-b9e7045646ac None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:50.648042 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f68715e6-0c4b-4d96-8036-b9e7045646ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:50.686008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:50.757948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68715e6-0c4b-4d96-8036-b9e7045646ac None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:50.840201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55266d1-6c4e-47f4-bdf3-cc50c25bd8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:50.840808 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55266d1-6c4e-47f4-bdf3-cc50c25bd8ae service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:50.841094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55266d1-6c4e-47f4-bdf3-cc50c25bd8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:50.841362 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55266d1-6c4e-47f4-bdf3-cc50c25bd8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:50.843033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b55266d1-6c4e-47f4-bdf3-cc50c25bd8ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:50.929963 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:50.983779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55266d1-6c4e-47f4-bdf3-cc50c25bd8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:50.986499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55266d1-6c4e-47f4-bdf3-cc50c25bd8ae service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:51.019317 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 754/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:13:53.326733 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8da547-0138-4ee4-97aa-6747e7e8c41b None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:53.327289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8da547-0138-4ee4-97aa-6747e7e8c41b None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:53.327289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8da547-0138-4ee4-97aa-6747e7e8c41b None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:53.328618 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 737/1491] 10.222.0.15 () {54 vars in 927 bytes} [Tue Aug 9 11:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:13:53.334730 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e78c7-2e1e-4abe-9e2e-48b6f4ac8bb3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:53.335726 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e78c7-2e1e-4abe-9e2e-48b6f4ac8bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:53.335726 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e78c7-2e1e-4abe-9e2e-48b6f4ac8bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:53.408433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2d7e78c7-2e1e-4abe-9e2e-48b6f4ac8bb3 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:13:53.409734 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2d7e78c7-2e1e-4abe-9e2e-48b6f4ac8bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:53.516242 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 755/1492] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Aug 9 11:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:13:53.555721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8da547-0138-4ee4-97aa-6747e7e8c41b None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:13:53.557339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7b8da547-0138-4ee4-97aa-6747e7e8c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:53.698366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8da547-0138-4ee4-97aa-6747e7e8c41b None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:13:53.780230 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1cd8f-3f78-419a-9c8c-97951ebb3c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:13:53.780843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1cd8f-3f78-419a-9c8c-97951ebb3c87 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:13:53.781111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1cd8f-3f78-419a-9c8c-97951ebb3c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:13:53.781373 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1cd8f-3f78-419a-9c8c-97951ebb3c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:13:53.783080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-24a1cd8f-3f78-419a-9c8c-97951ebb3c87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:13:53.793563 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:13:53.912899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1cd8f-3f78-419a-9c8c-97951ebb3c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:13:53.914467 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1cd8f-3f78-419a-9c8c-97951ebb3c87 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:13:53.936207 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 738/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:14:03.514333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=82 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:14:03.933452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=50 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:05.090026 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7910f8-d6b1-42ad-8a6b-9cbfd3ea2af8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:05.090669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7910f8-d6b1-42ad-8a6b-9cbfd3ea2af8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:05.090669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7910f8-d6b1-42ad-8a6b-9cbfd3ea2af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:05.170140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7a7910f8-d6b1-42ad-8a6b-9cbfd3ea2af8 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:15:05.171355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7a7910f8-d6b1-42ad-8a6b-9cbfd3ea2af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:05.269000 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 756/1494] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:15:05.277721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c8867-5378-4c93-9436-4e37fc0dbd86 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:05.278250 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c8867-5378-4c93-9436-4e37fc0dbd86 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:05.278250 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c8867-5378-4c93-9436-4e37fc0dbd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:05.358969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-7b9c8867-5378-4c93-9436-4e37fc0dbd86 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:15:05.360091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7b9c8867-5378-4c93-9436-4e37fc0dbd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:05.459572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 739/1495] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:15:05.465002 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7910f8-d6b1-42ad-8a6b-9cbfd3ea2af8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:05.466202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7a7910f8-d6b1-42ad-8a6b-9cbfd3ea2af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:05.477674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7910f8-d6b1-42ad-8a6b-9cbfd3ea2af8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:05.540355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:05.573327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170bdac-a8d5-4cbd-803f-1dd95f5e049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:05.573965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170bdac-a8d5-4cbd-803f-1dd95f5e049c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:05.574235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170bdac-a8d5-4cbd-803f-1dd95f5e049c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:05.574500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170bdac-a8d5-4cbd-803f-1dd95f5e049c admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:05.575127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170bdac-a8d5-4cbd-803f-1dd95f5e049c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:15:05.575424 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170bdac-a8d5-4cbd-803f-1dd95f5e049c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:05.576428 dv-cinder-852514-2-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-a170bdac-a8d5-4cbd-803f-1dd95f5e049c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:15:05.576428 dv-cinder-852514-2-smb devstack@keystone.service[80168]: warnings.warn(msg) Aug 09 11:15:05.576428 dv-cinder-852514-2-smb devstack@keystone.service[80168]: Aug 09 11:15:05.577305 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170bdac-a8d5-4cbd-803f-1dd95f5e049c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:05.588238 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 757/1496] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:15:05.596886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c8867-5378-4c93-9436-4e37fc0dbd86 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:05.606354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c8867-5378-4c93-9436-4e37fc0dbd86 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:05.671054 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:05.708168 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d59d6-7596-4ccf-b22a-f6fa116c1a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:05.708796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d59d6-7596-4ccf-b22a-f6fa116c1a16 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:05.709060 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d59d6-7596-4ccf-b22a-f6fa116c1a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:05.709316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d59d6-7596-4ccf-b22a-f6fa116c1a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:05.709961 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d59d6-7596-4ccf-b22a-f6fa116c1a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:05.711714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: WARNING py.warnings [None req-8f2d59d6-7596-4ccf-b22a-f6fa116c1a16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:15:05.711714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: warnings.warn(msg) Aug 09 11:15:05.711714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: Aug 09 11:15:05.712890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d59d6-7596-4ccf-b22a-f6fa116c1a16 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:05.774423 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 740/1497] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:15:05 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:15:05.779316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170bdac-a8d5-4cbd-803f-1dd95f5e049c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:05.780892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a170bdac-a8d5-4cbd-803f-1dd95f5e049c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:05.822332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170bdac-a8d5-4cbd-803f-1dd95f5e049c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:05.919998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e971ef7-57c3-489f-b1ce-58d598cf8a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:05.920601 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e971ef7-57c3-489f-b1ce-58d598cf8a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:05.920867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e971ef7-57c3-489f-b1ce-58d598cf8a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:05.921209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e971ef7-57c3-489f-b1ce-58d598cf8a86 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:05.921776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e971ef7-57c3-489f-b1ce-58d598cf8a86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:05.922785 dv-cinder-852514-2-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-3e971ef7-57c3-489f-b1ce-58d598cf8a86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:15:05.922785 dv-cinder-852514-2-smb devstack@keystone.service[80168]: warnings.warn(msg) Aug 09 11:15:05.922785 dv-cinder-852514-2-smb devstack@keystone.service[80168]: Aug 09 11:15:05.923981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e971ef7-57c3-489f-b1ce-58d598cf8a86 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:05.973528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 758/1498] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:15:05 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:15:05.977854 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d59d6-7596-4ccf-b22a-f6fa116c1a16 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:05.979395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8f2d59d6-7596-4ccf-b22a-f6fa116c1a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:06.046325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d59d6-7596-4ccf-b22a-f6fa116c1a16 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:06.140703 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:06.152119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2830545-9cf2-4e81-9813-0a37a76076f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:06.152727 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2830545-9cf2-4e81-9813-0a37a76076f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:06.152995 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2830545-9cf2-4e81-9813-0a37a76076f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:06.153260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2830545-9cf2-4e81-9813-0a37a76076f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:06.153934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2830545-9cf2-4e81-9813-0a37a76076f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:06.154961 dv-cinder-852514-2-smb devstack@keystone.service[80169]: WARNING py.warnings [None req-a2830545-9cf2-4e81-9813-0a37a76076f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:15:06.154961 dv-cinder-852514-2-smb devstack@keystone.service[80169]: warnings.warn(msg) Aug 09 11:15:06.154961 dv-cinder-852514-2-smb devstack@keystone.service[80169]: Aug 09 11:15:06.155846 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2830545-9cf2-4e81-9813-0a37a76076f0 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:06.168542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 741/1499] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:15:06.173004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e971ef7-57c3-489f-b1ce-58d598cf8a86 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:06.174476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3e971ef7-57c3-489f-b1ce-58d598cf8a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:06.186215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e971ef7-57c3-489f-b1ce-58d598cf8a86 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:06.212677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:06.285358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f208-6663-438a-a3f6-8d99de506ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:06.285992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f208-6663-438a-a3f6-8d99de506ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:06.286265 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f208-6663-438a-a3f6-8d99de506ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:06.286529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f208-6663-438a-a3f6-8d99de506ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:06.287166 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3f208-6663-438a-a3f6-8d99de506ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:06.288172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-f9c3f208-6663-438a-a3f6-8d99de506ca9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:15:06.288172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: warnings.warn(msg) Aug 09 11:15:06.288172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: Aug 09 11:15:06.289052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3f208-6663-438a-a3f6-8d99de506ca9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:06.302513 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 759/1500] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:15:06.306969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2830545-9cf2-4e81-9813-0a37a76076f0 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:06.309484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a2830545-9cf2-4e81-9813-0a37a76076f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:06.350893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2830545-9cf2-4e81-9813-0a37a76076f0 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:06.454613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a507d9-3c65-48bb-bab2-005703997e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:06.455212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a507d9-3c65-48bb-bab2-005703997e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:06.455484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a507d9-3c65-48bb-bab2-005703997e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:06.455755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a507d9-3c65-48bb-bab2-005703997e01 admin admin] PATH_INFO: `/v3/projects/faacf6c0142d495ea7cbdc93a57a7db0/users/752ab2d7490f485c88b648c3433adf24/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:06.483119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a507d9-3c65-48bb-bab2-005703997e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faacf6c0142d495ea7cbdc93a57a7db0, user_id=752ab2d7490f485c88b648c3433adf24, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:06.484097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: WARNING py.warnings [None req-53a507d9-3c65-48bb-bab2-005703997e01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:15:06.484097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: warnings.warn(msg) Aug 09 11:15:06.484097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: Aug 09 11:15:06.486276 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a507d9-3c65-48bb-bab2-005703997e01 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:06.516127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 742/1501] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:15:06 2022] PUT /identity/v3/projects/faacf6c0142d495ea7cbdc93a57a7db0/users/752ab2d7490f485c88b648c3433adf24/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:15:06.529244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b05372-1369-4b22-b0b6-d1a95285eacb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:06.529545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b05372-1369-4b22-b0b6-d1a95285eacb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:06.529859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b05372-1369-4b22-b0b6-d1a95285eacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:06.598199 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a6b05372-1369-4b22-b0b6-d1a95285eacb None None] MFA Rules not processed for user `752ab2d7490f485c88b648c3433adf24`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:15:06.599487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a6b05372-1369-4b22-b0b6-d1a95285eacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:06.689285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 760/1502] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:15:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:15:06.703715 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c6154-bce0-4633-ad1f-d244360846b9 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:06.703995 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c6154-bce0-4633-ad1f-d244360846b9 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:06.704301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c6154-bce0-4633-ad1f-d244360846b9 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:06.705763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 743/1503] 10.222.0.15 () {54 vars in 964 bytes} [Tue Aug 9 11:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:15:06.711220 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f055e-61d3-42bd-a075-72464af1f418 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:06.711494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f055e-61d3-42bd-a075-72464af1f418 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:06.711781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f055e-61d3-42bd-a075-72464af1f418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:06.744840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:06.793390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a63f055e-61d3-42bd-a075-72464af1f418 None None] MFA Rules not processed for user `097822b9d7954dd0b27e9f650b6e36f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:15:06.794633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a63f055e-61d3-42bd-a075-72464af1f418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:06.872746 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 761/1504] 10.222.0.15 () {58 vars in 1061 bytes} [Tue Aug 9 11:15:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:15:06.881016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c6154-bce0-4633-ad1f-d244360846b9 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:06.882635 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c67c6154-bce0-4633-ad1f-d244360846b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:06.933922 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:06.988019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c6154-bce0-4633-ad1f-d244360846b9 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:07.071791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a86f38-ac65-45f8-bbab-037a92ea0914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:07.072394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a86f38-ac65-45f8-bbab-037a92ea0914 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:07.072660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a86f38-ac65-45f8-bbab-037a92ea0914 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:07.072968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a86f38-ac65-45f8-bbab-037a92ea0914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:07.074671 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-09a86f38-ac65-45f8-bbab-037a92ea0914 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:07.182599 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a86f38-ac65-45f8-bbab-037a92ea0914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:07.184053 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a86f38-ac65-45f8-bbab-037a92ea0914 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:07.187545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:07.203535 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 744/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:15:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:15:07.250335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99562-9eee-405d-9705-0f06f664d21d None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:07.250737 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99562-9eee-405d-9705-0f06f664d21d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:07.250894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99562-9eee-405d-9705-0f06f664d21d None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:07.252151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 762/1506] 10.222.0.15 () {52 vars in 830 bytes} [Tue Aug 9 11:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:15:07.256000 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a86f38-ac65-45f8-bbab-037a92ea0914 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:07.257232 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-09a86f38-ac65-45f8-bbab-037a92ea0914 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:07.361772 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a86f38-ac65-45f8-bbab-037a92ea0914 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:07.462818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6863c-b2a7-4c04-853d-a48cd603c30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:07.463439 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6863c-b2a7-4c04-853d-a48cd603c30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:07.463711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6863c-b2a7-4c04-853d-a48cd603c30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:07.463970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6863c-b2a7-4c04-853d-a48cd603c30c admin admin] PATH_INFO: `/v3/users/752ab2d7490f485c88b648c3433adf24` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:07.477078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6863c-b2a7-4c04-853d-a48cd603c30c admin admin] RBAC: Authorizing `identity:delete_user(user_id=752ab2d7490f485c88b648c3433adf24)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:07.478138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: WARNING py.warnings [None req-bae6863c-b2a7-4c04-853d-a48cd603c30c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:15:07.478138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: warnings.warn(msg) Aug 09 11:15:07.478138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: Aug 09 11:15:07.479390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6863c-b2a7-4c04-853d-a48cd603c30c admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:07.491052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:07.549803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-bae6863c-b2a7-4c04-853d-a48cd603c30c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '752ab2d7490f485c88b648c3433adf24'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:15:07.561217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-bae6863c-b2a7-4c04-853d-a48cd603c30c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '752ab2d7490f485c88b648c3433adf24'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:15:07.561654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-bae6863c-b2a7-4c04-853d-a48cd603c30c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '752ab2d7490f485c88b648c3433adf24'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:15:07.575945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-bae6863c-b2a7-4c04-853d-a48cd603c30c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '752ab2d7490f485c88b648c3433adf24'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:15:07.599520 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-bae6863c-b2a7-4c04-853d-a48cd603c30c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '752ab2d7490f485c88b648c3433adf24'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:15:07.607742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 745/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:15:07 2022] DELETE /identity/v3/users/752ab2d7490f485c88b648c3433adf24 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:15:07.612374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900a0d6-092d-4dee-a066-67162e45e13a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:07.612656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900a0d6-092d-4dee-a066-67162e45e13a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:07.612919 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900a0d6-092d-4dee-a066-67162e45e13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:07.672549 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4900a0d6-092d-4dee-a066-67162e45e13a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:15:07.673799 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4900a0d6-092d-4dee-a066-67162e45e13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:07.755239 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:07.769238 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 763/1508] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:15:07.780401 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6863c-b2a7-4c04-853d-a48cd603c30c admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:07.781646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-bae6863c-b2a7-4c04-853d-a48cd603c30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:07.883866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6863c-b2a7-4c04-853d-a48cd603c30c admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:07.941120 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:07.964099 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630eaaa-5640-4ab2-a708-7e0fd5958d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:07.964744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630eaaa-5640-4ab2-a708-7e0fd5958d3f service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:07.965017 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630eaaa-5640-4ab2-a708-7e0fd5958d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:07.965281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630eaaa-5640-4ab2-a708-7e0fd5958d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:07.966927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e630eaaa-5640-4ab2-a708-7e0fd5958d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:08.099242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630eaaa-5640-4ab2-a708-7e0fd5958d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:08.100912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630eaaa-5640-4ab2-a708-7e0fd5958d3f service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:08.125068 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 746/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:15:08.514508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900a0d6-092d-4dee-a066-67162e45e13a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:15:08.515750 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4900a0d6-092d-4dee-a066-67162e45e13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:15:08.527685 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900a0d6-092d-4dee-a066-67162e45e13a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:15:08.626125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c172f-dcab-40cb-ae77-40182f146f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:15:08.626756 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c172f-dcab-40cb-ae77-40182f146f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:15:08.627026 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c172f-dcab-40cb-ae77-40182f146f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:15:08.627292 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c172f-dcab-40cb-ae77-40182f146f13 admin admin] PATH_INFO: `/v3/projects/faacf6c0142d495ea7cbdc93a57a7db0` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:15:08.637668 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c172f-dcab-40cb-ae77-40182f146f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faacf6c0142d495ea7cbdc93a57a7db0)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:15:08.638683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-cf4c172f-dcab-40cb-ae77-40182f146f13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:15:08.638683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: warnings.warn(msg) Aug 09 11:15:08.638683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: Aug 09 11:15:08.639881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c172f-dcab-40cb-ae77-40182f146f13 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:15:08.700003 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cf4c172f-dcab-40cb-ae77-40182f146f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faacf6c0142d495ea7cbdc93a57a7db0', 'request_id': 'req-cf4c172f-dcab-40cb-ae77-40182f146f13'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:15:08.706153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cf4c172f-dcab-40cb-ae77-40182f146f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faacf6c0142d495ea7cbdc93a57a7db0', 'request_id': 'req-cf4c172f-dcab-40cb-ae77-40182f146f13'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:15:08.717364 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cf4c172f-dcab-40cb-ae77-40182f146f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faacf6c0142d495ea7cbdc93a57a7db0', 'request_id': 'req-cf4c172f-dcab-40cb-ae77-40182f146f13'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:15:08.749315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cf4c172f-dcab-40cb-ae77-40182f146f13 admin admin] The token cache is being invalidate because project faacf6c0142d495ea7cbdc93a57a7db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:15:08.749597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cf4c172f-dcab-40cb-ae77-40182f146f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:15:08.750138 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cf4c172f-dcab-40cb-ae77-40182f146f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:15:08.751433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 764/1510] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:15:08 2022] DELETE /identity/v3/projects/faacf6c0142d495ea7cbdc93a57a7db0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:15:18.122123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=62 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:15:18.747309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:50.040936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3fa1-63cc-4987-a65c-d12ccbadeb86 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:50.041510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3fa1-63cc-4987-a65c-d12ccbadeb86 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:50.041510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc3fa1-63cc-4987-a65c-d12ccbadeb86 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:50.042838 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:16:50.048155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961571ca-4777-4eff-b592-4beaf47c50b7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:50.048889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961571ca-4777-4eff-b592-4beaf47c50b7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:50.048889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961571ca-4777-4eff-b592-4beaf47c50b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:50.136595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-961571ca-4777-4eff-b592-4beaf47c50b7 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:16:50.137855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-961571ca-4777-4eff-b592-4beaf47c50b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:16:50.250197 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:16:50.413544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3fa1-63cc-4987-a65c-d12ccbadeb86 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:50.415826 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c8dc3fa1-63cc-4987-a65c-d12ccbadeb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:16:50.547711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc3fa1-63cc-4987-a65c-d12ccbadeb86 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:50.553822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0577f-275b-4052-9027-e3c154ea145b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:50.554451 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0577f-275b-4052-9027-e3c154ea145b service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:50.554724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0577f-275b-4052-9027-e3c154ea145b service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:50.554990 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0577f-275b-4052-9027-e3c154ea145b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:50.563900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0577f-275b-4052-9027-e3c154ea145b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:50.565507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0577f-275b-4052-9027-e3c154ea145b service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:50.576066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 748/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:16:51.415947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f818c6-ed2e-4adf-9f61-84fc572a6ca2 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:51.416563 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f818c6-ed2e-4adf-9f61-84fc572a6ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:51.416563 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f818c6-ed2e-4adf-9f61-84fc572a6ca2 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:51.417896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:16:51.423577 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bebfe-7574-4eb6-bfe0-b0783e0b72ee None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:51.424174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bebfe-7574-4eb6-bfe0-b0783e0b72ee None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:51.424174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bebfe-7574-4eb6-bfe0-b0783e0b72ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:51.445439 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-827bebfe-7574-4eb6-bfe0-b0783e0b72ee None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:16:51.446739 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-827bebfe-7574-4eb6-bfe0-b0783e0b72ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:16:51.455921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:16:51.609090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f818c6-ed2e-4adf-9f61-84fc572a6ca2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:51.623978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f818c6-ed2e-4adf-9f61-84fc572a6ca2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:51.629870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b3633-b391-486f-8577-2b92b513f2ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:51.630486 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b3633-b391-486f-8577-2b92b513f2ef service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:51.630759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b3633-b391-486f-8577-2b92b513f2ef service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:51.631022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b3633-b391-486f-8577-2b92b513f2ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:51.639804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b3633-b391-486f-8577-2b92b513f2ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:51.641402 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b3633-b391-486f-8577-2b92b513f2ef service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:51.651728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 767/1516] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:16:52.189183 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d8e19-7966-4d97-b242-2246e89aff7a None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:52.189441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d8e19-7966-4d97-b242-2246e89aff7a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:52.189750 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d8e19-7966-4d97-b242-2246e89aff7a None None] PATH_INFO: `/v3` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:52.191066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 750/1517] 10.222.0.39 () {54 vars in 925 bytes} [Tue Aug 9 11:16:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:16:52.197499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d601c59-a813-4a38-a413-6ab9e920ac55 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:52.197826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d601c59-a813-4a38-a413-6ab9e920ac55 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:52.198098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d601c59-a813-4a38-a413-6ab9e920ac55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:52.260115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5d601c59-a813-4a38-a413-6ab9e920ac55 None None] MFA Rules not processed for user `a587c410fd8741f3b3858d21b9e4884d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:16:52.261334 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5d601c59-a813-4a38-a413-6ab9e920ac55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:16:52.279451 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:16:52.336720 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 768/1518] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Aug 9 11:16:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:16:56.250485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114e3fe-35a4-4dd5-8339-539492439900 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:56.251022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114e3fe-35a4-4dd5-8339-539492439900 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:56.251377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114e3fe-35a4-4dd5-8339-539492439900 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:56.253112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 751/1519] 10.222.0.15 () {54 vars in 961 bytes} [Tue Aug 9 11:16:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:16:56.258719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac514dfc-5e1a-43e9-b94b-eccabc74bace None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:56.259199 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac514dfc-5e1a-43e9-b94b-eccabc74bace None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:56.259412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac514dfc-5e1a-43e9-b94b-eccabc74bace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:56.278972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ac514dfc-5e1a-43e9-b94b-eccabc74bace None None] MFA Rules not processed for user `a587c410fd8741f3b3858d21b9e4884d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:16:56.280219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ac514dfc-5e1a-43e9-b94b-eccabc74bace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:16:56.289147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 769/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Tue Aug 9 11:16:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:16:56.297005 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114e3fe-35a4-4dd5-8339-539492439900 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:16:56.312178 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114e3fe-35a4-4dd5-8339-539492439900 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:16:56.317400 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ec864-d9c6-48f5-80ca-147c1609c790 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:16:56.318035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ec864-d9c6-48f5-80ca-147c1609c790 service placement] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:16:56.318310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ec864-d9c6-48f5-80ca-147c1609c790 service placement] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:16:56.318574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ec864-d9c6-48f5-80ca-147c1609c790 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:16:56.327942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ec864-d9c6-48f5-80ca-147c1609c790 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:16:56.329558 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ec864-d9c6-48f5-80ca-147c1609c790 service placement] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:16:56.340677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 752/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:16:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:17:02.904249 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e7dfe-557c-4126-bfb0-8c502e2c5285 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:02.904878 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e7dfe-557c-4126-bfb0-8c502e2c5285 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:02.904878 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e7dfe-557c-4126-bfb0-8c502e2c5285 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:02.906185 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:02.911631 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676d75-f075-40c6-92fa-c2fdab1c2e5c None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:02.912133 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676d75-f075-40c6-92fa-c2fdab1c2e5c None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:02.912133 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57676d75-f075-40c6-92fa-c2fdab1c2e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:02.935622 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-57676d75-f075-40c6-92fa-c2fdab1c2e5c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:02.936877 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-57676d75-f075-40c6-92fa-c2fdab1c2e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:02.952446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:17:03.104767 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e7dfe-557c-4126-bfb0-8c502e2c5285 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:03.129860 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e7dfe-557c-4126-bfb0-8c502e2c5285 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:03.136703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd5397-418a-4387-96bd-3a6874eb10fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:03.137323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd5397-418a-4387-96bd-3a6874eb10fe service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:03.137599 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd5397-418a-4387-96bd-3a6874eb10fe service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:03.137899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd5397-418a-4387-96bd-3a6874eb10fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:03.147385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd5397-418a-4387-96bd-3a6874eb10fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:03.148973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd5397-418a-4387-96bd-3a6874eb10fe service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:03.159416 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 771/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:17:03.970607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88fe7-a957-496c-a79c-455e8b7238b5 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:03.971295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88fe7-a957-496c-a79c-455e8b7238b5 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:03.971295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e88fe7-a957-496c-a79c-455e8b7238b5 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:03.972949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 11:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:03.978469 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0bfc9-1af0-4fbe-8e50-0ed75865b738 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:03.978980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0bfc9-1af0-4fbe-8e50-0ed75865b738 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:03.979093 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0bfc9-1af0-4fbe-8e50-0ed75865b738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:04.000084 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-74f0bfc9-1af0-4fbe-8e50-0ed75865b738 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:04.001301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-74f0bfc9-1af0-4fbe-8e50-0ed75865b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:04.009585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 11:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:17:04.161841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e88fe7-a957-496c-a79c-455e8b7238b5 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:04.178046 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e88fe7-a957-496c-a79c-455e8b7238b5 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:04.183985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed697e-aef5-4702-a5fd-b9fc4ab6a30c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:04.184588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed697e-aef5-4702-a5fd-b9fc4ab6a30c service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:04.184858 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed697e-aef5-4702-a5fd-b9fc4ab6a30c service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:04.185123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed697e-aef5-4702-a5fd-b9fc4ab6a30c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:04.194831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed697e-aef5-4702-a5fd-b9fc4ab6a30c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:04.196432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed697e-aef5-4702-a5fd-b9fc4ab6a30c service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:04.207065 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 755/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:17:08.265643 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cec7c8-3374-458f-aba5-74176d2225be None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:08.266336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cec7c8-3374-458f-aba5-74176d2225be None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:08.266336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cec7c8-3374-458f-aba5-74176d2225be None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:08.267573 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:08.273174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893223d-8f41-4791-811b-50f29be808b6 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:08.273718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893223d-8f41-4791-811b-50f29be808b6 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:08.273718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893223d-8f41-4791-811b-50f29be808b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:08.298964 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-f893223d-8f41-4791-811b-50f29be808b6 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:08.300199 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f893223d-8f41-4791-811b-50f29be808b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:08.310433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:17:08.401422 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cec7c8-3374-458f-aba5-74176d2225be None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:08.403492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-56cec7c8-3374-458f-aba5-74176d2225be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:08.500685 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cec7c8-3374-458f-aba5-74176d2225be None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:08.504411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63417ce-ccd6-428a-ab81-7f782c1189f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:08.505017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63417ce-ccd6-428a-ab81-7f782c1189f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:08.505287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63417ce-ccd6-428a-ab81-7f782c1189f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:08.505547 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63417ce-ccd6-428a-ab81-7f782c1189f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:08.521333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63417ce-ccd6-428a-ab81-7f782c1189f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:08.522837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63417ce-ccd6-428a-ab81-7f782c1189f1 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:08.533166 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 774/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:17:10.547571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503757b0-a0f0-4758-81f3-3d5e7582c6cf None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:10.548157 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503757b0-a0f0-4758-81f3-3d5e7582c6cf None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:10.548157 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503757b0-a0f0-4758-81f3-3d5e7582c6cf None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:10.549432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:10.554810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44cb67-f32b-41f2-8f89-5dd88bb53e3a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:10.555277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44cb67-f32b-41f2-8f89-5dd88bb53e3a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:10.555379 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44cb67-f32b-41f2-8f89-5dd88bb53e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:10.575934 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fe44cb67-f32b-41f2-8f89-5dd88bb53e3a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:10.577123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fe44cb67-f32b-41f2-8f89-5dd88bb53e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:10.586299 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:17:10.623230 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503757b0-a0f0-4758-81f3-3d5e7582c6cf None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:10.625292 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-503757b0-a0f0-4758-81f3-3d5e7582c6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:10.639726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503757b0-a0f0-4758-81f3-3d5e7582c6cf None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:10.643695 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7f126-7dc1-4efc-9f55-31fe46938ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:10.644290 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7f126-7dc1-4efc-9f55-31fe46938ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:10.644561 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7f126-7dc1-4efc-9f55-31fe46938ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:10.644827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7f126-7dc1-4efc-9f55-31fe46938ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:10.657704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7f126-7dc1-4efc-9f55-31fe46938ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:10.659198 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7f126-7dc1-4efc-9f55-31fe46938ae4 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:10.669914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 758/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:17:14.226581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abb442-45d8-4585-a7be-635e0a35e191 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:14.227190 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abb442-45d8-4585-a7be-635e0a35e191 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:14.227190 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abb442-45d8-4585-a7be-635e0a35e191 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:14.228455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:14.234034 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea67e3-7b28-4d38-bdab-3e0fa4a1e082 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:14.234477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea67e3-7b28-4d38-bdab-3e0fa4a1e082 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:14.234595 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea67e3-7b28-4d38-bdab-3e0fa4a1e082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:14.256689 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-77ea67e3-7b28-4d38-bdab-3e0fa4a1e082 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:14.257954 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-77ea67e3-7b28-4d38-bdab-3e0fa4a1e082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:14.267497 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:17:14.585651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abb442-45d8-4585-a7be-635e0a35e191 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:14.587696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-62abb442-45d8-4585-a7be-635e0a35e191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:14.657986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:14.672762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abb442-45d8-4585-a7be-635e0a35e191 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:14.676958 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52b01c-3d3f-4885-8a5b-dbe5d65a511e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:14.677583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52b01c-3d3f-4885-8a5b-dbe5d65a511e service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:14.677903 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52b01c-3d3f-4885-8a5b-dbe5d65a511e service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:14.678169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52b01c-3d3f-4885-8a5b-dbe5d65a511e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:14.688453 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52b01c-3d3f-4885-8a5b-dbe5d65a511e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:14.689970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52b01c-3d3f-4885-8a5b-dbe5d65a511e service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:14.699471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 777/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:17:16.721647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c9aa9-bff7-48d3-adda-62e74eedff4a None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:16.722327 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c9aa9-bff7-48d3-adda-62e74eedff4a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:16.722327 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c9aa9-bff7-48d3-adda-62e74eedff4a None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:16.723577 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 11:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:17:16.728908 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea04ec-4be8-4285-8f90-55ba2b4bb70c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:16.729480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea04ec-4be8-4285-8f90-55ba2b4bb70c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:16.729480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea04ec-4be8-4285-8f90-55ba2b4bb70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:16.751527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-66ea04ec-4be8-4285-8f90-55ba2b4bb70c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:17:16.752705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-66ea04ec-4be8-4285-8f90-55ba2b4bb70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:16.761481 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 11:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:17:17.067797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c9aa9-bff7-48d3-adda-62e74eedff4a None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:17:17.069747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-1c8c9aa9-bff7-48d3-adda-62e74eedff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:17:17.083982 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c9aa9-bff7-48d3-adda-62e74eedff4a None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:17:17.088363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c3b81-9c7c-40e0-9c10-86d33e09574a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:17:17.089296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c3b81-9c7c-40e0-9c10-86d33e09574a service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:17:17.089798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c3b81-9c7c-40e0-9c10-86d33e09574a service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:17:17.090123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c3b81-9c7c-40e0-9c10-86d33e09574a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:17:17.101823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c3b81-9c7c-40e0-9c10-86d33e09574a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:17:17.103295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c3b81-9c7c-40e0-9c10-86d33e09574a service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:17:17.113672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 761/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:17:26.745827 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=11 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:17:27.108774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:53.017682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd684c1-9050-4fed-9620-a9f86e9d2689 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.018620 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd684c1-9050-4fed-9620-a9f86e9d2689 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.018620 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd684c1-9050-4fed-9620-a9f86e9d2689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.042688 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3fd684c1-9050-4fed-9620-a9f86e9d2689 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.044270 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3fd684c1-9050-4fed-9620-a9f86e9d2689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.057727 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 779/1540] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:18:53.067728 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa60a-38bf-4e3d-a51d-dbfdb571fefa None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.068843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa60a-38bf-4e3d-a51d-dbfdb571fefa None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.069285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afa60a-38bf-4e3d-a51d-dbfdb571fefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.103749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-46afa60a-38bf-4e3d-a51d-dbfdb571fefa None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.105293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-46afa60a-38bf-4e3d-a51d-dbfdb571fefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.121593 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 762/1541] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:53.126841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd684c1-9050-4fed-9620-a9f86e9d2689 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:53.144594 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd684c1-9050-4fed-9620-a9f86e9d2689 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:53.159343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc72b68-c8df-46b0-94de-5cd6ae1cddb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:53.160289 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc72b68-c8df-46b0-94de-5cd6ae1cddb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.160814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc72b68-c8df-46b0-94de-5cd6ae1cddb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.161246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc72b68-c8df-46b0-94de-5cd6ae1cddb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.162112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc72b68-c8df-46b0-94de-5cd6ae1cddb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:18:53.162649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc72b68-c8df-46b0-94de-5cd6ae1cddb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:53.165112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc72b68-c8df-46b0-94de-5cd6ae1cddb4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:53.186015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 780/1542] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:18:53.194878 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa60a-38bf-4e3d-a51d-dbfdb571fefa None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:53.207429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d99ba-72b3-4925-84c1-bcc0eb02c585 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.208494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afa60a-38bf-4e3d-a51d-dbfdb571fefa None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:53.214107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d99ba-72b3-4925-84c1-bcc0eb02c585 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.215465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d99ba-72b3-4925-84c1-bcc0eb02c585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.228655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a706254-bd93-4315-afc5-21e369832651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:53.229291 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a706254-bd93-4315-afc5-21e369832651 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.229558 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a706254-bd93-4315-afc5-21e369832651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.230019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a706254-bd93-4315-afc5-21e369832651 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.230477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a706254-bd93-4315-afc5-21e369832651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:53.232453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a706254-bd93-4315-afc5-21e369832651 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:53.257582 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bc7d99ba-72b3-4925-84c1-bcc0eb02c585 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.259199 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bc7d99ba-72b3-4925-84c1-bcc0eb02c585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.285679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 781/1543] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:53.300899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb1cb0-5e13-4923-b0e9-126a29bf82d3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.301465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb1cb0-5e13-4923-b0e9-126a29bf82d3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.301943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb1cb0-5e13-4923-b0e9-126a29bf82d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.337720 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-86fb1cb0-5e13-4923-b0e9-126a29bf82d3 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.338002 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 763/1544] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:53.339859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a706254-bd93-4315-afc5-21e369832651 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:53.340757 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-86fb1cb0-5e13-4923-b0e9-126a29bf82d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.487681 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 782/1545] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:18:53.502291 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91aa88-bcfe-4008-9d24-cf4fd737bab9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.503021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91aa88-bcfe-4008-9d24-cf4fd737bab9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.503710 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91aa88-bcfe-4008-9d24-cf4fd737bab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.573219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bd91aa88-bcfe-4008-9d24-cf4fd737bab9 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.581139 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bd91aa88-bcfe-4008-9d24-cf4fd737bab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.589985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a706254-bd93-4315-afc5-21e369832651 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:53.602146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 783/1546] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:53.605009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91aa88-bcfe-4008-9d24-cf4fd737bab9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:53.606172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e01c8-1eb8-42e5-a5dc-892cb910fb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:53.607186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e01c8-1eb8-42e5-a5dc-892cb910fb9a admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.607706 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e01c8-1eb8-42e5-a5dc-892cb910fb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.608886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e01c8-1eb8-42e5-a5dc-892cb910fb9a admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.611327 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e01c8-1eb8-42e5-a5dc-892cb910fb9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:53.614353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: WARNING py.warnings [None req-ba0e01c8-1eb8-42e5-a5dc-892cb910fb9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:18:53.614353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: warnings.warn(msg) Aug 09 11:18:53.614353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: Aug 09 11:18:53.620345 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e01c8-1eb8-42e5-a5dc-892cb910fb9a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:53.634316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91aa88-bcfe-4008-9d24-cf4fd737bab9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:53.647035 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ac990-e676-4eda-9302-05e5ca7c81e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:53.647769 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac990-e676-4eda-9302-05e5ca7c81e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.648048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac990-e676-4eda-9302-05e5ca7c81e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.648321 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac990-e676-4eda-9302-05e5ca7c81e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.649063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ac990-e676-4eda-9302-05e5ca7c81e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:18:53.649334 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ac990-e676-4eda-9302-05e5ca7c81e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:53.651097 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ac990-e676-4eda-9302-05e5ca7c81e7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:53.677867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 784/1547] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:18:53.678746 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 764/1548] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/users => generated 286 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:53.679335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4a02c-f6f7-4f8e-837a-2381a1bc520a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.679626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4a02c-f6f7-4f8e-837a-2381a1bc520a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.680046 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4a02c-f6f7-4f8e-837a-2381a1bc520a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.682602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aca9b1-5c99-469d-8ddf-153122c1fa24 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.684078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aca9b1-5c99-469d-8ddf-153122c1fa24 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.685077 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aca9b1-5c99-469d-8ddf-153122c1fa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.710487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-84aca9b1-5c99-469d-8ddf-153122c1fa24 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.711748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-84aca9b1-5c99-469d-8ddf-153122c1fa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.723851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f6c4a02c-f6f7-4f8e-837a-2381a1bc520a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.725116 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f6c4a02c-f6f7-4f8e-837a-2381a1bc520a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.730617 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 765/1549] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:53.731936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dbbdd-81c4-415a-a201-3f8668e60d16 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.732212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dbbdd-81c4-415a-a201-3f8668e60d16 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.732482 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dbbdd-81c4-415a-a201-3f8668e60d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.737665 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 785/1550] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:53.740086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db189b-4294-498a-91dc-47ba6ddf5a54 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.740368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db189b-4294-498a-91dc-47ba6ddf5a54 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.740641 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db189b-4294-498a-91dc-47ba6ddf5a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.760000 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-405dbbdd-81c4-415a-a201-3f8668e60d16 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.761256 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-405dbbdd-81c4-415a-a201-3f8668e60d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.770456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f9db189b-4294-498a-91dc-47ba6ddf5a54 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.771185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 766/1551] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:53.771948 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dbbdd-81c4-415a-a201-3f8668e60d16 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:53.772631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f9db189b-4294-498a-91dc-47ba6ddf5a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.782042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dbbdd-81c4-415a-a201-3f8668e60d16 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:53.793895 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 786/1552] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:53.793895 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db189b-4294-498a-91dc-47ba6ddf5a54 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:53.794223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fc0f9-3e21-4416-8936-80b44f7b5b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:53.794223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fc0f9-3e21-4416-8936-80b44f7b5b9e admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.794223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fc0f9-3e21-4416-8936-80b44f7b5b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.794223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fc0f9-3e21-4416-8936-80b44f7b5b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.794606 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fc0f9-3e21-4416-8936-80b44f7b5b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:53.794606 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fc0f9-3e21-4416-8936-80b44f7b5b9e admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:53.799917 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db189b-4294-498a-91dc-47ba6ddf5a54 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:53.805989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7d7b8-db28-4f34-a827-24a98b82c39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:53.806779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7d7b8-db28-4f34-a827-24a98b82c39c admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.807063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7d7b8-db28-4f34-a827-24a98b82c39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.807471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7d7b8-db28-4f34-a827-24a98b82c39c admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.808240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b7d7b8-db28-4f34-a827-24a98b82c39c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:53.812198 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 767/1553] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:53.812384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-b9b7d7b8-db28-4f34-a827-24a98b82c39c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:18:53.812384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: warnings.warn(msg) Aug 09 11:18:53.812384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: Aug 09 11:18:53.812384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b7d7b8-db28-4f34-a827-24a98b82c39c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:53.812741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e598e-7ca9-4c55-b8d1-9b8c0ce12ac4 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.812741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e598e-7ca9-4c55-b8d1-9b8c0ce12ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.813035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e598e-7ca9-4c55-b8d1-9b8c0ce12ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.839371 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-8f7e598e-7ca9-4c55-b8d1-9b8c0ce12ac4 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.840680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8f7e598e-7ca9-4c55-b8d1-9b8c0ce12ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.854214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 787/1554] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:53.854214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429a802-a87a-46eb-b6e2-d06c3675cff9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.854214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429a802-a87a-46eb-b6e2-d06c3675cff9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.854214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429a802-a87a-46eb-b6e2-d06c3675cff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.855463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 768/1555] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:53.856857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d8471-310a-4ed1-b119-7fcf8543e319 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.857269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d8471-310a-4ed1-b119-7fcf8543e319 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.857679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d8471-310a-4ed1-b119-7fcf8543e319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.884195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7429a802-a87a-46eb-b6e2-d06c3675cff9 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.885494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7429a802-a87a-46eb-b6e2-d06c3675cff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.890744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-428d8471-310a-4ed1-b119-7fcf8543e319 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.892012 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-428d8471-310a-4ed1-b119-7fcf8543e319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.953796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 788/1556] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:53.955098 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 769/1557] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:53.955824 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc035-96fb-4c26-b5c7-135e87f16e8f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.956007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d8471-310a-4ed1-b119-7fcf8543e319 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:53.956399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc035-96fb-4c26-b5c7-135e87f16e8f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.956843 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc035-96fb-4c26-b5c7-135e87f16e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.968755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d8471-310a-4ed1-b119-7fcf8543e319 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:53.974155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1f8e0-73b5-4b3f-83e3-788176c15424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:53.974791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1f8e0-73b5-4b3f-83e3-788176c15424 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.975063 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1f8e0-73b5-4b3f-83e3-788176c15424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.975329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1f8e0-73b5-4b3f-83e3-788176c15424 admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.975989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1f8e0-73b5-4b3f-83e3-788176c15424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:18:53.976309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1f8e0-73b5-4b3f-83e3-788176c15424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:53.977319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: WARNING py.warnings [None req-d0f1f8e0-73b5-4b3f-83e3-788176c15424 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:18:53.977319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: warnings.warn(msg) Aug 09 11:18:53.977319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: Aug 09 11:18:53.978245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1f8e0-73b5-4b3f-83e3-788176c15424 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:53.979383 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-49fdc035-96fb-4c26-b5c7-135e87f16e8f None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:53.980604 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-49fdc035-96fb-4c26-b5c7-135e87f16e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:53.991036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 770/1558] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:18:53.997649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 789/1559] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:53.997871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3c64a-6662-4841-a5b9-c0773b414b18 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:53.997871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3c64a-6662-4841-a5b9-c0773b414b18 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:53.997871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3c64a-6662-4841-a5b9-c0773b414b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:53.998130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdc035-96fb-4c26-b5c7-135e87f16e8f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.014218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdc035-96fb-4c26-b5c7-135e87f16e8f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.017660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-a1a3c64a-6662-4841-a5b9-c0773b414b18 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:54.018913 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a1a3c64a-6662-4841-a5b9-c0773b414b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:54.019772 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0f575-75b8-4ebb-9549-dd71578f32fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.020855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0f575-75b8-4ebb-9549-dd71578f32fb admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.021161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0f575-75b8-4ebb-9549-dd71578f32fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.021416 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0f575-75b8-4ebb-9549-dd71578f32fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.022232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0f575-75b8-4ebb-9549-dd71578f32fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.024798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0f575-75b8-4ebb-9549-dd71578f32fb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.027254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 771/1560] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:54.028106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3c64a-6662-4841-a5b9-c0773b414b18 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.033026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:54.040723 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 790/1561] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:54.042054 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3c64a-6662-4841-a5b9-c0773b414b18 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.042191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2cddb-e4cf-4499-8728-bd0e5c1c7c26 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.042476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2cddb-e4cf-4499-8728-bd0e5c1c7c26 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.042771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2cddb-e4cf-4499-8728-bd0e5c1c7c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.049677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fece1-fc4d-43c4-8624-55768935e441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.050305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fece1-fc4d-43c4-8624-55768935e441 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.050822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fece1-fc4d-43c4-8624-55768935e441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.051017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:54.051138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fece1-fc4d-43c4-8624-55768935e441 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.051784 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fece1-fc4d-43c4-8624-55768935e441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.055142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fece1-fc4d-43c4-8624-55768935e441 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.067045 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8ec2cddb-e4cf-4499-8728-bd0e5c1c7c26 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:54.069403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8ec2cddb-e4cf-4499-8728-bd0e5c1c7c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:54.079989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 772/1562] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:18:54 2022] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:54.081062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fece1-fc4d-43c4-8624-55768935e441 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.083344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 791/1563] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:54.085889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b478e-b536-4a8e-9a85-37ba6f26732b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.086387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b478e-b536-4a8e-9a85-37ba6f26732b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.087049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b478e-b536-4a8e-9a85-37ba6f26732b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.092359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fece1-fc4d-43c4-8624-55768935e441 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.097341 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263272-5904-48d1-9b15-53957e461132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.098008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263272-5904-48d1-9b15-53957e461132 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.098281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263272-5904-48d1-9b15-53957e461132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.098550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263272-5904-48d1-9b15-53957e461132 admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.099214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4263272-5904-48d1-9b15-53957e461132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:18:54.099513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4263272-5904-48d1-9b15-53957e461132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.101165 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4263272-5904-48d1-9b15-53957e461132 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.111746 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b34b478e-b536-4a8e-9a85-37ba6f26732b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:54.114009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b34b478e-b536-4a8e-9a85-37ba6f26732b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:54.114989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 773/1564] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:18:54.115813 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263272-5904-48d1-9b15-53957e461132 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.127885 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 792/1565] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:54.129276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b478e-b536-4a8e-9a85-37ba6f26732b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.129431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263272-5904-48d1-9b15-53957e461132 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.136892 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4280f82-4067-4dbc-a591-e86daf96e9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.137510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4280f82-4067-4dbc-a591-e86daf96e9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.137906 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4280f82-4067-4dbc-a591-e86daf96e9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.138227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4280f82-4067-4dbc-a591-e86daf96e9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.138874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4280f82-4067-4dbc-a591-e86daf96e9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.139011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b478e-b536-4a8e-9a85-37ba6f26732b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.140856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4280f82-4067-4dbc-a591-e86daf96e9c9 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.143613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9422c-8630-4b81-9470-a2d0cc092b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.144221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9422c-8630-4b81-9470-a2d0cc092b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.144486 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9422c-8630-4b81-9470-a2d0cc092b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.144747 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9422c-8630-4b81-9470-a2d0cc092b7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.145387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9422c-8630-4b81-9470-a2d0cc092b7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:18:54.145717 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9422c-8630-4b81-9470-a2d0cc092b7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.147311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9422c-8630-4b81-9470-a2d0cc092b7c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.162340 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 793/1566] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:18:54.163581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9422c-8630-4b81-9470-a2d0cc092b7c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.175760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 774/1567] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:18:54 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:54.176919 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4280f82-4067-4dbc-a591-e86daf96e9c9 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.181489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9422c-8630-4b81-9470-a2d0cc092b7c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.254940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0cd0e-a05a-4500-ade1-b81cb30ddf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.255719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0cd0e-a05a-4500-ade1-b81cb30ddf28 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.255934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4280f82-4067-4dbc-a591-e86daf96e9c9 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.256176 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0cd0e-a05a-4500-ade1-b81cb30ddf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.256600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0cd0e-a05a-4500-ade1-b81cb30ddf28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.257519 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0cd0e-a05a-4500-ade1-b81cb30ddf28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:18:54.258007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0cd0e-a05a-4500-ade1-b81cb30ddf28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.259969 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0cd0e-a05a-4500-ade1-b81cb30ddf28 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.261376 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71baa65-b850-41a1-bafb-16bd63b03e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.262125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71baa65-b850-41a1-bafb-16bd63b03e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.262398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71baa65-b850-41a1-bafb-16bd63b03e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.262738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71baa65-b850-41a1-bafb-16bd63b03e15 admin admin] PATH_INFO: `/v3/projects/796611bb042c46e2958c96ee9c535ea5/users/c0b38e1fc1714613b4363048ec02657b/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.278069 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 794/1568] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:18:54.279427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0cd0e-a05a-4500-ade1-b81cb30ddf28 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.281052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71baa65-b850-41a1-bafb-16bd63b03e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=796611bb042c46e2958c96ee9c535ea5, user_id=c0b38e1fc1714613b4363048ec02657b, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.283960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71baa65-b850-41a1-bafb-16bd63b03e15 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.294232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0cd0e-a05a-4500-ade1-b81cb30ddf28 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.300949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 775/1569] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:18:54 2022] PUT /identity/v3/projects/796611bb042c46e2958c96ee9c535ea5/users/c0b38e1fc1714613b4363048ec02657b/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:18:54.303097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71baa65-b850-41a1-bafb-16bd63b03e15 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.372488 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a77a4-51b1-4756-afc5-83a39f8fc8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.373024 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a77a4-51b1-4756-afc5-83a39f8fc8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.373299 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a77a4-51b1-4756-afc5-83a39f8fc8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.373574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a77a4-51b1-4756-afc5-83a39f8fc8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.374295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a77a4-51b1-4756-afc5-83a39f8fc8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.376149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a77a4-51b1-4756-afc5-83a39f8fc8a8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.387463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71baa65-b850-41a1-bafb-16bd63b03e15 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.387844 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 795/1570] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:54.391534 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a77a4-51b1-4756-afc5-83a39f8fc8a8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.393278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399a059-ad10-4e56-b082-dd47340992c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.393930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399a059-ad10-4e56-b082-dd47340992c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.394203 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399a059-ad10-4e56-b082-dd47340992c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.394472 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399a059-ad10-4e56-b082-dd47340992c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.395137 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399a059-ad10-4e56-b082-dd47340992c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:18:54.395452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399a059-ad10-4e56-b082-dd47340992c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.397108 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399a059-ad10-4e56-b082-dd47340992c6 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.402471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a77a4-51b1-4756-afc5-83a39f8fc8a8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.407399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e224d-f87e-486d-9b3e-5f28da6d45f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.408076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e224d-f87e-486d-9b3e-5f28da6d45f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.408348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e224d-f87e-486d-9b3e-5f28da6d45f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.408610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e224d-f87e-486d-9b3e-5f28da6d45f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.409252 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e224d-f87e-486d-9b3e-5f28da6d45f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.423391 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 776/1571] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:18:54.423708 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e224d-f87e-486d-9b3e-5f28da6d45f4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.423859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399a059-ad10-4e56-b082-dd47340992c6 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.428461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399a059-ad10-4e56-b082-dd47340992c6 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.434094 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39309ec3-be62-4c49-8e4a-09ef49e02e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.434828 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39309ec3-be62-4c49-8e4a-09ef49e02e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.435106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39309ec3-be62-4c49-8e4a-09ef49e02e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.435376 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39309ec3-be62-4c49-8e4a-09ef49e02e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.436037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39309ec3-be62-4c49-8e4a-09ef49e02e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:18:54.436377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39309ec3-be62-4c49-8e4a-09ef49e02e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.438319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39309ec3-be62-4c49-8e4a-09ef49e02e20 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.445570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 796/1572] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:18:54 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:54.446429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e224d-f87e-486d-9b3e-5f28da6d45f4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.459678 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 777/1573] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:18:54.460853 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39309ec3-be62-4c49-8e4a-09ef49e02e20 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.473397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39309ec3-be62-4c49-8e4a-09ef49e02e20 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.497520 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:54.504962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:54.534365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e224d-f87e-486d-9b3e-5f28da6d45f4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.541168 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88cd79-e774-4b13-b74d-dc1ade618a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.541827 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88cd79-e774-4b13-b74d-dc1ade618a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.542105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88cd79-e774-4b13-b74d-dc1ade618a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.542377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88cd79-e774-4b13-b74d-dc1ade618a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.543026 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88cd79-e774-4b13-b74d-dc1ade618a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.545027 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88cd79-e774-4b13-b74d-dc1ade618a4e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.576327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 797/1574] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:18:54 2022] POST /identity/v3/projects => generated 355 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:54.581736 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88cd79-e774-4b13-b74d-dc1ade618a4e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.583644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7338746-a01b-4323-9ccc-fd77282f30c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.584427 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7338746-a01b-4323-9ccc-fd77282f30c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.584796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7338746-a01b-4323-9ccc-fd77282f30c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.585235 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7338746-a01b-4323-9ccc-fd77282f30c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.586914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7338746-a01b-4323-9ccc-fd77282f30c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.588358 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7338746-a01b-4323-9ccc-fd77282f30c4 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.616618 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 778/1575] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:18:54 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:54.619610 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488552-030d-4378-a0e0-3d19d85410c7 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.620106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488552-030d-4378-a0e0-3d19d85410c7 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.620572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488552-030d-4378-a0e0-3d19d85410c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.658095 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-16488552-030d-4378-a0e0-3d19d85410c7 None None] MFA Rules not processed for user `c0b38e1fc1714613b4363048ec02657b`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:54.659226 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-16488552-030d-4378-a0e0-3d19d85410c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:54.664246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88cd79-e774-4b13-b74d-dc1ade618a4e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.671918 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74e5e4-b5ab-421a-b262-5f329d7d8bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.672556 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74e5e4-b5ab-421a-b262-5f329d7d8bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.672834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74e5e4-b5ab-421a-b262-5f329d7d8bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.673100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74e5e4-b5ab-421a-b262-5f329d7d8bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.673776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74e5e4-b5ab-421a-b262-5f329d7d8bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.675712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74e5e4-b5ab-421a-b262-5f329d7d8bb0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.706851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 798/1576] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:18:54 2022] POST /identity/v3/projects => generated 393 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:54.707789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74e5e4-b5ab-421a-b262-5f329d7d8bb0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.745968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 779/1577] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:54.747253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16488552-030d-4378-a0e0-3d19d85410c7 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.761924 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16488552-030d-4378-a0e0-3d19d85410c7 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.795823 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74e5e4-b5ab-421a-b262-5f329d7d8bb0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.801336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb249ab-f8a5-4030-a4fd-0bc87a312317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.802097 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb249ab-f8a5-4030-a4fd-0bc87a312317 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.802293 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb249ab-f8a5-4030-a4fd-0bc87a312317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.802581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb249ab-f8a5-4030-a4fd-0bc87a312317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.803215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb249ab-f8a5-4030-a4fd-0bc87a312317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.804822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb249ab-f8a5-4030-a4fd-0bc87a312317 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.817285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 799/1578] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:54.817881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb249ab-f8a5-4030-a4fd-0bc87a312317 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.828306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb249ab-f8a5-4030-a4fd-0bc87a312317 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.833123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79659aca-6c3b-4034-a2ac-d3b5a3303857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.833757 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79659aca-6c3b-4034-a2ac-d3b5a3303857 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.834030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79659aca-6c3b-4034-a2ac-d3b5a3303857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.834293 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79659aca-6c3b-4034-a2ac-d3b5a3303857 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.834916 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79659aca-6c3b-4034-a2ac-d3b5a3303857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.836832 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79659aca-6c3b-4034-a2ac-d3b5a3303857 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.849231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81320cad-83f2-4499-b213-dea90d594c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.850469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81320cad-83f2-4499-b213-dea90d594c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.850759 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81320cad-83f2-4499-b213-dea90d594c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.851133 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81320cad-83f2-4499-b213-dea90d594c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.852362 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81320cad-83f2-4499-b213-dea90d594c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.856443 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81320cad-83f2-4499-b213-dea90d594c51 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.860771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 800/1579] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:18:54 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:54.861762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79659aca-6c3b-4034-a2ac-d3b5a3303857 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.873571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79659aca-6c3b-4034-a2ac-d3b5a3303857 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:54.879934 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44c3eb-b48d-40ee-abe5-20323c7dce34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:54.880677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44c3eb-b48d-40ee-abe5-20323c7dce34 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:54.880972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44c3eb-b48d-40ee-abe5-20323c7dce34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:54.881452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44c3eb-b48d-40ee-abe5-20323c7dce34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:54.882413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44c3eb-b48d-40ee-abe5-20323c7dce34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:54.885082 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44c3eb-b48d-40ee-abe5-20323c7dce34 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:54.892190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 780/1580] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:18:54 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:54.893119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81320cad-83f2-4499-b213-dea90d594c51 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.916243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:54.925854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 801/1581] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:18:54 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:54.927057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44c3eb-b48d-40ee-abe5-20323c7dce34 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:54.945885 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:54.971721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81320cad-83f2-4499-b213-dea90d594c51 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.010039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44c3eb-b48d-40ee-abe5-20323c7dce34 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.014795 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951805d7-209e-4809-8502-bec2a44e2b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.018354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951805d7-209e-4809-8502-bec2a44e2b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.018354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951805d7-209e-4809-8502-bec2a44e2b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.018354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951805d7-209e-4809-8502-bec2a44e2b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.018354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951805d7-209e-4809-8502-bec2a44e2b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.020424 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951805d7-209e-4809-8502-bec2a44e2b1f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.033449 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 802/1582] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:55.037427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951805d7-209e-4809-8502-bec2a44e2b1f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.045662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78699a32-35cb-4fee-bbf5-011dc70cb5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.046611 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78699a32-35cb-4fee-bbf5-011dc70cb5bc admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.047048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78699a32-35cb-4fee-bbf5-011dc70cb5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.047483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78699a32-35cb-4fee-bbf5-011dc70cb5bc admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.048514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78699a32-35cb-4fee-bbf5-011dc70cb5bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.051664 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951805d7-209e-4809-8502-bec2a44e2b1f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.051971 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78699a32-35cb-4fee-bbf5-011dc70cb5bc admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.062834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc0be6-e0c4-41ab-b821-910d40d0c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.064057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc0be6-e0c4-41ab-b821-910d40d0c956 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.064969 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc0be6-e0c4-41ab-b821-910d40d0c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.065508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc0be6-e0c4-41ab-b821-910d40d0c956 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.066980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc0be6-e0c4-41ab-b821-910d40d0c956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.071145 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc0be6-e0c4-41ab-b821-910d40d0c956 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.080817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 781/1583] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:18:54 2022] POST /identity/v3/users => generated 278 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:55.082638 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d819b48-f74a-4ac6-a670-f25c9590c439 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.082977 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d819b48-f74a-4ac6-a670-f25c9590c439 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.083305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d819b48-f74a-4ac6-a670-f25c9590c439 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.085330 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 782/1584] 10.222.0.15 () {54 vars in 962 bytes} [Tue Aug 9 11:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:55.086293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d819b48-f74a-4ac6-a670-f25c9590c439 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.106369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d819b48-f74a-4ac6-a670-f25c9590c439 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.109991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf18e0e-dcad-444d-8826-ab1055b30309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.111209 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf18e0e-dcad-444d-8826-ab1055b30309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.111751 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf18e0e-dcad-444d-8826-ab1055b30309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.112383 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf18e0e-dcad-444d-8826-ab1055b30309 admin admin] PATH_INFO: `/v3/projects/2f205ecaab074cd39079edad36cfb753/users/a8bb876492e24d609dc80e6ce13d4650/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.118235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 803/1585] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:18:55 2022] POST /identity/v3/users => generated 297 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:55.119258 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc0be6-e0c4-41ab-b821-910d40d0c956 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.136354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc0be6-e0c4-41ab-b821-910d40d0c956 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.138292 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf18e0e-dcad-444d-8826-ab1055b30309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f205ecaab074cd39079edad36cfb753, user_id=a8bb876492e24d609dc80e6ce13d4650, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.142948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b637c76-41d5-4f5f-a85b-3dca7b924990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.143336 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf18e0e-dcad-444d-8826-ab1055b30309 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.143914 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b637c76-41d5-4f5f-a85b-3dca7b924990 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.144348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b637c76-41d5-4f5f-a85b-3dca7b924990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.144811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b637c76-41d5-4f5f-a85b-3dca7b924990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.145887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b637c76-41d5-4f5f-a85b-3dca7b924990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.148676 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b637c76-41d5-4f5f-a85b-3dca7b924990 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.164944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 783/1586] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:18:55 2022] PUT /identity/v3/projects/2f205ecaab074cd39079edad36cfb753/users/a8bb876492e24d609dc80e6ce13d4650/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:18:55.165837 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf18e0e-dcad-444d-8826-ab1055b30309 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.166732 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 804/1587] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:55.168058 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b637c76-41d5-4f5f-a85b-3dca7b924990 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.188560 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b637c76-41d5-4f5f-a85b-3dca7b924990 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.258281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf18e0e-dcad-444d-8826-ab1055b30309 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.264170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dd135-a1a4-4ba5-8aaa-18493e953aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.264903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dd135-a1a4-4ba5-8aaa-18493e953aaa admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.265229 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dd135-a1a4-4ba5-8aaa-18493e953aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.265445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dd135-a1a4-4ba5-8aaa-18493e953aaa admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.266118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dd135-a1a4-4ba5-8aaa-18493e953aaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.266593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed7912-0d78-499f-8953-71a5d80f9864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.267326 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed7912-0d78-499f-8953-71a5d80f9864 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.267603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed7912-0d78-499f-8953-71a5d80f9864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.267878 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed7912-0d78-499f-8953-71a5d80f9864 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.268240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dd135-a1a4-4ba5-8aaa-18493e953aaa admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.268923 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed7912-0d78-499f-8953-71a5d80f9864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.272824 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed7912-0d78-499f-8953-71a5d80f9864 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.296438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 784/1588] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:18:55 2022] POST /identity/v3/users => generated 284 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:55.297800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 805/1589] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:18:55 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:55.298338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dd135-a1a4-4ba5-8aaa-18493e953aaa admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.301875 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed7912-0d78-499f-8953-71a5d80f9864 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.309967 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dd135-a1a4-4ba5-8aaa-18493e953aaa admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.313190 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed7912-0d78-499f-8953-71a5d80f9864 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.315049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040afee-e8bf-4339-9343-904511d7a204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.315815 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040afee-e8bf-4339-9343-904511d7a204 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.316081 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040afee-e8bf-4339-9343-904511d7a204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.316349 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040afee-e8bf-4339-9343-904511d7a204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.316999 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040afee-e8bf-4339-9343-904511d7a204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.318591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc28311-1244-4ff6-9521-3395e274fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.318795 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040afee-e8bf-4339-9343-904511d7a204 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.319203 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc28311-1244-4ff6-9521-3395e274fdec admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.319482 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc28311-1244-4ff6-9521-3395e274fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.319750 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc28311-1244-4ff6-9521-3395e274fdec admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.320392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc28311-1244-4ff6-9521-3395e274fdec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.322059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc28311-1244-4ff6-9521-3395e274fdec admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.329724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 785/1590] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:55.330993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2e999-b8ea-4e2f-9809-535b2868171e None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.331299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2e999-b8ea-4e2f-9809-535b2868171e None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.331564 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2e999-b8ea-4e2f-9809-535b2868171e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.336647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 806/1591] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:55.337519 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc28311-1244-4ff6-9521-3395e274fdec admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.351850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc28311-1244-4ff6-9521-3395e274fdec admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.361566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a869ed-f89a-4fe4-a343-abcbcde90bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.362250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a869ed-f89a-4fe4-a343-abcbcde90bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.362369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:55.362526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a869ed-f89a-4fe4-a343-abcbcde90bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.362800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a869ed-f89a-4fe4-a343-abcbcde90bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.363631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a869ed-f89a-4fe4-a343-abcbcde90bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.365408 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a869ed-f89a-4fe4-a343-abcbcde90bd2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.378818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 807/1592] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:55.382937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a869ed-f89a-4fe4-a343-abcbcde90bd2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.393486 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a869ed-f89a-4fe4-a343-abcbcde90bd2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.397087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-cdf2e999-b8ea-4e2f-9809-535b2868171e None None] MFA Rules not processed for user `881030d7605b40879762d1c199362ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:55.398530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29e8b0-db18-4bfd-97cc-86451e0b6f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.398749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-cdf2e999-b8ea-4e2f-9809-535b2868171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:55.399306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29e8b0-db18-4bfd-97cc-86451e0b6f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.399582 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29e8b0-db18-4bfd-97cc-86451e0b6f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.399855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29e8b0-db18-4bfd-97cc-86451e0b6f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.400507 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29e8b0-db18-4bfd-97cc-86451e0b6f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.402150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29e8b0-db18-4bfd-97cc-86451e0b6f6d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.413229 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 808/1593] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:55.414570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4b220-cd00-4629-8a01-6561e46146ee None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.414851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4b220-cd00-4629-8a01-6561e46146ee None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.415121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4b220-cd00-4629-8a01-6561e46146ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.453214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-00d4b220-cd00-4629-8a01-6561e46146ee None None] MFA Rules not processed for user `a8bb876492e24d609dc80e6ce13d4650`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:55.454411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-00d4b220-cd00-4629-8a01-6561e46146ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:55.492809 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:55.504205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 786/1594] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Aug 9 11:18:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:55.505240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2e999-b8ea-4e2f-9809-535b2868171e None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.516870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2e999-b8ea-4e2f-9809-535b2868171e None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.521609 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61496fb-7f0e-42ed-9e0a-e6f6702efecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.522253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61496fb-7f0e-42ed-9e0a-e6f6702efecf admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.522524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61496fb-7f0e-42ed-9e0a-e6f6702efecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.522792 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61496fb-7f0e-42ed-9e0a-e6f6702efecf admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.523585 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61496fb-7f0e-42ed-9e0a-e6f6702efecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.525312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61496fb-7f0e-42ed-9e0a-e6f6702efecf admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.536103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 787/1595] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:55.537235 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61496fb-7f0e-42ed-9e0a-e6f6702efecf admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.547650 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61496fb-7f0e-42ed-9e0a-e6f6702efecf admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.553144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d3364-4ab1-4811-a68b-4dd3b90a5765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.553805 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d3364-4ab1-4811-a68b-4dd3b90a5765 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.554076 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d3364-4ab1-4811-a68b-4dd3b90a5765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.554342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d3364-4ab1-4811-a68b-4dd3b90a5765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.554990 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d3364-4ab1-4811-a68b-4dd3b90a5765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.556638 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d3364-4ab1-4811-a68b-4dd3b90a5765 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.567311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 788/1596] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:55.568149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d3364-4ab1-4811-a68b-4dd3b90a5765 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.568510 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 809/1597] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:55.569896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4b220-cd00-4629-8a01-6561e46146ee None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.583934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d3364-4ab1-4811-a68b-4dd3b90a5765 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.586095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4b220-cd00-4629-8a01-6561e46146ee None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.590988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0ad0b-cf72-4116-b860-dd7e88dd6154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.591864 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0ad0b-cf72-4116-b860-dd7e88dd6154 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.592050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54066e-090d-4d84-96c8-451cb4257dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.593059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0ad0b-cf72-4116-b860-dd7e88dd6154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.593059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0ad0b-cf72-4116-b860-dd7e88dd6154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.593346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54066e-090d-4d84-96c8-451cb4257dff admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.593690 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0ad0b-cf72-4116-b860-dd7e88dd6154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.593834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54066e-090d-4d84-96c8-451cb4257dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.594364 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54066e-090d-4d84-96c8-451cb4257dff admin admin] PATH_INFO: `/v3/projects/6a937a1da0f84bb0a77ea02a4ce7a66d/users/773b0b016684462ba2867148996095b2/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.595287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0ad0b-cf72-4116-b860-dd7e88dd6154 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.607362 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 810/1598] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:55.611517 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0ad0b-cf72-4116-b860-dd7e88dd6154 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.623256 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54066e-090d-4d84-96c8-451cb4257dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a937a1da0f84bb0a77ea02a4ce7a66d, user_id=773b0b016684462ba2867148996095b2, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.623649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0ad0b-cf72-4116-b860-dd7e88dd6154 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.628734 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54066e-090d-4d84-96c8-451cb4257dff admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.629713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e2b59-53a4-4763-b6c2-41a7e2ad5273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.630347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e2b59-53a4-4763-b6c2-41a7e2ad5273 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.630620 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e2b59-53a4-4763-b6c2-41a7e2ad5273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.630925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e2b59-53a4-4763-b6c2-41a7e2ad5273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.631567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e2b59-53a4-4763-b6c2-41a7e2ad5273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.633276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e2b59-53a4-4763-b6c2-41a7e2ad5273 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.647413 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 789/1599] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:18:55 2022] PUT /identity/v3/projects/6a937a1da0f84bb0a77ea02a4ce7a66d/users/773b0b016684462ba2867148996095b2/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:18:55.647719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 811/1600] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:55.647973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54066e-090d-4d84-96c8-451cb4257dff admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.648908 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e2b59-53a4-4763-b6c2-41a7e2ad5273 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.665296 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e2b59-53a4-4763-b6c2-41a7e2ad5273 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.719237 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54066e-090d-4d84-96c8-451cb4257dff admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.724304 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0b924-d7cc-4c64-9623-2c210e322df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.725010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0b924-d7cc-4c64-9623-2c210e322df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.725316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0b924-d7cc-4c64-9623-2c210e322df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.725578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0b924-d7cc-4c64-9623-2c210e322df3 admin admin] PATH_INFO: `/v3/projects/118db627a2af4f11b1a35f3adeb51e8e/users/d98fa7056d4247edbda7c8e406e2dcb1/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.746156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0b924-d7cc-4c64-9623-2c210e322df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118db627a2af4f11b1a35f3adeb51e8e, user_id=d98fa7056d4247edbda7c8e406e2dcb1, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.749414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb68c2-5d50-4de8-ab85-ac91e29c69cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.750090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb68c2-5d50-4de8-ab85-ac91e29c69cc service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.750370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb68c2-5d50-4de8-ab85-ac91e29c69cc service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.750643 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb68c2-5d50-4de8-ab85-ac91e29c69cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.751599 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0b924-d7cc-4c64-9623-2c210e322df3 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.772588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 790/1601] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:18:55 2022] PUT /identity/v3/projects/118db627a2af4f11b1a35f3adeb51e8e/users/d98fa7056d4247edbda7c8e406e2dcb1/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:18:55.774332 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0b924-d7cc-4c64-9623-2c210e322df3 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.806096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:55.829189 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb68c2-5d50-4de8-ab85-ac91e29c69cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.831466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb68c2-5d50-4de8-ab85-ac91e29c69cc service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.842315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 812/1602] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:55.846979 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb68c2-5d50-4de8-ab85-ac91e29c69cc service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.848188 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0b924-d7cc-4c64-9623-2c210e322df3 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.853188 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d3c8b-aaa7-4242-8e3e-64ab82a5efb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.853838 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d3c8b-aaa7-4242-8e3e-64ab82a5efb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.854160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d3c8b-aaa7-4242-8e3e-64ab82a5efb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.854435 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d3c8b-aaa7-4242-8e3e-64ab82a5efb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.855268 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d3c8b-aaa7-4242-8e3e-64ab82a5efb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.856911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d3c8b-aaa7-4242-8e3e-64ab82a5efb8 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.861455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb68c2-5d50-4de8-ab85-ac91e29c69cc service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.868285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 791/1603] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:55.870135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3684df4-19a5-44bf-90fe-4076b5238c9b None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.870135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3684df4-19a5-44bf-90fe-4076b5238c9b None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.870433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3684df4-19a5-44bf-90fe-4076b5238c9b None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.871470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 792/1604] 10.222.0.15 () {54 vars in 962 bytes} [Tue Aug 9 11:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:55.872171 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3684df4-19a5-44bf-90fe-4076b5238c9b None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.874198 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31941e-e214-4f2e-980f-771a8b123e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.875444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31941e-e214-4f2e-980f-771a8b123e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.875813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31941e-e214-4f2e-980f-771a8b123e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.876210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31941e-e214-4f2e-980f-771a8b123e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.877339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31941e-e214-4f2e-980f-771a8b123e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.880351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31941e-e214-4f2e-980f-771a8b123e0b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.893851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3684df4-19a5-44bf-90fe-4076b5238c9b None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.901460 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 813/1605] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:55.901460 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121e318-cf6b-45c9-ac91-a7dfa13eb80f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.901460 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121e318-cf6b-45c9-ac91-a7dfa13eb80f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.901460 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121e318-cf6b-45c9-ac91-a7dfa13eb80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.908009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391eba7b-0d55-47cc-9022-06b8415d1cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.909311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eba7b-0d55-47cc-9022-06b8415d1cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.910224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eba7b-0d55-47cc-9022-06b8415d1cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.910803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391eba7b-0d55-47cc-9022-06b8415d1cd3 admin admin] PATH_INFO: `/v3/projects/c4635fc24ed149008e9bd368b5fad746/users/96badfb596894c24b624bef859ce30fa/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.926923 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2121e318-cf6b-45c9-ac91-a7dfa13eb80f None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:55.928081 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2121e318-cf6b-45c9-ac91-a7dfa13eb80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:55.937518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391eba7b-0d55-47cc-9022-06b8415d1cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4635fc24ed149008e9bd368b5fad746, user_id=96badfb596894c24b624bef859ce30fa, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.942132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 814/1606] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:55.943403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121e318-cf6b-45c9-ac91-a7dfa13eb80f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:55.950305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391eba7b-0d55-47cc-9022-06b8415d1cd3 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:55.957825 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121e318-cf6b-45c9-ac91-a7dfa13eb80f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:55.964948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636173-c192-46b0-aa51-79af61ab776d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:55.966341 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636173-c192-46b0-aa51-79af61ab776d admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.966609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636173-c192-46b0-aa51-79af61ab776d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.967054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636173-c192-46b0-aa51-79af61ab776d admin admin] PATH_INFO: `/v3/projects/60b2cb5525ab44ffb5a9f882389ee7fb/users/994164cde9f14b8ca5714b5e028f33c1/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.976508 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 793/1607] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:18:55 2022] PUT /identity/v3/projects/c4635fc24ed149008e9bd368b5fad746/users/96badfb596894c24b624bef859ce30fa/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:18:55.983380 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32aad27-2a7b-4d04-b6ee-076e22263875 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:55.984088 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32aad27-2a7b-4d04-b6ee-076e22263875 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:55.985245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32aad27-2a7b-4d04-b6ee-076e22263875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:55.995516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38636173-c192-46b0-aa51-79af61ab776d admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b2cb5525ab44ffb5a9f882389ee7fb, user_id=994164cde9f14b8ca5714b5e028f33c1, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:55.995516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-38636173-c192-46b0-aa51-79af61ab776d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:18:55.995516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: warnings.warn(msg) Aug 09 11:18:55.995516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: Aug 09 11:18:55.997891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38636173-c192-46b0-aa51-79af61ab776d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:56.008222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:56.014314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-a32aad27-2a7b-4d04-b6ee-076e22263875 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:56.015646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a32aad27-2a7b-4d04-b6ee-076e22263875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:56.017235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 815/1608] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:18:55 2022] PUT /identity/v3/projects/60b2cb5525ab44ffb5a9f882389ee7fb/users/994164cde9f14b8ca5714b5e028f33c1/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:18:56.023419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636173-c192-46b0-aa51-79af61ab776d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:56.092935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 794/1609] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:56.094394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e591f8-1387-4b45-a868-a82a4232c40a None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:56.094770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e591f8-1387-4b45-a868-a82a4232c40a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:56.095128 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e591f8-1387-4b45-a868-a82a4232c40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:56.108123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636173-c192-46b0-aa51-79af61ab776d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:56.113964 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0052f-942b-46d6-ae34-cf116fc3b700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:56.114737 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0052f-942b-46d6-ae34-cf116fc3b700 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:56.115080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0052f-942b-46d6-ae34-cf116fc3b700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:56.115417 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0052f-942b-46d6-ae34-cf116fc3b700 admin admin] PATH_INFO: `/v3/projects/ab74bccfe94f40b8939f415d93976b2d/users/84405f12c84a40d79493e02276e65266/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:56.123763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-f1e591f8-1387-4b45-a868-a82a4232c40a None None] MFA Rules not processed for user `881030d7605b40879762d1c199362ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:56.125481 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f1e591f8-1387-4b45-a868-a82a4232c40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:56.132044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0052f-942b-46d6-ae34-cf116fc3b700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab74bccfe94f40b8939f415d93976b2d, user_id=84405f12c84a40d79493e02276e65266, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:56.134756 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0052f-942b-46d6-ae34-cf116fc3b700 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:56.151390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 816/1610] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:18:56 2022] PUT /identity/v3/projects/ab74bccfe94f40b8939f415d93976b2d/users/84405f12c84a40d79493e02276e65266/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:18:56.156913 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0052f-942b-46d6-ae34-cf116fc3b700 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:56.209520 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 795/1611] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Aug 9 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:56.210432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e591f8-1387-4b45-a868-a82a4232c40a None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:56.240156 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0052f-942b-46d6-ae34-cf116fc3b700 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:56.244314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:56.246086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2a1e7-2a92-44c0-9318-d0b4e57e9c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:56.247318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2a1e7-2a92-44c0-9318-d0b4e57e9c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:56.247723 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2a1e7-2a92-44c0-9318-d0b4e57e9c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:56.248211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2a1e7-2a92-44c0-9318-d0b4e57e9c9b admin admin] PATH_INFO: `/v3/projects/cce192abf1c14b02825a5395c1e7e434/users/d333983873d941c3aa6bc39869552a5c/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:56.270922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2a1e7-2a92-44c0-9318-d0b4e57e9c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce192abf1c14b02825a5395c1e7e434, user_id=d333983873d941c3aa6bc39869552a5c, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:56.273587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e591f8-1387-4b45-a868-a82a4232c40a None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:56.274621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e2a1e7-2a92-44c0-9318-d0b4e57e9c9b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:56.295534 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 817/1612] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:18:56 2022] PUT /identity/v3/projects/cce192abf1c14b02825a5395c1e7e434/users/d333983873d941c3aa6bc39869552a5c/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:18:56.298022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72625b9d-b101-4706-bd11-b78c19253f31 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:56.298645 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72625b9d-b101-4706-bd11-b78c19253f31 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:56.299223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72625b9d-b101-4706-bd11-b78c19253f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:56.330884 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe25a57-24e0-425e-8ab8-9a740b455734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:56.331610 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe25a57-24e0-425e-8ab8-9a740b455734 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:56.331880 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe25a57-24e0-425e-8ab8-9a740b455734 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:56.332142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe25a57-24e0-425e-8ab8-9a740b455734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:56.334455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-72625b9d-b101-4706-bd11-b78c19253f31 None None] MFA Rules not processed for user `96badfb596894c24b624bef859ce30fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:56.335706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-72625b9d-b101-4706-bd11-b78c19253f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:56.343967 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe25a57-24e0-425e-8ab8-9a740b455734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:56.345641 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe25a57-24e0-425e-8ab8-9a740b455734 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:56.360313 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 796/1613] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:56.361026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb39e73-b5f1-44f2-9a7a-111ecff96e56 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:56.361547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb39e73-b5f1-44f2-9a7a-111ecff96e56 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:56.362072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb39e73-b5f1-44f2-9a7a-111ecff96e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:56.392376 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-2cb39e73-b5f1-44f2-9a7a-111ecff96e56 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:56.394023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2cb39e73-b5f1-44f2-9a7a-111ecff96e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:56.404207 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:56.429997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 818/1614] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:56.431978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181222f-0213-4b3f-b457-8f5fd8c2fd00 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:56.432800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181222f-0213-4b3f-b457-8f5fd8c2fd00 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:56.433222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181222f-0213-4b3f-b457-8f5fd8c2fd00 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:56.436253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 819/1615] 10.222.0.15 () {54 vars in 912 bytes} [Tue Aug 9 11:18:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:56.437686 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181222f-0213-4b3f-b457-8f5fd8c2fd00 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:56.474426 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 797/1616] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:56.474426 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad694e7-9f15-4b02-bcdc-8b660e5b9dfd None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:56.474785 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad694e7-9f15-4b02-bcdc-8b660e5b9dfd None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:56.479361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad694e7-9f15-4b02-bcdc-8b660e5b9dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:56.511504 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-5ad694e7-9f15-4b02-bcdc-8b660e5b9dfd None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:56.513509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5ad694e7-9f15-4b02-bcdc-8b660e5b9dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:56.526712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181222f-0213-4b3f-b457-8f5fd8c2fd00 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:56.527903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 798/1617] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:56.528571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad694e7-9f15-4b02-bcdc-8b660e5b9dfd None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:56.544731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1ce5d-22f3-4e5f-b05b-fd864c0d0ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:56.546174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1ce5d-22f3-4e5f-b05b-fd864c0d0ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:56.546752 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1ce5d-22f3-4e5f-b05b-fd864c0d0ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:56.547331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1ce5d-22f3-4e5f-b05b-fd864c0d0ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:56.559193 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1ce5d-22f3-4e5f-b05b-fd864c0d0ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:56.560801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1ce5d-22f3-4e5f-b05b-fd864c0d0ae0 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:56.576656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 820/1618] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:56.579034 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca483ef8-1ffa-41c0-94aa-e3ff6b6cb874 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:56.579544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca483ef8-1ffa-41c0-94aa-e3ff6b6cb874 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:56.580038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca483ef8-1ffa-41c0-94aa-e3ff6b6cb874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:56.633309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ca483ef8-1ffa-41c0-94aa-e3ff6b6cb874 None None] MFA Rules not processed for user `d333983873d941c3aa6bc39869552a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:56.635756 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ca483ef8-1ffa-41c0-94aa-e3ff6b6cb874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:56.672904 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad694e7-9f15-4b02-bcdc-8b660e5b9dfd None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:56.680101 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9e5fc-0970-4768-9ecf-1a40b0452cdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:56.681297 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9e5fc-0970-4768-9ecf-1a40b0452cdb service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:56.681786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9e5fc-0970-4768-9ecf-1a40b0452cdb service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:56.682247 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9e5fc-0970-4768-9ecf-1a40b0452cdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:56.702627 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:56.736017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 821/1619] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:56.737512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca483ef8-1ffa-41c0-94aa-e3ff6b6cb874 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:56.752213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca483ef8-1ffa-41c0-94aa-e3ff6b6cb874 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:56.757771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee38f7-a118-43bb-a87f-15c6d11ed68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:56.758489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee38f7-a118-43bb-a87f-15c6d11ed68b admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:56.758818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee38f7-a118-43bb-a87f-15c6d11ed68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:56.759154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee38f7-a118-43bb-a87f-15c6d11ed68b admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:56.759871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee38f7-a118-43bb-a87f-15c6d11ed68b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:56.762237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee38f7-a118-43bb-a87f-15c6d11ed68b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:56.781453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9e5fc-0970-4768-9ecf-1a40b0452cdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:56.784970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9e5fc-0970-4768-9ecf-1a40b0452cdb service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:56.798787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 799/1620] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:56.800682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628821b-3d4d-43bc-a01e-23e45d22a4f9 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:56.801758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628821b-3d4d-43bc-a01e-23e45d22a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:56.802228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628821b-3d4d-43bc-a01e-23e45d22a4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:56.822131 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 822/1621] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:18:56 2022] POST /identity/v3/projects => generated 357 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:56.824112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee38f7-a118-43bb-a87f-15c6d11ed68b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:56.858078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-b628821b-3d4d-43bc-a01e-23e45d22a4f9 None None] MFA Rules not processed for user `881030d7605b40879762d1c199362ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:56.867536 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b628821b-3d4d-43bc-a01e-23e45d22a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:56.956915 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 800/1622] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Aug 9 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:56.957917 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628821b-3d4d-43bc-a01e-23e45d22a4f9 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:57.020064 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee38f7-a118-43bb-a87f-15c6d11ed68b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:57.031445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f4cf9-b254-419f-91d3-d11fea3addc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:57.032500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f4cf9-b254-419f-91d3-d11fea3addc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:57.033232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f4cf9-b254-419f-91d3-d11fea3addc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:57.033735 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f4cf9-b254-419f-91d3-d11fea3addc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:57.055157 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628821b-3d4d-43bc-a01e-23e45d22a4f9 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:57.059719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fab4e-a020-49a9-834a-cfaa416eb398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:57.060608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fab4e-a020-49a9-834a-cfaa416eb398 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:57.061107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fab4e-a020-49a9-834a-cfaa416eb398 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:57.061478 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fab4e-a020-49a9-834a-cfaa416eb398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:57.065731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:57.125980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f4cf9-b254-419f-91d3-d11fea3addc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:57.128052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f4cf9-b254-419f-91d3-d11fea3addc2 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:57.141103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 823/1623] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:57.142255 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f4cf9-b254-419f-91d3-d11fea3addc2 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:57.149736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fab4e-a020-49a9-834a-cfaa416eb398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:57.151639 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fab4e-a020-49a9-834a-cfaa416eb398 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:57.158477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:57.168106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 801/1624] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:57.169896 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fab4e-a020-49a9-834a-cfaa416eb398 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:57.190224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fab4e-a020-49a9-834a-cfaa416eb398 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:57.197734 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c8d05-f338-4090-873b-3350ee789655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:57.198472 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c8d05-f338-4090-873b-3350ee789655 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:57.198850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c8d05-f338-4090-873b-3350ee789655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:57.199190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c8d05-f338-4090-873b-3350ee789655 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:57.199894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c8d05-f338-4090-873b-3350ee789655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:57.202009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c8d05-f338-4090-873b-3350ee789655 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:57.227588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f4cf9-b254-419f-91d3-d11fea3addc2 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:57.231873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1e98a-4880-410b-9962-b3028cb6e732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:57.233030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1e98a-4880-410b-9962-b3028cb6e732 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:57.233380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1e98a-4880-410b-9962-b3028cb6e732 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:57.233767 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1e98a-4880-410b-9962-b3028cb6e732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:57.239742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 802/1625] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:18:57 2022] POST /identity/v3/users => generated 285 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:18:57.239742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c8d05-f338-4090-873b-3350ee789655 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:57.249085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c8d05-f338-4090-873b-3350ee789655 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:57.253971 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e957ca8-e366-4207-b909-db987a95bc44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:57.254570 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e957ca8-e366-4207-b909-db987a95bc44 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:57.254842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e957ca8-e366-4207-b909-db987a95bc44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:57.255108 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e957ca8-e366-4207-b909-db987a95bc44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:57.270434 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e957ca8-e366-4207-b909-db987a95bc44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:57.272117 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e957ca8-e366-4207-b909-db987a95bc44 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:57.284685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 803/1626] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:57.286431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848ebbd-9a5f-4951-8455-b33112593eb0 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:57.286700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848ebbd-9a5f-4951-8455-b33112593eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:57.286967 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848ebbd-9a5f-4951-8455-b33112593eb0 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:57.289828 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 804/1627] 10.222.0.15 () {54 vars in 912 bytes} [Tue Aug 9 11:18:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:18:57.290966 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848ebbd-9a5f-4951-8455-b33112593eb0 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:57.306708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848ebbd-9a5f-4951-8455-b33112593eb0 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:57.308591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1e98a-4880-410b-9962-b3028cb6e732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:57.310099 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1e98a-4880-410b-9962-b3028cb6e732 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:57.311896 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e632d7-0121-41a1-bc6a-0b950435fa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:57.312646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e632d7-0121-41a1-bc6a-0b950435fa57 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:57.312979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e632d7-0121-41a1-bc6a-0b950435fa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:57.313305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e632d7-0121-41a1-bc6a-0b950435fa57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:57.314139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e632d7-0121-41a1-bc6a-0b950435fa57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:57.316026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e632d7-0121-41a1-bc6a-0b950435fa57 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:57.320707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 824/1628] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:57.322410 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c0dd1-9285-435c-bdaa-42445b0297bc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:57.322866 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c0dd1-9285-435c-bdaa-42445b0297bc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:57.323287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c0dd1-9285-435c-bdaa-42445b0297bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:57.344117 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 805/1629] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:57.348484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e632d7-0121-41a1-bc6a-0b950435fa57 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:57.358277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9f9c0dd1-9285-435c-bdaa-42445b0297bc None None] MFA Rules not processed for user `881030d7605b40879762d1c199362ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:57.359528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9f9c0dd1-9285-435c-bdaa-42445b0297bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:57.367798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e632d7-0121-41a1-bc6a-0b950435fa57 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:57.374570 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446e62f-a78c-4096-b0a1-d36408196032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:57.375730 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446e62f-a78c-4096-b0a1-d36408196032 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:57.376125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446e62f-a78c-4096-b0a1-d36408196032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:57.376599 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446e62f-a78c-4096-b0a1-d36408196032 admin admin] PATH_INFO: `/v3/projects/dbe60f930a9c4e6da24d3b4b97e12e6e/users/885232c30f2b43baad0d3adad1f36003/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:57.384499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 825/1630] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Aug 9 11:18:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:57.418318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446e62f-a78c-4096-b0a1-d36408196032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe60f930a9c4e6da24d3b4b97e12e6e, user_id=885232c30f2b43baad0d3adad1f36003, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:57.422989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446e62f-a78c-4096-b0a1-d36408196032 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:57.454804 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 806/1631] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:18:57 2022] PUT /identity/v3/projects/dbe60f930a9c4e6da24d3b4b97e12e6e/users/885232c30f2b43baad0d3adad1f36003/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:18:57.456464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c0dd1-9285-435c-bdaa-42445b0297bc None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:57.468576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c0dd1-9285-435c-bdaa-42445b0297bc None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:57.584002 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6ffcd-93a8-47f1-b5e7-a439a7a6ba16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:57.586249 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6ffcd-93a8-47f1-b5e7-a439a7a6ba16 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:57.586748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6ffcd-93a8-47f1-b5e7-a439a7a6ba16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:57.587215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6ffcd-93a8-47f1-b5e7-a439a7a6ba16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:57.589478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6ffcd-93a8-47f1-b5e7-a439a7a6ba16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:57.593285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6ffcd-93a8-47f1-b5e7-a439a7a6ba16 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:57.600099 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:18:57.624397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 826/1632] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:18:57.630554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446e62f-a78c-4096-b0a1-d36408196032 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:57.646931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446e62f-a78c-4096-b0a1-d36408196032 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:57.654969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e15cd-451e-4535-86d8-f6315fe05f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:57.656029 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e15cd-451e-4535-86d8-f6315fe05f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:57.656436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e15cd-451e-4535-86d8-f6315fe05f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:57.656849 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e15cd-451e-4535-86d8-f6315fe05f57 admin admin] PATH_INFO: `/v3/projects/dbe60f930a9c4e6da24d3b4b97e12e6e/users/885232c30f2b43baad0d3adad1f36003/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:57.660299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e15cd-451e-4535-86d8-f6315fe05f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe60f930a9c4e6da24d3b4b97e12e6e, user_id=885232c30f2b43baad0d3adad1f36003, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:57.665053 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e15cd-451e-4535-86d8-f6315fe05f57 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:57.700201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 807/1633] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:18:57 2022] PUT /identity/v3/projects/dbe60f930a9c4e6da24d3b4b97e12e6e/users/885232c30f2b43baad0d3adad1f36003/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:18:57.704270 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7545900-d7c9-4a8a-aa9d-3a5c6797ab54 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:57.704761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7545900-d7c9-4a8a-aa9d-3a5c6797ab54 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:57.705213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7545900-d7c9-4a8a-aa9d-3a5c6797ab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:57.755845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a7545900-d7c9-4a8a-aa9d-3a5c6797ab54 None None] MFA Rules not processed for user `885232c30f2b43baad0d3adad1f36003`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:18:57.757114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a7545900-d7c9-4a8a-aa9d-3a5c6797ab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:18:57.895866 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 827/1634] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:18:57 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:18:58.208529 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e15cd-451e-4535-86d8-f6315fe05f57 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:58.353086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7545900-d7c9-4a8a-aa9d-3a5c6797ab54 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:58.365563 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e15cd-451e-4535-86d8-f6315fe05f57 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:58.372938 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179b2ab-1852-4b71-8796-fa3694a1ffbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:58.374158 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179b2ab-1852-4b71-8796-fa3694a1ffbf service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:58.374362 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7545900-d7c9-4a8a-aa9d-3a5c6797ab54 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:58.374646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179b2ab-1852-4b71-8796-fa3694a1ffbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:58.375076 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179b2ab-1852-4b71-8796-fa3694a1ffbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:58.390635 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd667eb3-873f-498b-a586-64631c2a21cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:58.391451 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd667eb3-873f-498b-a586-64631c2a21cd service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:58.391756 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd667eb3-873f-498b-a586-64631c2a21cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:58.392367 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd667eb3-873f-498b-a586-64631c2a21cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:58.413841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd667eb3-873f-498b-a586-64631c2a21cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:58.415798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd667eb3-873f-498b-a586-64631c2a21cd service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:58.445935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 828/1635] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:58 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:58.676662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179b2ab-1852-4b71-8796-fa3694a1ffbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:58.681067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179b2ab-1852-4b71-8796-fa3694a1ffbf service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:58.738787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 808/1636] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:18:58.975014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd667eb3-873f-498b-a586-64631c2a21cd service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:18:58.985054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd667eb3-873f-498b-a586-64631c2a21cd service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:18:58.993803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eedb5d-ed66-4c3b-b6c4-ad03a2d20c1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:18:58.995436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eedb5d-ed66-4c3b-b6c4-ad03a2d20c1f service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:18:58.995733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eedb5d-ed66-4c3b-b6c4-ad03a2d20c1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:18:58.995983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eedb5d-ed66-4c3b-b6c4-ad03a2d20c1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:18:59.158666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eedb5d-ed66-4c3b-b6c4-ad03a2d20c1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:18:59.160431 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eedb5d-ed66-4c3b-b6c4-ad03a2d20c1f service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:18:59.198700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 829/1637] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:18:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:19:00.915891 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179b2ab-1852-4b71-8796-fa3694a1ffbf service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:00.966559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:01.027331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179b2ab-1852-4b71-8796-fa3694a1ffbf service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:01.034281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfaf0f-fa8d-49ec-b8a8-8ca9363f8308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:01.035037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfaf0f-fa8d-49ec-b8a8-8ca9363f8308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:01.035348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfaf0f-fa8d-49ec-b8a8-8ca9363f8308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:01.035619 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfaf0f-fa8d-49ec-b8a8-8ca9363f8308 admin admin] PATH_INFO: `/v3/users/c0b38e1fc1714613b4363048ec02657b` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:01.038184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfaf0f-fa8d-49ec-b8a8-8ca9363f8308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b38e1fc1714613b4363048ec02657b)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:01.041344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfaf0f-fa8d-49ec-b8a8-8ca9363f8308 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:01.185570 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-43bfaf0f-fa8d-49ec-b8a8-8ca9363f8308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b38e1fc1714613b4363048ec02657b'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:01.211468 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-43bfaf0f-fa8d-49ec-b8a8-8ca9363f8308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b38e1fc1714613b4363048ec02657b'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:01.218789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-43bfaf0f-fa8d-49ec-b8a8-8ca9363f8308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b38e1fc1714613b4363048ec02657b'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:01.254745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-43bfaf0f-fa8d-49ec-b8a8-8ca9363f8308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b38e1fc1714613b4363048ec02657b'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:01.294411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-43bfaf0f-fa8d-49ec-b8a8-8ca9363f8308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b38e1fc1714613b4363048ec02657b'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:01.310307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 809/1638] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:00 2022] DELETE /identity/v3/users/c0b38e1fc1714613b4363048ec02657b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:01.315166 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5310e05-3099-40b2-9aa1-d4130b6af244 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:01.315705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5310e05-3099-40b2-9aa1-d4130b6af244 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:01.315705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5310e05-3099-40b2-9aa1-d4130b6af244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:01.363411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b5310e05-3099-40b2-9aa1-d4130b6af244 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:01.364721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b5310e05-3099-40b2-9aa1-d4130b6af244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:01.544306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 830/1639] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:01.612673 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfaf0f-fa8d-49ec-b8a8-8ca9363f8308 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:01.616213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-43bfaf0f-fa8d-49ec-b8a8-8ca9363f8308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:01.801233 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfaf0f-fa8d-49ec-b8a8-8ca9363f8308 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:01.806960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ac6e4-1544-44de-9f93-c8f9e18ecbaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:01.808086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac6e4-1544-44de-9f93-c8f9e18ecbaa service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:01.808920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac6e4-1544-44de-9f93-c8f9e18ecbaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:01.809423 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac6e4-1544-44de-9f93-c8f9e18ecbaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:01.824327 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ac6e4-1544-44de-9f93-c8f9e18ecbaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:01.827388 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ac6e4-1544-44de-9f93-c8f9e18ecbaa service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:01.846271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 810/1640] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:04.144579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5310e05-3099-40b2-9aa1-d4130b6af244 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:04.146306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b5310e05-3099-40b2-9aa1-d4130b6af244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:04.175467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5310e05-3099-40b2-9aa1-d4130b6af244 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:04.195007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df26985-6105-45e1-abf9-4c47268a769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:04.195667 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df26985-6105-45e1-abf9-4c47268a769f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:04.195941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df26985-6105-45e1-abf9-4c47268a769f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:04.196577 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df26985-6105-45e1-abf9-4c47268a769f admin admin] PATH_INFO: `/v3/projects/796611bb042c46e2958c96ee9c535ea5` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:04.197395 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df26985-6105-45e1-abf9-4c47268a769f admin admin] RBAC: Authorizing `identity:delete_project(project_id=796611bb042c46e2958c96ee9c535ea5)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:04.199381 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df26985-6105-45e1-abf9-4c47268a769f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:04.207119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:04.326777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0df26985-6105-45e1-abf9-4c47268a769f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796611bb042c46e2958c96ee9c535ea5', 'request_id': 'req-0df26985-6105-45e1-abf9-4c47268a769f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:04.336005 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0df26985-6105-45e1-abf9-4c47268a769f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796611bb042c46e2958c96ee9c535ea5', 'request_id': 'req-0df26985-6105-45e1-abf9-4c47268a769f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:04.357048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0df26985-6105-45e1-abf9-4c47268a769f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796611bb042c46e2958c96ee9c535ea5', 'request_id': 'req-0df26985-6105-45e1-abf9-4c47268a769f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:04.377128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0df26985-6105-45e1-abf9-4c47268a769f admin admin] The token cache is being invalidate because project 796611bb042c46e2958c96ee9c535ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:04.377455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0df26985-6105-45e1-abf9-4c47268a769f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:04.380550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0df26985-6105-45e1-abf9-4c47268a769f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:04.385728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 831/1641] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:04 2022] DELETE /identity/v3/projects/796611bb042c46e2958c96ee9c535ea5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:04.393572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a8dc2-acdd-4f03-8ade-f3c0d65c689a None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:04.394195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a8dc2-acdd-4f03-8ade-f3c0d65c689a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:04.394195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a8dc2-acdd-4f03-8ade-f3c0d65c689a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:04.444991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-bd9a8dc2-acdd-4f03-8ade-f3c0d65c689a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:04.448876 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-bd9a8dc2-acdd-4f03-8ade-f3c0d65c689a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:04.565371 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:04.614118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 811/1642] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:04.633959 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7fe0d-2868-4f7a-a524-72bef2daf1ce None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:04.634242 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7fe0d-2868-4f7a-a524-72bef2daf1ce None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:04.634518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7fe0d-2868-4f7a-a524-72bef2daf1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:04.683965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-21a7fe0d-2868-4f7a-a524-72bef2daf1ce None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:04.685382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-21a7fe0d-2868-4f7a-a524-72bef2daf1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:04.721323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 832/1643] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:04.722463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a8dc2-acdd-4f03-8ade-f3c0d65c689a None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:04.741470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a8dc2-acdd-4f03-8ade-f3c0d65c689a None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:04.755811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630b1eb-3d9b-4764-9bc5-02a66c90583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:04.756359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630b1eb-3d9b-4764-9bc5-02a66c90583f admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:04.756633 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630b1eb-3d9b-4764-9bc5-02a66c90583f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:04.756900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630b1eb-3d9b-4764-9bc5-02a66c90583f admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:04.757564 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630b1eb-3d9b-4764-9bc5-02a66c90583f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:19:04.757925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630b1eb-3d9b-4764-9bc5-02a66c90583f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:04.759547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630b1eb-3d9b-4764-9bc5-02a66c90583f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:04.792521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 812/1644] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:19:04.796027 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7fe0d-2868-4f7a-a524-72bef2daf1ce None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:04.806498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7fe0d-2868-4f7a-a524-72bef2daf1ce None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:04.817856 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbbc06-a7c8-496e-a659-2c54b8ad1682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:04.818504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbbc06-a7c8-496e-a659-2c54b8ad1682 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:04.818777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbbc06-a7c8-496e-a659-2c54b8ad1682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:04.819042 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbbc06-a7c8-496e-a659-2c54b8ad1682 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:04.819699 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fbbc06-a7c8-496e-a659-2c54b8ad1682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:04.821672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fbbc06-a7c8-496e-a659-2c54b8ad1682 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:04.918806 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 833/1645] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:04 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:04.924649 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630b1eb-3d9b-4764-9bc5-02a66c90583f admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:04.944762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630b1eb-3d9b-4764-9bc5-02a66c90583f admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:05.174557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962f858-dddd-4c74-b6de-cab24aadc14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:05.175331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962f858-dddd-4c74-b6de-cab24aadc14a admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:05.175448 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962f858-dddd-4c74-b6de-cab24aadc14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:05.175713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962f858-dddd-4c74-b6de-cab24aadc14a admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:05.176443 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962f858-dddd-4c74-b6de-cab24aadc14a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:05.188365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962f858-dddd-4c74-b6de-cab24aadc14a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:05.274672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbbc06-a7c8-496e-a659-2c54b8ad1682 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:05.290688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 813/1646] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:04 2022] POST /identity/v3/users => generated 287 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:05.293127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbbc06-a7c8-496e-a659-2c54b8ad1682 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:05.319152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17b92-2a60-4fab-bcc0-db954665a46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:05.320039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17b92-2a60-4fab-bcc0-db954665a46e admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:05.321675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17b92-2a60-4fab-bcc0-db954665a46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:05.322222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b17b92-2a60-4fab-bcc0-db954665a46e admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:05.323830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b17b92-2a60-4fab-bcc0-db954665a46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:05.327965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b17b92-2a60-4fab-bcc0-db954665a46e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:05.368821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 834/1647] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:19:05.371204 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962f858-dddd-4c74-b6de-cab24aadc14a admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:05.383231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962f858-dddd-4c74-b6de-cab24aadc14a admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:05.401794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e762f-88b8-4809-b3f0-d66cf6c90b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:05.403225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e762f-88b8-4809-b3f0-d66cf6c90b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:05.403691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e762f-88b8-4809-b3f0-d66cf6c90b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:05.404153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e762f-88b8-4809-b3f0-d66cf6c90b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:05.404995 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e762f-88b8-4809-b3f0-d66cf6c90b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:05.406963 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e762f-88b8-4809-b3f0-d66cf6c90b8d admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:05.433246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17b92-2a60-4fab-bcc0-db954665a46e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:05.444216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b17b92-2a60-4fab-bcc0-db954665a46e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:05.447446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 814/1648] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:05.461171 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cae2e4-d806-44cb-9c21-a11ac9c5d1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:05.462234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cae2e4-d806-44cb-9c21-a11ac9c5d1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:05.462707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cae2e4-d806-44cb-9c21-a11ac9c5d1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:05.463144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cae2e4-d806-44cb-9c21-a11ac9c5d1fc admin admin] PATH_INFO: `/v3/projects/7ad44dac41634f6783857c31c4513b7d/users/108c7b66a3024cffb30f44681a087f9f/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:05.513131 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cae2e4-d806-44cb-9c21-a11ac9c5d1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad44dac41634f6783857c31c4513b7d, user_id=108c7b66a3024cffb30f44681a087f9f, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:05.516161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cae2e4-d806-44cb-9c21-a11ac9c5d1fc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:05.549813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 835/1649] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:05 2022] PUT /identity/v3/projects/7ad44dac41634f6783857c31c4513b7d/users/108c7b66a3024cffb30f44681a087f9f/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:05.562175 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692cf3e-bb09-49cb-b064-8d4deff8ee77 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:05.564086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692cf3e-bb09-49cb-b064-8d4deff8ee77 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:05.566182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692cf3e-bb09-49cb-b064-8d4deff8ee77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:05.681797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-9692cf3e-bb09-49cb-b064-8d4deff8ee77 None None] MFA Rules not processed for user `108c7b66a3024cffb30f44681a087f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:05.683931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9692cf3e-bb09-49cb-b064-8d4deff8ee77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:05.872549 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cae2e4-d806-44cb-9c21-a11ac9c5d1fc admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:05.881416 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b6cae2e4-d806-44cb-9c21-a11ac9c5d1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:05.912586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 815/1650] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:05.913577 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692cf3e-bb09-49cb-b064-8d4deff8ee77 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:06.085463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:06.169506 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692cf3e-bb09-49cb-b064-8d4deff8ee77 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:06.185422 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902acfab-05c6-49f9-b65a-f5aa79d9bcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:06.186246 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902acfab-05c6-49f9-b65a-f5aa79d9bcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:06.186983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902acfab-05c6-49f9-b65a-f5aa79d9bcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:06.187271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902acfab-05c6-49f9-b65a-f5aa79d9bcb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:06.187921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902acfab-05c6-49f9-b65a-f5aa79d9bcb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:06.190306 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902acfab-05c6-49f9-b65a-f5aa79d9bcb1 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:06.253291 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cae2e4-d806-44cb-9c21-a11ac9c5d1fc admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:06.267830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 816/1651] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:05 2022] POST /identity/v3/projects => generated 373 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:06.271866 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116ab50-be14-4469-95cb-e878da268176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:06.272794 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116ab50-be14-4469-95cb-e878da268176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:06.273141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116ab50-be14-4469-95cb-e878da268176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:06.273485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116ab50-be14-4469-95cb-e878da268176 admin admin] PATH_INFO: `/v3/users/a8bb876492e24d609dc80e6ce13d4650` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:06.275767 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116ab50-be14-4469-95cb-e878da268176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8bb876492e24d609dc80e6ce13d4650)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:06.278921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902acfab-05c6-49f9-b65a-f5aa79d9bcb1 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:06.284456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: WARNING py.warnings [None req-4116ab50-be14-4469-95cb-e878da268176 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:19:06.284456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: warnings.warn(msg) Aug 09 11:19:06.284456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: Aug 09 11:19:06.285655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116ab50-be14-4469-95cb-e878da268176 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:06.430020 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:06.502197 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4116ab50-be14-4469-95cb-e878da268176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8bb876492e24d609dc80e6ce13d4650'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:06.517122 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902acfab-05c6-49f9-b65a-f5aa79d9bcb1 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:06.523981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96136d0e-5078-46a7-89a2-ef85e1820996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:06.524621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96136d0e-5078-46a7-89a2-ef85e1820996 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:06.524897 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96136d0e-5078-46a7-89a2-ef85e1820996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:06.525168 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96136d0e-5078-46a7-89a2-ef85e1820996 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:06.526507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96136d0e-5078-46a7-89a2-ef85e1820996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:06.528552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96136d0e-5078-46a7-89a2-ef85e1820996 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:06.556960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4116ab50-be14-4469-95cb-e878da268176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8bb876492e24d609dc80e6ce13d4650'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:06.571327 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 817/1652] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:06 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:06.577667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96136d0e-5078-46a7-89a2-ef85e1820996 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:06.622253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96136d0e-5078-46a7-89a2-ef85e1820996 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:06.640015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d4a06-df6a-4551-8e69-d57ea7a45094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:06.646262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d4a06-df6a-4551-8e69-d57ea7a45094 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:06.646586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d4a06-df6a-4551-8e69-d57ea7a45094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:06.646860 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d4a06-df6a-4551-8e69-d57ea7a45094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:06.647755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d4a06-df6a-4551-8e69-d57ea7a45094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:06.650384 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d4a06-df6a-4551-8e69-d57ea7a45094 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:06.691270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 818/1653] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:06.691971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4116ab50-be14-4469-95cb-e878da268176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8bb876492e24d609dc80e6ce13d4650'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:06.694857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4116ab50-be14-4469-95cb-e878da268176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8bb876492e24d609dc80e6ce13d4650'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:06.697587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d4a06-df6a-4551-8e69-d57ea7a45094 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:06.705009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-889d4a06-df6a-4551-8e69-d57ea7a45094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:06.727006 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4116ab50-be14-4469-95cb-e878da268176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8bb876492e24d609dc80e6ce13d4650'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:06.752193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d4a06-df6a-4551-8e69-d57ea7a45094 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:06.758613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 836/1654] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:05 2022] DELETE /identity/v3/users/a8bb876492e24d609dc80e6ce13d4650 => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:19:06.765374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7389090-2a78-4272-b5e7-bb6d6ec2fe04 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:06.766187 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7389090-2a78-4272-b5e7-bb6d6ec2fe04 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:06.771132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7389090-2a78-4272-b5e7-bb6d6ec2fe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:06.868351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b7389090-2a78-4272-b5e7-bb6d6ec2fe04 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:06.871002 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b7389090-2a78-4272-b5e7-bb6d6ec2fe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:06.941450 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb7cd3-c76d-4155-865f-f6ba992cf713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:06.942572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb7cd3-c76d-4155-865f-f6ba992cf713 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:06.943064 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb7cd3-c76d-4155-865f-f6ba992cf713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:06.944350 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb7cd3-c76d-4155-865f-f6ba992cf713 admin admin] PATH_INFO: `/v3/projects/eb03de620a6142ea8e99757e3c75d105/users/7bb4fc7733b84d1f99c03bddfe1efc23/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:07.013312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb7cd3-c76d-4155-865f-f6ba992cf713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb03de620a6142ea8e99757e3c75d105, user_id=7bb4fc7733b84d1f99c03bddfe1efc23, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:07.019960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb7cd3-c76d-4155-865f-f6ba992cf713 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:07.066603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 837/1655] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:07.068155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 819/1656] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:06 2022] PUT /identity/v3/projects/eb03de620a6142ea8e99757e3c75d105/users/7bb4fc7733b84d1f99c03bddfe1efc23/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:07.073367 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7389090-2a78-4272-b5e7-bb6d6ec2fe04 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:07.086157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7389090-2a78-4272-b5e7-bb6d6ec2fe04 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:07.125953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb7cd3-c76d-4155-865f-f6ba992cf713 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:07.128239 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0edb7cd3-c76d-4155-865f-f6ba992cf713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:07.228894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:07.252170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce648fb-0872-4c9b-b821-5bfd626be83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:07.252825 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce648fb-0872-4c9b-b821-5bfd626be83a admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:07.253125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce648fb-0872-4c9b-b821-5bfd626be83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:07.253396 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce648fb-0872-4c9b-b821-5bfd626be83a admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:07.254062 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce648fb-0872-4c9b-b821-5bfd626be83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:07.256874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce648fb-0872-4c9b-b821-5bfd626be83a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:07.284615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 838/1657] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:19:07.286108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce648fb-0872-4c9b-b821-5bfd626be83a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:07.304162 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce648fb-0872-4c9b-b821-5bfd626be83a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:07.334499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67189d48-0728-493f-85c0-7f5524800988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:07.339352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67189d48-0728-493f-85c0-7f5524800988 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:07.340276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67189d48-0728-493f-85c0-7f5524800988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:07.340276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67189d48-0728-493f-85c0-7f5524800988 admin admin] PATH_INFO: `/v3/projects/eb03de620a6142ea8e99757e3c75d105/users/7bb4fc7733b84d1f99c03bddfe1efc23/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:07.343408 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb7cd3-c76d-4155-865f-f6ba992cf713 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:07.347842 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67189d48-0728-493f-85c0-7f5524800988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb03de620a6142ea8e99757e3c75d105, user_id=7bb4fc7733b84d1f99c03bddfe1efc23, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:07.350814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67189d48-0728-493f-85c0-7f5524800988 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:07.352312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088d37c-3456-41f3-b1d9-802db7b6d32e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:07.353034 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088d37c-3456-41f3-b1d9-802db7b6d32e service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:07.353308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088d37c-3456-41f3-b1d9-802db7b6d32e service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:07.353574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088d37c-3456-41f3-b1d9-802db7b6d32e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:07.378464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 839/1658] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:07 2022] PUT /identity/v3/projects/eb03de620a6142ea8e99757e3c75d105/users/7bb4fc7733b84d1f99c03bddfe1efc23/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:19:07.380130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491b029-cea5-4b04-9006-fb49fc1d8435 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:07.380416 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491b029-cea5-4b04-9006-fb49fc1d8435 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:07.380689 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491b029-cea5-4b04-9006-fb49fc1d8435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:07.386448 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088d37c-3456-41f3-b1d9-802db7b6d32e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:07.388607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088d37c-3456-41f3-b1d9-802db7b6d32e service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:07.416741 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a491b029-cea5-4b04-9006-fb49fc1d8435 None None] MFA Rules not processed for user `7bb4fc7733b84d1f99c03bddfe1efc23`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:07.418173 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a491b029-cea5-4b04-9006-fb49fc1d8435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:07.418410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 820/1659] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:07.458022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:07.624339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 840/1660] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:07.630817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088d37c-3456-41f3-b1d9-802db7b6d32e service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:07.633386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f088d37c-3456-41f3-b1d9-802db7b6d32e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:07.795455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088d37c-3456-41f3-b1d9-802db7b6d32e service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:07.939086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea48c2b-69f0-4c04-96a0-f315dbe3e551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:07.939729 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea48c2b-69f0-4c04-96a0-f315dbe3e551 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:07.940003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea48c2b-69f0-4c04-96a0-f315dbe3e551 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:07.940268 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea48c2b-69f0-4c04-96a0-f315dbe3e551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:07.965836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea48c2b-69f0-4c04-96a0-f315dbe3e551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:07.972125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea48c2b-69f0-4c04-96a0-f315dbe3e551 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:08.012029 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 821/1661] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:08.169227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491b029-cea5-4b04-9006-fb49fc1d8435 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:08.175263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a491b029-cea5-4b04-9006-fb49fc1d8435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:08.255455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491b029-cea5-4b04-9006-fb49fc1d8435 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:08.275306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed2b8f-f75f-4d25-a114-71bcec05063f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:08.276279 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed2b8f-f75f-4d25-a114-71bcec05063f service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:08.281052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed2b8f-f75f-4d25-a114-71bcec05063f service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:08.281806 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed2b8f-f75f-4d25-a114-71bcec05063f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:08.292781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-20ed2b8f-f75f-4d25-a114-71bcec05063f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:08.614474 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed2b8f-f75f-4d25-a114-71bcec05063f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:08.619466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed2b8f-f75f-4d25-a114-71bcec05063f service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:08.647946 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 841/1662] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:09.451743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea48c2b-69f0-4c04-96a0-f315dbe3e551 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:09.457190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-dea48c2b-69f0-4c04-96a0-f315dbe3e551 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:09.633706 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea48c2b-69f0-4c04-96a0-f315dbe3e551 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:09.655498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:09.656071 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:09.656344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:09.656612 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb admin admin] PATH_INFO: `/v3/projects/2f205ecaab074cd39079edad36cfb753` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:09.658151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f205ecaab074cd39079edad36cfb753)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:09.659311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: WARNING py.warnings [None req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 11:19:09.659311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: warnings.warn(msg) Aug 09 11:19:09.659311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: Aug 09 11:19:09.660425 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:09.710870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:09.738348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f205ecaab074cd39079edad36cfb753', 'request_id': 'req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:09.751631 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f205ecaab074cd39079edad36cfb753', 'request_id': 'req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:09.801475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f205ecaab074cd39079edad36cfb753', 'request_id': 'req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:09.820790 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb admin admin] The token cache is being invalidate because project 2f205ecaab074cd39079edad36cfb753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:09.820790 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:09.821273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-56fe48ed-d063-40ee-b3d2-0aedea7eabcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:09.825977 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 822/1663] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:09 2022] DELETE /identity/v3/projects/2f205ecaab074cd39079edad36cfb753 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:09.829080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b98267-4d5d-465b-a404-c962d0ac7411 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:09.829667 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b98267-4d5d-465b-a404-c962d0ac7411 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:09.830750 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b98267-4d5d-465b-a404-c962d0ac7411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:09.919590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-61b98267-4d5d-465b-a404-c962d0ac7411 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:09.932793 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-61b98267-4d5d-465b-a404-c962d0ac7411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:10.323995 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 842/1664] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:10.333606 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11619c5b-a17e-445f-b266-0a6ad0318579 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:10.333884 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11619c5b-a17e-445f-b266-0a6ad0318579 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:10.334256 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11619c5b-a17e-445f-b266-0a6ad0318579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:10.407412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-11619c5b-a17e-445f-b266-0a6ad0318579 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:10.410836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-11619c5b-a17e-445f-b266-0a6ad0318579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:10.427606 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 823/1665] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:10.430930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b98267-4d5d-465b-a404-c962d0ac7411 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:10.455183 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b98267-4d5d-465b-a404-c962d0ac7411 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:10.499870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a1f0d-76c8-49dc-b87a-1655164c62e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:10.500527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a1f0d-76c8-49dc-b87a-1655164c62e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:10.501045 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a1f0d-76c8-49dc-b87a-1655164c62e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:10.501150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a1f0d-76c8-49dc-b87a-1655164c62e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:10.501998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a1f0d-76c8-49dc-b87a-1655164c62e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:19:10.502431 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a1f0d-76c8-49dc-b87a-1655164c62e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:10.505382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a1f0d-76c8-49dc-b87a-1655164c62e0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:10.561751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 843/1666] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:19:10.568073 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11619c5b-a17e-445f-b266-0a6ad0318579 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:10.589759 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11619c5b-a17e-445f-b266-0a6ad0318579 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:10.602372 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6636fb-d1f5-4e9e-b559-37b3d66b0e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:10.604259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6636fb-d1f5-4e9e-b559-37b3d66b0e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:10.605356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6636fb-d1f5-4e9e-b559-37b3d66b0e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:10.606125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6636fb-d1f5-4e9e-b559-37b3d66b0e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:10.608989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6636fb-d1f5-4e9e-b559-37b3d66b0e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:10.615280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6636fb-d1f5-4e9e-b559-37b3d66b0e5e admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:10.699759 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 824/1667] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:10 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:10.706244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a1f0d-76c8-49dc-b87a-1655164c62e0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:10.725060 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a1f0d-76c8-49dc-b87a-1655164c62e0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:10.852306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:10.897872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec90cb3-97f6-49ea-a056-85f36ce6f25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:10.900292 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec90cb3-97f6-49ea-a056-85f36ce6f25a admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:10.900670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec90cb3-97f6-49ea-a056-85f36ce6f25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:10.900952 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec90cb3-97f6-49ea-a056-85f36ce6f25a admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:10.903532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec90cb3-97f6-49ea-a056-85f36ce6f25a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:10.907188 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec90cb3-97f6-49ea-a056-85f36ce6f25a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:10.986703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 844/1668] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:10 2022] POST /identity/v3/users => generated 287 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:10.993829 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6636fb-d1f5-4e9e-b559-37b3d66b0e5e admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:11.030344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6636fb-d1f5-4e9e-b559-37b3d66b0e5e admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:11.051668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345db1d-6e9e-4fc0-b026-a6de33889ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:11.056356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345db1d-6e9e-4fc0-b026-a6de33889ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:11.056786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345db1d-6e9e-4fc0-b026-a6de33889ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:11.060864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345db1d-6e9e-4fc0-b026-a6de33889ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:11.061646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345db1d-6e9e-4fc0-b026-a6de33889ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:11.068475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345db1d-6e9e-4fc0-b026-a6de33889ba8 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:11.109164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 825/1669] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:11.112923 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec90cb3-97f6-49ea-a056-85f36ce6f25a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:11.134596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec90cb3-97f6-49ea-a056-85f36ce6f25a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:11.147118 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1134bb0-1e2e-49a8-9205-9350b933a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:11.149219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1134bb0-1e2e-49a8-9205-9350b933a874 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:11.152285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1134bb0-1e2e-49a8-9205-9350b933a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:11.152873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1134bb0-1e2e-49a8-9205-9350b933a874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:11.156235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1134bb0-1e2e-49a8-9205-9350b933a874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:11.160895 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1134bb0-1e2e-49a8-9205-9350b933a874 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:11.194210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 845/1670] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:11.198761 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345db1d-6e9e-4fc0-b026-a6de33889ba8 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:11.228434 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345db1d-6e9e-4fc0-b026-a6de33889ba8 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:11.244884 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f8671-7c60-4035-948a-847f1ab6b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:11.245698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f8671-7c60-4035-948a-847f1ab6b5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:11.246001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f8671-7c60-4035-948a-847f1ab6b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:11.246298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f8671-7c60-4035-948a-847f1ab6b5e6 admin admin] PATH_INFO: `/v3/projects/c403f0519ace439e8d9da5d856fe4af6/users/7949822270e440d1a233826e1e268fa5/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:11.286906 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1134bb0-1e2e-49a8-9205-9350b933a874 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:11.289027 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d1134bb0-1e2e-49a8-9205-9350b933a874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:11.317798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1134bb0-1e2e-49a8-9205-9350b933a874 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:11.320567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f8671-7c60-4035-948a-847f1ab6b5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c403f0519ace439e8d9da5d856fe4af6, user_id=7949822270e440d1a233826e1e268fa5, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:11.329644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f8671-7c60-4035-948a-847f1ab6b5e6 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:11.352527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5cd78-8e80-4901-8abe-f70afae0e2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:11.353212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5cd78-8e80-4901-8abe-f70afae0e2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:11.353493 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5cd78-8e80-4901-8abe-f70afae0e2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:11.357349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5cd78-8e80-4901-8abe-f70afae0e2c7 admin admin] PATH_INFO: `/v3/users/d333983873d941c3aa6bc39869552a5c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:11.362843 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5cd78-8e80-4901-8abe-f70afae0e2c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d333983873d941c3aa6bc39869552a5c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:11.370042 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5cd78-8e80-4901-8abe-f70afae0e2c7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:11.389536 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 826/1671] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:11 2022] PUT /identity/v3/projects/c403f0519ace439e8d9da5d856fe4af6/users/7949822270e440d1a233826e1e268fa5/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:11.412228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ef3af-09a1-4ce1-8e8d-1e4f89669373 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:11.412228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ef3af-09a1-4ce1-8e8d-1e4f89669373 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:11.413072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ef3af-09a1-4ce1-8e8d-1e4f89669373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:11.484816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-9d7ef3af-09a1-4ce1-8e8d-1e4f89669373 None None] MFA Rules not processed for user `7949822270e440d1a233826e1e268fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:11.487027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9d7ef3af-09a1-4ce1-8e8d-1e4f89669373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:11.523062 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f7f5cd78-8e80-4901-8abe-f70afae0e2c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd333983873d941c3aa6bc39869552a5c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:11.538365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f7f5cd78-8e80-4901-8abe-f70afae0e2c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd333983873d941c3aa6bc39869552a5c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:11.558807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f7f5cd78-8e80-4901-8abe-f70afae0e2c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd333983873d941c3aa6bc39869552a5c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:11.559900 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f7f5cd78-8e80-4901-8abe-f70afae0e2c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd333983873d941c3aa6bc39869552a5c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:11.578180 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f7f5cd78-8e80-4901-8abe-f70afae0e2c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd333983873d941c3aa6bc39869552a5c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:11.598393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 846/1672] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:11 2022] DELETE /identity/v3/users/d333983873d941c3aa6bc39869552a5c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:19:11.605711 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b8ba5-90e6-4b0f-93fd-75dc8260c4ad None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:11.606206 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b8ba5-90e6-4b0f-93fd-75dc8260c4ad None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:11.606555 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b8ba5-90e6-4b0f-93fd-75dc8260c4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:11.652544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-206b8ba5-90e6-4b0f-93fd-75dc8260c4ad None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:11.654993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-206b8ba5-90e6-4b0f-93fd-75dc8260c4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:11.696008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 827/1673] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:11.697005 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ef3af-09a1-4ce1-8e8d-1e4f89669373 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:11.698951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9d7ef3af-09a1-4ce1-8e8d-1e4f89669373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:11.846261 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:11.870877 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 847/1674] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:11.909131 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ef3af-09a1-4ce1-8e8d-1e4f89669373 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:11.920904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b8ba5-90e6-4b0f-93fd-75dc8260c4ad None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:11.922346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-206b8ba5-90e6-4b0f-93fd-75dc8260c4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:11.929555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9aeb07-fcc1-4272-b718-72da894319b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:11.930283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aeb07-fcc1-4272-b718-72da894319b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:11.930656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aeb07-fcc1-4272-b718-72da894319b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:11.930905 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aeb07-fcc1-4272-b718-72da894319b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:11.936664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9aeb07-fcc1-4272-b718-72da894319b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:11.941536 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9aeb07-fcc1-4272-b718-72da894319b8 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:12.036576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:12.036909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 828/1675] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:11 2022] POST /identity/v3/projects => generated 373 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:12.044308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9aeb07-fcc1-4272-b718-72da894319b8 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:12.120790 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b8ba5-90e6-4b0f-93fd-75dc8260c4ad None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:12.285645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9aeb07-fcc1-4272-b718-72da894319b8 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:12.291238 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523da8fd-6bcc-443f-9a22-33c8eade57a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:12.291933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523da8fd-6bcc-443f-9a22-33c8eade57a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:12.292305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523da8fd-6bcc-443f-9a22-33c8eade57a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:12.292688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523da8fd-6bcc-443f-9a22-33c8eade57a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:12.293423 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523da8fd-6bcc-443f-9a22-33c8eade57a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:12.295554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523da8fd-6bcc-443f-9a22-33c8eade57a8 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:12.339596 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 829/1676] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:12 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:12.343302 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523da8fd-6bcc-443f-9a22-33c8eade57a8 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:12.355969 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fcc8f-4677-4ba4-850a-ebeb9e3815cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:12.357029 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fcc8f-4677-4ba4-850a-ebeb9e3815cb service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:12.357313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fcc8f-4677-4ba4-850a-ebeb9e3815cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:12.357584 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fcc8f-4677-4ba4-850a-ebeb9e3815cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:12.364662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523da8fd-6bcc-443f-9a22-33c8eade57a8 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:12.376623 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46903364-adff-408d-ae4f-1d03abda114f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:12.377435 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46903364-adff-408d-ae4f-1d03abda114f admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:12.377854 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46903364-adff-408d-ae4f-1d03abda114f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:12.378293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46903364-adff-408d-ae4f-1d03abda114f admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:12.379109 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46903364-adff-408d-ae4f-1d03abda114f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:12.387492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46903364-adff-408d-ae4f-1d03abda114f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:12.387720 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2fcc8f-4677-4ba4-850a-ebeb9e3815cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:12.393542 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2fcc8f-4677-4ba4-850a-ebeb9e3815cb service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:12.418654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 830/1677] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:12.419731 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46903364-adff-408d-ae4f-1d03abda114f admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:12.440489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 848/1678] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:19:12.448388 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46903364-adff-408d-ae4f-1d03abda114f admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:12.462916 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281c66f-68e7-4672-ac12-6027403271b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:12.463603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281c66f-68e7-4672-ac12-6027403271b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:12.463876 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281c66f-68e7-4672-ac12-6027403271b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:12.464181 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281c66f-68e7-4672-ac12-6027403271b7 admin admin] PATH_INFO: `/v3/projects/7e8e12807e8448a48db30d971c2dc48e/users/44c314368d9a44f689f058a50fbad4c4/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:12.524217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281c66f-68e7-4672-ac12-6027403271b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8e12807e8448a48db30d971c2dc48e, user_id=44c314368d9a44f689f058a50fbad4c4, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:12.529441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281c66f-68e7-4672-ac12-6027403271b7 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:12.576707 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 831/1679] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:12 2022] PUT /identity/v3/projects/7e8e12807e8448a48db30d971c2dc48e/users/44c314368d9a44f689f058a50fbad4c4/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:12.580835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fcc8f-4677-4ba4-850a-ebeb9e3815cb service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:12.596298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fcc8f-4677-4ba4-850a-ebeb9e3815cb service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:12.768295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55d6f6-0615-490d-89f0-a173bcc83e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:12.768926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55d6f6-0615-490d-89f0-a173bcc83e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:12.769202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55d6f6-0615-490d-89f0-a173bcc83e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:12.769477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55d6f6-0615-490d-89f0-a173bcc83e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:12.770295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55d6f6-0615-490d-89f0-a173bcc83e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:12.771929 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55d6f6-0615-490d-89f0-a173bcc83e05 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:12.797602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 849/1680] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:12.799796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281c66f-68e7-4672-ac12-6027403271b7 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:12.823784 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281c66f-68e7-4672-ac12-6027403271b7 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:12.836819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78754c9d-dae4-4bc3-9944-20335de7fbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:12.839301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78754c9d-dae4-4bc3-9944-20335de7fbf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:12.839753 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78754c9d-dae4-4bc3-9944-20335de7fbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:12.843096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78754c9d-dae4-4bc3-9944-20335de7fbf5 admin admin] PATH_INFO: `/v3/projects/7e8e12807e8448a48db30d971c2dc48e/users/44c314368d9a44f689f058a50fbad4c4/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:12.849458 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78754c9d-dae4-4bc3-9944-20335de7fbf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8e12807e8448a48db30d971c2dc48e, user_id=44c314368d9a44f689f058a50fbad4c4, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:12.863504 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78754c9d-dae4-4bc3-9944-20335de7fbf5 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:12.894809 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 832/1681] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:12 2022] PUT /identity/v3/projects/7e8e12807e8448a48db30d971c2dc48e/users/44c314368d9a44f689f058a50fbad4c4/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:12.907611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4af160-0a0b-4951-9e63-22aed8091c78 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:12.908270 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4af160-0a0b-4951-9e63-22aed8091c78 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:12.908270 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4af160-0a0b-4951-9e63-22aed8091c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:12.972348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-da4af160-0a0b-4951-9e63-22aed8091c78 None None] MFA Rules not processed for user `44c314368d9a44f689f058a50fbad4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:12.974450 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-da4af160-0a0b-4951-9e63-22aed8091c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:13.085066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 850/1682] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:13.098799 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78754c9d-dae4-4bc3-9944-20335de7fbf5 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:13.101062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-78754c9d-dae4-4bc3-9944-20335de7fbf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:13.263602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78754c9d-dae4-4bc3-9944-20335de7fbf5 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:13.274105 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f842d-7511-48d5-93c9-b9ca8362aca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:13.274932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f842d-7511-48d5-93c9-b9ca8362aca9 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:13.276385 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f842d-7511-48d5-93c9-b9ca8362aca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:13.279552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f842d-7511-48d5-93c9-b9ca8362aca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:13.304907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f842d-7511-48d5-93c9-b9ca8362aca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:13.306997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f842d-7511-48d5-93c9-b9ca8362aca9 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:13.337462 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 833/1683] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:14.281689 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a284d9-51ae-46f3-b5fa-665a45027826 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:14.282238 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a284d9-51ae-46f3-b5fa-665a45027826 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:14.282626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a284d9-51ae-46f3-b5fa-665a45027826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:14.359940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:14.371637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e4a284d9-51ae-46f3-b5fa-665a45027826 None None] MFA Rules not processed for user `994164cde9f14b8ca5714b5e028f33c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:14.373352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e4a284d9-51ae-46f3-b5fa-665a45027826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:14.406680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f842d-7511-48d5-93c9-b9ca8362aca9 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:14.442620 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:14.653093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f842d-7511-48d5-93c9-b9ca8362aca9 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:14.675349 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74d620-a58a-495b-a3f9-257e110cd6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:14.676028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74d620-a58a-495b-a3f9-257e110cd6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:14.678620 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74d620-a58a-495b-a3f9-257e110cd6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:14.679170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74d620-a58a-495b-a3f9-257e110cd6d1 admin admin] PATH_INFO: `/v3/users/7949822270e440d1a233826e1e268fa5` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:14.681529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 851/1684] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:14.691704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74d620-a58a-495b-a3f9-257e110cd6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7949822270e440d1a233826e1e268fa5)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:14.692249 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137627b9-d2a0-4a16-a5f3-aed4f331b038 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:14.692703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137627b9-d2a0-4a16-a5f3-aed4f331b038 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:14.693140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137627b9-d2a0-4a16-a5f3-aed4f331b038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:14.700272 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74d620-a58a-495b-a3f9-257e110cd6d1 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:14.742592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-137627b9-d2a0-4a16-a5f3-aed4f331b038 None None] MFA Rules not processed for user `994164cde9f14b8ca5714b5e028f33c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:14.744574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-137627b9-d2a0-4a16-a5f3-aed4f331b038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:14.759528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 852/1685] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:14.780817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137627b9-d2a0-4a16-a5f3-aed4f331b038 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:14.784988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-137627b9-d2a0-4a16-a5f3-aed4f331b038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:14.987787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-eb74d620-a58a-495b-a3f9-257e110cd6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7949822270e440d1a233826e1e268fa5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:15.026485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-eb74d620-a58a-495b-a3f9-257e110cd6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7949822270e440d1a233826e1e268fa5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:15.030601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-eb74d620-a58a-495b-a3f9-257e110cd6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7949822270e440d1a233826e1e268fa5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:15.053728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137627b9-d2a0-4a16-a5f3-aed4f331b038 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:15.065826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ade3e-0157-4af6-8841-f23940fc4d83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:15.069533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ade3e-0157-4af6-8841-f23940fc4d83 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:15.069963 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ade3e-0157-4af6-8841-f23940fc4d83 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:15.070118 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ade3e-0157-4af6-8841-f23940fc4d83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:15.071697 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-eb74d620-a58a-495b-a3f9-257e110cd6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7949822270e440d1a233826e1e268fa5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:15.073996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1c1ade3e-0157-4af6-8841-f23940fc4d83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:15.089390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-eb74d620-a58a-495b-a3f9-257e110cd6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7949822270e440d1a233826e1e268fa5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:15.099172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 834/1686] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:14 2022] DELETE /identity/v3/users/7949822270e440d1a233826e1e268fa5 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:19:15.100976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ed8c1-6ca2-4d83-80cd-67dc4b3b40dc None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:15.101459 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ed8c1-6ca2-4d83-80cd-67dc4b3b40dc None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:15.101986 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ed8c1-6ca2-4d83-80cd-67dc4b3b40dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:15.127465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ade3e-0157-4af6-8841-f23940fc4d83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:15.130178 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ade3e-0157-4af6-8841-f23940fc4d83 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:15.150426 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-6d6ed8c1-6ca2-4d83-80cd-67dc4b3b40dc None None] MFA Rules not processed for user `773b0b016684462ba2867148996095b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:15.152281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6d6ed8c1-6ca2-4d83-80cd-67dc4b3b40dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:15.156070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 853/1687] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:15.164627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bc83f-0255-497f-b94b-c699056d6d4f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:15.165703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bc83f-0255-497f-b94b-c699056d6d4f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:15.166123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bc83f-0255-497f-b94b-c699056d6d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:15.258645 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8f4bc83f-0255-497f-b94b-c699056d6d4f None None] MFA Rules not processed for user `d98fa7056d4247edbda7c8e406e2dcb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:15.263229 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8f4bc83f-0255-497f-b94b-c699056d6d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:15.383120 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 835/1688] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:15.384316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ed8c1-6ca2-4d83-80cd-67dc4b3b40dc None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:15.386517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6d6ed8c1-6ca2-4d83-80cd-67dc4b3b40dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:15.461781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:15.464877 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 854/1689] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:15.466819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a5a7e-9695-4f9e-8279-eb2f91fddf79 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:15.469674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a5a7e-9695-4f9e-8279-eb2f91fddf79 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:15.472837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a5a7e-9695-4f9e-8279-eb2f91fddf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:15.528850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a85a5a7e-9695-4f9e-8279-eb2f91fddf79 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:15.530829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a85a5a7e-9695-4f9e-8279-eb2f91fddf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:15.538671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:15.576433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ed8c1-6ca2-4d83-80cd-67dc4b3b40dc None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:15.586030 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:15.587823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:15.588102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:15.588374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05 admin admin] PATH_INFO: `/v3/projects/cce192abf1c14b02825a5395c1e7e434` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:15.592974 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cce192abf1c14b02825a5395c1e7e434)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:15.598276 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:15.729792 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cce192abf1c14b02825a5395c1e7e434', 'request_id': 'req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:15.750227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 855/1690] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:15.751985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031f2e0-f32e-4962-bc41-3b7f67dc21f5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:15.753873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cce192abf1c14b02825a5395c1e7e434', 'request_id': 'req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:15.757371 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031f2e0-f32e-4962-bc41-3b7f67dc21f5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:15.757875 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031f2e0-f32e-4962-bc41-3b7f67dc21f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:15.763932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cce192abf1c14b02825a5395c1e7e434', 'request_id': 'req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:15.790993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05 admin admin] The token cache is being invalidate because project cce192abf1c14b02825a5395c1e7e434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:15.791372 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:15.792093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:15.793960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 836/1691] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:15 2022] DELETE /identity/v3/projects/cce192abf1c14b02825a5395c1e7e434 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:15.798277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:15.803028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:15.824057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8031f2e0-f32e-4962-bc41-3b7f67dc21f5 None None] MFA Rules not processed for user `773b0b016684462ba2867148996095b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:15.825523 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8031f2e0-f32e-4962-bc41-3b7f67dc21f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:15.967815 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 856/1692] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:15.970721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d1cf4-a51a-44ef-84aa-e2641c75b862 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:15.971183 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d1cf4-a51a-44ef-84aa-e2641c75b862 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:15.972119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d1cf4-a51a-44ef-84aa-e2641c75b862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:16.000149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d23d1cf4-a51a-44ef-84aa-e2641c75b862 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:16.003514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d23d1cf4-a51a-44ef-84aa-e2641c75b862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:16.134587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc113a04-0489-4c9f-b56b-b3bb3cce8c05 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:16.171431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe1834-8991-4618-b789-4a9dcc0ac47f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:16.172239 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe1834-8991-4618-b789-4a9dcc0ac47f service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:16.172239 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe1834-8991-4618-b789-4a9dcc0ac47f service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:16.172419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe1834-8991-4618-b789-4a9dcc0ac47f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:16.181949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6fbe1834-8991-4618-b789-4a9dcc0ac47f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:16.190209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 857/1693] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:16.191474 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d1cf4-a51a-44ef-84aa-e2641c75b862 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:16.197225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d23d1cf4-a51a-44ef-84aa-e2641c75b862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:16.364628 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d1cf4-a51a-44ef-84aa-e2641c75b862 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:16.364822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:16.369840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f00010-2eaf-4018-aa00-4da386540729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:16.370546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f00010-2eaf-4018-aa00-4da386540729 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:16.370817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f00010-2eaf-4018-aa00-4da386540729 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:16.371091 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f00010-2eaf-4018-aa00-4da386540729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:16.373085 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d8f00010-2eaf-4018-aa00-4da386540729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:16.387801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f00010-2eaf-4018-aa00-4da386540729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:16.389719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f00010-2eaf-4018-aa00-4da386540729 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:16.395812 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:16.398472 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe1834-8991-4618-b789-4a9dcc0ac47f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:16.403229 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe1834-8991-4618-b789-4a9dcc0ac47f service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:16.412080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 858/1694] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:16.413365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46a2de-6555-4637-ba25-a566f0e10619 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:16.413654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46a2de-6555-4637-ba25-a566f0e10619 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:16.413952 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46a2de-6555-4637-ba25-a566f0e10619 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:16.416818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 859/1695] 10.222.0.15 () {54 vars in 912 bytes} [Tue Aug 9 11:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:16.422871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa1bf0-82ea-4d1f-90f2-594a462e5015 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:16.423197 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa1bf0-82ea-4d1f-90f2-594a462e5015 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:16.423474 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa1bf0-82ea-4d1f-90f2-594a462e5015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:16.433507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 837/1696] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:16.433507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f47b-1dff-45d9-8c6c-f4db973d2f56 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:16.434125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f47b-1dff-45d9-8c6c-f4db973d2f56 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:16.434404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f47b-1dff-45d9-8c6c-f4db973d2f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:16.471727 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-39aa1bf0-82ea-4d1f-90f2-594a462e5015 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:16.486549 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-39aa1bf0-82ea-4d1f-90f2-594a462e5015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:16.513060 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 860/1697] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:16.514482 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa1bf0-82ea-4d1f-90f2-594a462e5015 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:16.537226 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa1bf0-82ea-4d1f-90f2-594a462e5015 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:16.540882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-3d96f47b-1dff-45d9-8c6c-f4db973d2f56 None None] MFA Rules not processed for user `0ee3889add1541418ccda24268831979`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:16.543516 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3d96f47b-1dff-45d9-8c6c-f4db973d2f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:16.547796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e463-c8b6-4c20-acf0-dfb94ba7ec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:16.548706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e463-c8b6-4c20-acf0-dfb94ba7ec2a admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:16.548801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e463-c8b6-4c20-acf0-dfb94ba7ec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:16.549057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e463-c8b6-4c20-acf0-dfb94ba7ec2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:16.551838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077e463-c8b6-4c20-acf0-dfb94ba7ec2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:19:16.552155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077e463-c8b6-4c20-acf0-dfb94ba7ec2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:16.555431 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077e463-c8b6-4c20-acf0-dfb94ba7ec2a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:16.560035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 838/1698] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Aug 9 11:19:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:16.577599 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f47b-1dff-45d9-8c6c-f4db973d2f56 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:16.579110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3d96f47b-1dff-45d9-8c6c-f4db973d2f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:16.605437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f47b-1dff-45d9-8c6c-f4db973d2f56 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:16.605684 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 861/1699] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:19:16.606922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e463-c8b6-4c20-acf0-dfb94ba7ec2a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:16.616970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9d334-4635-421b-b156-606169c7e233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:16.617597 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9d334-4635-421b-b156-606169c7e233 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:16.622126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9d334-4635-421b-b156-606169c7e233 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:16.622667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9d334-4635-421b-b156-606169c7e233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:16.631922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e463-c8b6-4c20-acf0-dfb94ba7ec2a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:16.638409 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9d334-4635-421b-b156-606169c7e233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:16.640313 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9d334-4635-421b-b156-606169c7e233 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:16.640458 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd711a1-7dbe-436e-bea6-9da08bbbeaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:16.641342 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd711a1-7dbe-436e-bea6-9da08bbbeaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:16.641843 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd711a1-7dbe-436e-bea6-9da08bbbeaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:16.642198 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd711a1-7dbe-436e-bea6-9da08bbbeaf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:16.643243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd711a1-7dbe-436e-bea6-9da08bbbeaf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:16.646838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd711a1-7dbe-436e-bea6-9da08bbbeaf0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:16.675378 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 839/1700] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:16.709584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9d334-4635-421b-b156-606169c7e233 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:16.730850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 862/1701] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:16 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:16.735554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd711a1-7dbe-436e-bea6-9da08bbbeaf0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:16.737324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9d334-4635-421b-b156-606169c7e233 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:16.880215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd711a1-7dbe-436e-bea6-9da08bbbeaf0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:16.888899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f2734-5b61-481a-a06c-92e0d84ab78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:16.889159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f2734-5b61-481a-a06c-92e0d84ab78a admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:16.890052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f2734-5b61-481a-a06c-92e0d84ab78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:16.890457 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f2734-5b61-481a-a06c-92e0d84ab78a admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:16.891253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f2734-5b61-481a-a06c-92e0d84ab78a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:16.894356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f2734-5b61-481a-a06c-92e0d84ab78a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:16.948763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc7001-88c5-4bc8-ab1b-e1cd4c510528 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:16.950502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc7001-88c5-4bc8-ab1b-e1cd4c510528 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:16.950781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc7001-88c5-4bc8-ab1b-e1cd4c510528 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:16.951049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc7001-88c5-4bc8-ab1b-e1cd4c510528 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:16.954483 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 863/1702] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:16 2022] POST /identity/v3/users => generated 284 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:16.958894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed6218-41c5-40ba-b13c-9511f4073add None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:16.959221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed6218-41c5-40ba-b13c-9511f4073add None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:16.959508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed6218-41c5-40ba-b13c-9511f4073add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:16.963513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-66cc7001-88c5-4bc8-ab1b-e1cd4c510528 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:16.998701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-58ed6218-41c5-40ba-b13c-9511f4073add None None] MFA Rules not processed for user `84405f12c84a40d79493e02276e65266`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:17.000056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-58ed6218-41c5-40ba-b13c-9511f4073add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:17.102096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc7001-88c5-4bc8-ab1b-e1cd4c510528 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:17.103895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc7001-88c5-4bc8-ab1b-e1cd4c510528 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:17.116080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 864/1703] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:17.116080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed6218-41c5-40ba-b13c-9511f4073add None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:17.124458 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 840/1704] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:17.140628 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed6218-41c5-40ba-b13c-9511f4073add None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:17.151051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e7515-a177-4751-9d83-c7ba57d91712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:17.151944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e7515-a177-4751-9d83-c7ba57d91712 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:17.152383 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e7515-a177-4751-9d83-c7ba57d91712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:17.152846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e7515-a177-4751-9d83-c7ba57d91712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:17.153792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e7515-a177-4751-9d83-c7ba57d91712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:17.155939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e7515-a177-4751-9d83-c7ba57d91712 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:17.175102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 865/1705] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:17.176085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc7001-88c5-4bc8-ab1b-e1cd4c510528 service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:17.191029 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc7001-88c5-4bc8-ab1b-e1cd4c510528 service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:17.196682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6a125-f887-4f9f-8527-facb898e3e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:17.197675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6a125-f887-4f9f-8527-facb898e3e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:17.198326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6a125-f887-4f9f-8527-facb898e3e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:17.198991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6a125-f887-4f9f-8527-facb898e3e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:17.200315 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6a125-f887-4f9f-8527-facb898e3e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:17.202324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6a125-f887-4f9f-8527-facb898e3e0d admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:17.226769 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e7515-a177-4751-9d83-c7ba57d91712 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:17.227821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 841/1706] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:17.253709 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e7515-a177-4751-9d83-c7ba57d91712 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:17.265718 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a03d4-65e1-4efc-9a96-d90003e681b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:17.269508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a03d4-65e1-4efc-9a96-d90003e681b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:17.269945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a03d4-65e1-4efc-9a96-d90003e681b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:17.270138 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a03d4-65e1-4efc-9a96-d90003e681b2 admin admin] PATH_INFO: `/v3/projects/cae44e23b8934501a1c212ad600b88e1/users/9ce10ded972c40aca2203a9b29e9b10a/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:17.319435 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a03d4-65e1-4efc-9a96-d90003e681b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae44e23b8934501a1c212ad600b88e1, user_id=9ce10ded972c40aca2203a9b29e9b10a, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:17.325887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a03d4-65e1-4efc-9a96-d90003e681b2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:17.365713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 866/1707] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:17 2022] PUT /identity/v3/projects/cae44e23b8934501a1c212ad600b88e1/users/9ce10ded972c40aca2203a9b29e9b10a/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:17.378637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f8c88-19c4-4e05-aaa5-b89b7ac8127f None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:17.379271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f8c88-19c4-4e05-aaa5-b89b7ac8127f None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:17.379751 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f8c88-19c4-4e05-aaa5-b89b7ac8127f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:17.457157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a03d4-65e1-4efc-9a96-d90003e681b2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:17.459333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-340a03d4-65e1-4efc-9a96-d90003e681b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:17.467065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:17.511079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-677f8c88-19c4-4e05-aaa5-b89b7ac8127f None None] MFA Rules not processed for user `9ce10ded972c40aca2203a9b29e9b10a`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:17.512824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-677f8c88-19c4-4e05-aaa5-b89b7ac8127f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:17.659332 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:17.780625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 842/1708] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:17.786856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ce2ac-1fa3-43c0-aac9-90a924f571a9 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:17.790134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ce2ac-1fa3-43c0-aac9-90a924f571a9 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:17.796514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ce2ac-1fa3-43c0-aac9-90a924f571a9 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:17.802313 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 843/1709] 10.222.0.15 () {54 vars in 961 bytes} [Tue Aug 9 11:19:17 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:17.810478 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ce2ac-1fa3-43c0-aac9-90a924f571a9 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:17.838052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a03d4-65e1-4efc-9a96-d90003e681b2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:17.865852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb09db-3577-400c-8b5a-2477789b58ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:17.872056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb09db-3577-400c-8b5a-2477789b58ba service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:17.872438 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb09db-3577-400c-8b5a-2477789b58ba service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:17.872713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb09db-3577-400c-8b5a-2477789b58ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:18.009547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ce2ac-1fa3-43c0-aac9-90a924f571a9 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:18.028975 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb7763-005f-4cea-a8b0-a943145a84d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:18.029941 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7763-005f-4cea-a8b0-a943145a84d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:18.030228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7763-005f-4cea-a8b0-a943145a84d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:18.030518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb7763-005f-4cea-a8b0-a943145a84d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:18.031340 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb7763-005f-4cea-a8b0-a943145a84d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:18.036226 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb09db-3577-400c-8b5a-2477789b58ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:18.041447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb09db-3577-400c-8b5a-2477789b58ba service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:18.044304 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb7763-005f-4cea-a8b0-a943145a84d0 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:18.067848 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 867/1710] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:19:18.069516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63a048-87bf-47b6-8dee-9ac07178a4df None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:18.074078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63a048-87bf-47b6-8dee-9ac07178a4df None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:18.074475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63a048-87bf-47b6-8dee-9ac07178a4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:18.128100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6a63a048-87bf-47b6-8dee-9ac07178a4df None None] MFA Rules not processed for user `a587c410fd8741f3b3858d21b9e4884d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:18.133951 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6a63a048-87bf-47b6-8dee-9ac07178a4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:18.206998 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 844/1711] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:17 2022] POST /identity/v3/projects => generated 367 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:18.209112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb7763-005f-4cea-a8b0-a943145a84d0 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:18.234590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-4cdb7763-005f-4cea-a8b0-a943145a84d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:18.318511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 868/1712] 10.222.0.15 () {58 vars in 1058 bytes} [Tue Aug 9 11:19:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:18.319549 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63a048-87bf-47b6-8dee-9ac07178a4df None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:18.343912 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63a048-87bf-47b6-8dee-9ac07178a4df None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:18.398338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb7763-005f-4cea-a8b0-a943145a84d0 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:18.414699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23cc5c-e5db-4cd7-8069-1d725d0236b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:18.415549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23cc5c-e5db-4cd7-8069-1d725d0236b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:18.415891 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23cc5c-e5db-4cd7-8069-1d725d0236b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:18.417219 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23cc5c-e5db-4cd7-8069-1d725d0236b2 admin admin] PATH_INFO: `/v3/projects/c403f0519ace439e8d9da5d856fe4af6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:18.420012 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23cc5c-e5db-4cd7-8069-1d725d0236b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c403f0519ace439e8d9da5d856fe4af6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:18.427151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23cc5c-e5db-4cd7-8069-1d725d0236b2 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:18.455622 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:18.518336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96925d-b37b-454e-87d4-6378445312ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:18.518984 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96925d-b37b-454e-87d4-6378445312ee admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:18.522493 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96925d-b37b-454e-87d4-6378445312ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:18.522815 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96925d-b37b-454e-87d4-6378445312ee admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:18.523506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96925d-b37b-454e-87d4-6378445312ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:18.529844 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96925d-b37b-454e-87d4-6378445312ee admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:18.555208 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8d23cc5c-e5db-4cd7-8069-1d725d0236b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c403f0519ace439e8d9da5d856fe4af6', 'request_id': 'req-8d23cc5c-e5db-4cd7-8069-1d725d0236b2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:18.569565 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8d23cc5c-e5db-4cd7-8069-1d725d0236b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c403f0519ace439e8d9da5d856fe4af6', 'request_id': 'req-8d23cc5c-e5db-4cd7-8069-1d725d0236b2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:18.574935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:18.588216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 869/1713] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:18 2022] POST /identity/v3/users => generated 290 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:18.589503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96925d-b37b-454e-87d4-6378445312ee admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:18.595395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8d23cc5c-e5db-4cd7-8069-1d725d0236b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c403f0519ace439e8d9da5d856fe4af6', 'request_id': 'req-8d23cc5c-e5db-4cd7-8069-1d725d0236b2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:18.626200 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8d23cc5c-e5db-4cd7-8069-1d725d0236b2 admin admin] The token cache is being invalidate because project c403f0519ace439e8d9da5d856fe4af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:18.626485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8d23cc5c-e5db-4cd7-8069-1d725d0236b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:18.628327 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8d23cc5c-e5db-4cd7-8069-1d725d0236b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:18.639201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 845/1714] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:18 2022] DELETE /identity/v3/projects/c403f0519ace439e8d9da5d856fe4af6 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:18.640966 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc7d89-73ac-4cd0-806e-28db1f1eb722 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:18.641260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc7d89-73ac-4cd0-806e-28db1f1eb722 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:18.641524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc7d89-73ac-4cd0-806e-28db1f1eb722 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:18.645803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 846/1715] 10.222.0.15 () {54 vars in 912 bytes} [Tue Aug 9 11:19:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:18.645803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc7d89-73ac-4cd0-806e-28db1f1eb722 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:18.659791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9bcc7d89-73ac-4cd0-806e-28db1f1eb722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:18.813674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96925d-b37b-454e-87d4-6378445312ee admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:18.870849 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc7d89-73ac-4cd0-806e-28db1f1eb722 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:18.886489 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08261487-49a4-45ea-bfbe-faa95dc98114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:18.887251 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08261487-49a4-45ea-bfbe-faa95dc98114 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:18.887393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08261487-49a4-45ea-bfbe-faa95dc98114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:18.887665 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08261487-49a4-45ea-bfbe-faa95dc98114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:18.888334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08261487-49a4-45ea-bfbe-faa95dc98114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:18.890048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08261487-49a4-45ea-bfbe-faa95dc98114 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:18.915335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 847/1716] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:18.916549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08261487-49a4-45ea-bfbe-faa95dc98114 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:18.923895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-08261487-49a4-45ea-bfbe-faa95dc98114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:18.969587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484cfd0-3bbb-420b-a521-4e5473f8d8de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:18.970691 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484cfd0-3bbb-420b-a521-4e5473f8d8de service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:18.970978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484cfd0-3bbb-420b-a521-4e5473f8d8de service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:18.971253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484cfd0-3bbb-420b-a521-4e5473f8d8de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:18.973318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7484cfd0-3bbb-420b-a521-4e5473f8d8de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:18.976521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08261487-49a4-45ea-bfbe-faa95dc98114 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:18.998253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42e814-17e4-42cb-92a4-73842dcc52e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:18.998918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42e814-17e4-42cb-92a4-73842dcc52e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:18.999190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42e814-17e4-42cb-92a4-73842dcc52e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:18.999631 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42e814-17e4-42cb-92a4-73842dcc52e3 admin admin] PATH_INFO: `/v3/users/44c314368d9a44f689f058a50fbad4c4` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:19.003170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42e814-17e4-42cb-92a4-73842dcc52e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c314368d9a44f689f058a50fbad4c4)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:19.006803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42e814-17e4-42cb-92a4-73842dcc52e3 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:19.007527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484cfd0-3bbb-420b-a521-4e5473f8d8de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:19.021610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484cfd0-3bbb-420b-a521-4e5473f8d8de service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:19.041466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 870/1717] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:19.042918 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848f702-65d8-41d5-b3e7-7e9c9e6fbf43 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:19.046485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848f702-65d8-41d5-b3e7-7e9c9e6fbf43 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:19.046485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848f702-65d8-41d5-b3e7-7e9c9e6fbf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:19.091766 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5848f702-65d8-41d5-b3e7-7e9c9e6fbf43 None None] MFA Rules not processed for user `0ee3889add1541418ccda24268831979`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:19.093946 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5848f702-65d8-41d5-b3e7-7e9c9e6fbf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:19.143934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8b42e814-17e4-42cb-92a4-73842dcc52e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c314368d9a44f689f058a50fbad4c4'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:19.162270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8b42e814-17e4-42cb-92a4-73842dcc52e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c314368d9a44f689f058a50fbad4c4'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:19.163315 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8b42e814-17e4-42cb-92a4-73842dcc52e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c314368d9a44f689f058a50fbad4c4'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:19.178583 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8b42e814-17e4-42cb-92a4-73842dcc52e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c314368d9a44f689f058a50fbad4c4'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:19.219811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8b42e814-17e4-42cb-92a4-73842dcc52e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c314368d9a44f689f058a50fbad4c4'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:19.236778 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 848/1718] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:18 2022] DELETE /identity/v3/users/44c314368d9a44f689f058a50fbad4c4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:19.242621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd6f06-5cc3-4a7b-998a-0b4ef030db5c None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:19.244771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd6f06-5cc3-4a7b-998a-0b4ef030db5c None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:19.245122 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd6f06-5cc3-4a7b-998a-0b4ef030db5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:19.247261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 871/1719] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Aug 9 11:19:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:19.248349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848f702-65d8-41d5-b3e7-7e9c9e6fbf43 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:19.250220 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5848f702-65d8-41d5-b3e7-7e9c9e6fbf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:19.280797 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848f702-65d8-41d5-b3e7-7e9c9e6fbf43 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:19.286012 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:19.329958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-13cd6f06-5cc3-4a7b-998a-0b4ef030db5c None None] MFA Rules not processed for user `994164cde9f14b8ca5714b5e028f33c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:19.331522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-13cd6f06-5cc3-4a7b-998a-0b4ef030db5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:19.388145 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70a9ad-d522-45eb-8b8d-c651716e4226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:19.389022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70a9ad-d522-45eb-8b8d-c651716e4226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:19.389374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70a9ad-d522-45eb-8b8d-c651716e4226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:19.389825 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70a9ad-d522-45eb-8b8d-c651716e4226 admin admin] PATH_INFO: `/v3/projects/82017deff278460b88e6dc3d1c838a03/users/ab1d2e5bbbd3434294101793b9c907e5/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:19.437740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70a9ad-d522-45eb-8b8d-c651716e4226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82017deff278460b88e6dc3d1c838a03, user_id=ab1d2e5bbbd3434294101793b9c907e5, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:19.442154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70a9ad-d522-45eb-8b8d-c651716e4226 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:19.464217 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 872/1720] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:19 2022] PUT /identity/v3/projects/82017deff278460b88e6dc3d1c838a03/users/ab1d2e5bbbd3434294101793b9c907e5/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:19.465198 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70a9ad-d522-45eb-8b8d-c651716e4226 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:19.467134 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5d70a9ad-d522-45eb-8b8d-c651716e4226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:19.516105 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:19.539127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 849/1721] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:19.540154 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd6f06-5cc3-4a7b-998a-0b4ef030db5c None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:19.587169 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd6f06-5cc3-4a7b-998a-0b4ef030db5c None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:19.601718 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70a9ad-d522-45eb-8b8d-c651716e4226 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:19.606162 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca7a0c-3b9f-4ec1-87b7-5cc4ad87abc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:19.606871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca7a0c-3b9f-4ec1-87b7-5cc4ad87abc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:19.607150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca7a0c-3b9f-4ec1-87b7-5cc4ad87abc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:19.607839 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca7a0c-3b9f-4ec1-87b7-5cc4ad87abc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:19.617682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca7a0c-3b9f-4ec1-87b7-5cc4ad87abc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:19.619532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca7a0c-3b9f-4ec1-87b7-5cc4ad87abc8 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:19.631018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 873/1722] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:19.831660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d0b04-88c5-428f-9326-560413a48e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:19.832701 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d0b04-88c5-428f-9326-560413a48e44 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:19.832948 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d0b04-88c5-428f-9326-560413a48e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:19.835793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d0b04-88c5-428f-9326-560413a48e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:19.836548 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d0b04-88c5-428f-9326-560413a48e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:19.840707 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d0b04-88c5-428f-9326-560413a48e44 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:19.901557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 850/1723] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:19.906152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca7a0c-3b9f-4ec1-87b7-5cc4ad87abc8 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:19.932842 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca7a0c-3b9f-4ec1-87b7-5cc4ad87abc8 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:19.966126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1a1dd-af79-4f09-abcc-567d40751c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:19.966846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1a1dd-af79-4f09-abcc-567d40751c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:19.967127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1a1dd-af79-4f09-abcc-567d40751c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:19.967420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1a1dd-af79-4f09-abcc-567d40751c0f admin admin] PATH_INFO: `/v3/projects/82017deff278460b88e6dc3d1c838a03/users/ab1d2e5bbbd3434294101793b9c907e5/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:19.978323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1a1dd-af79-4f09-abcc-567d40751c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=82017deff278460b88e6dc3d1c838a03, user_id=ab1d2e5bbbd3434294101793b9c907e5, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:19.997517 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1a1dd-af79-4f09-abcc-567d40751c0f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:20.045533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 874/1724] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:19 2022] PUT /identity/v3/projects/82017deff278460b88e6dc3d1c838a03/users/ab1d2e5bbbd3434294101793b9c907e5/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:20.050517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0982a-b6ba-46c4-8d9a-4b9e6df8c8a6 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:20.050517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0982a-b6ba-46c4-8d9a-4b9e6df8c8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:20.050517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0982a-b6ba-46c4-8d9a-4b9e6df8c8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:20.164483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-a6f0982a-b6ba-46c4-8d9a-4b9e6df8c8a6 None None] MFA Rules not processed for user `ab1d2e5bbbd3434294101793b9c907e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:20.169094 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a6f0982a-b6ba-46c4-8d9a-4b9e6df8c8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:20.358059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 851/1725] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:20.492693 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1a1dd-af79-4f09-abcc-567d40751c0f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:20.495440 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-78c1a1dd-af79-4f09-abcc-567d40751c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:20.718123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1a1dd-af79-4f09-abcc-567d40751c0f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:20.727855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ad943-2064-4a4e-9f78-5719254047e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:20.728628 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ad943-2064-4a4e-9f78-5719254047e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:20.728904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ad943-2064-4a4e-9f78-5719254047e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:20.729173 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ad943-2064-4a4e-9f78-5719254047e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:20.770720 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ad943-2064-4a4e-9f78-5719254047e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:20.772389 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ad943-2064-4a4e-9f78-5719254047e7 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:20.829441 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 875/1726] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:21.179943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0982a-b6ba-46c4-8d9a-4b9e6df8c8a6 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:21.181558 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a6f0982a-b6ba-46c4-8d9a-4b9e6df8c8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:21.414267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0982a-b6ba-46c4-8d9a-4b9e6df8c8a6 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:21.440461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbfba4-3755-45d5-a5cd-797c43c4a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:21.445179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbfba4-3755-45d5-a5cd-797c43c4a7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:21.445459 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbfba4-3755-45d5-a5cd-797c43c4a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:21.445757 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbfba4-3755-45d5-a5cd-797c43c4a7d0 admin admin] PATH_INFO: `/v3/projects/7e8e12807e8448a48db30d971c2dc48e` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:21.454624 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbfba4-3755-45d5-a5cd-797c43c4a7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8e12807e8448a48db30d971c2dc48e)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:21.468405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbfba4-3755-45d5-a5cd-797c43c4a7d0 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:21.571118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:21.713642 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-53cbfba4-3755-45d5-a5cd-797c43c4a7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8e12807e8448a48db30d971c2dc48e', 'request_id': 'req-53cbfba4-3755-45d5-a5cd-797c43c4a7d0'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:21.739186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-53cbfba4-3755-45d5-a5cd-797c43c4a7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8e12807e8448a48db30d971c2dc48e', 'request_id': 'req-53cbfba4-3755-45d5-a5cd-797c43c4a7d0'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:21.761362 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-53cbfba4-3755-45d5-a5cd-797c43c4a7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8e12807e8448a48db30d971c2dc48e', 'request_id': 'req-53cbfba4-3755-45d5-a5cd-797c43c4a7d0'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:21.824463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-53cbfba4-3755-45d5-a5cd-797c43c4a7d0 admin admin] The token cache is being invalidate because project 7e8e12807e8448a48db30d971c2dc48e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:21.826097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-53cbfba4-3755-45d5-a5cd-797c43c4a7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:21.830939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-53cbfba4-3755-45d5-a5cd-797c43c4a7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:21.834172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 852/1727] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:21 2022] DELETE /identity/v3/projects/7e8e12807e8448a48db30d971c2dc48e => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:21.841541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998a640-74f1-4c6b-a1cb-a06fd621ded1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:21.842992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998a640-74f1-4c6b-a1cb-a06fd621ded1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:21.843550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998a640-74f1-4c6b-a1cb-a06fd621ded1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:21.873184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0998a640-74f1-4c6b-a1cb-a06fd621ded1 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:21.875050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0998a640-74f1-4c6b-a1cb-a06fd621ded1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:21.913360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:22.118264 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 876/1728] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:22.128242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92187c-f468-4427-8a72-2fdcf32abbdc None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:22.128561 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92187c-f468-4427-8a72-2fdcf32abbdc None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:22.128874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92187c-f468-4427-8a72-2fdcf32abbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:22.199027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-fc92187c-f468-4427-8a72-2fdcf32abbdc None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:22.203584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fc92187c-f468-4427-8a72-2fdcf32abbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:22.271059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998a640-74f1-4c6b-a1cb-a06fd621ded1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:22.271281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 853/1729] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:22.285011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998a640-74f1-4c6b-a1cb-a06fd621ded1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:22.314794 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824aed6-7652-4af5-9ccf-b9c8ee24df32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:22.315502 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824aed6-7652-4af5-9ccf-b9c8ee24df32 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:22.315782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824aed6-7652-4af5-9ccf-b9c8ee24df32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:22.316052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824aed6-7652-4af5-9ccf-b9c8ee24df32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:22.316709 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824aed6-7652-4af5-9ccf-b9c8ee24df32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:19:22.317010 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824aed6-7652-4af5-9ccf-b9c8ee24df32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:22.333255 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824aed6-7652-4af5-9ccf-b9c8ee24df32 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:22.398090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 877/1730] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:19:22.403390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92187c-f468-4427-8a72-2fdcf32abbdc None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:22.425174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92187c-f468-4427-8a72-2fdcf32abbdc None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:22.459452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ff063-effc-4c42-b256-300a6ecf1e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:22.460296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ff063-effc-4c42-b256-300a6ecf1e4b admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:22.460813 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ff063-effc-4c42-b256-300a6ecf1e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:22.461264 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ff063-effc-4c42-b256-300a6ecf1e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:22.462118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ff063-effc-4c42-b256-300a6ecf1e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:22.469218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ff063-effc-4c42-b256-300a6ecf1e4b admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:22.640442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 854/1731] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:22 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:22.645093 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824aed6-7652-4af5-9ccf-b9c8ee24df32 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:22.661779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824aed6-7652-4af5-9ccf-b9c8ee24df32 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:22.930348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8accd-052f-40e2-a10e-48e6f95d5742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:22.931361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8accd-052f-40e2-a10e-48e6f95d5742 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:22.932847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8accd-052f-40e2-a10e-48e6f95d5742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:22.933335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8accd-052f-40e2-a10e-48e6f95d5742 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:22.934719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8accd-052f-40e2-a10e-48e6f95d5742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:22.939398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8accd-052f-40e2-a10e-48e6f95d5742 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:23.037763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ff063-effc-4c42-b256-300a6ecf1e4b admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:23.044974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 878/1732] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:22 2022] POST /identity/v3/users => generated 293 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:23.050377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ff063-effc-4c42-b256-300a6ecf1e4b admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:23.067824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddca9b-15c1-439b-867a-fab95551d808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:23.069006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddca9b-15c1-439b-867a-fab95551d808 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:23.069880 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddca9b-15c1-439b-867a-fab95551d808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:23.070394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddca9b-15c1-439b-867a-fab95551d808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:23.071347 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddca9b-15c1-439b-867a-fab95551d808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:23.074605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddca9b-15c1-439b-867a-fab95551d808 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:23.117476 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 855/1733] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:19:23.123011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8accd-052f-40e2-a10e-48e6f95d5742 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:23.134513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddca9b-15c1-439b-867a-fab95551d808 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:23.137180 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d3ddca9b-15c1-439b-867a-fab95551d808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:23.141796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8accd-052f-40e2-a10e-48e6f95d5742 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:23.166633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b987fa5-3d27-4b97-b9a1-a99a962a51c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:23.167587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b987fa5-3d27-4b97-b9a1-a99a962a51c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:23.182734 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b987fa5-3d27-4b97-b9a1-a99a962a51c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:23.185085 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b987fa5-3d27-4b97-b9a1-a99a962a51c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:23.186152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b987fa5-3d27-4b97-b9a1-a99a962a51c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:23.188273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b987fa5-3d27-4b97-b9a1-a99a962a51c4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:23.217095 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddca9b-15c1-439b-867a-fab95551d808 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:23.236030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 879/1734] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:23.237378 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b987fa5-3d27-4b97-b9a1-a99a962a51c4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:23.276218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b987fa5-3d27-4b97-b9a1-a99a962a51c4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:23.279439 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721c1d3-56e6-4f39-b632-2ae2f8b2bb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:23.282198 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721c1d3-56e6-4f39-b632-2ae2f8b2bb71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:23.290791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721c1d3-56e6-4f39-b632-2ae2f8b2bb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:23.294108 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721c1d3-56e6-4f39-b632-2ae2f8b2bb71 admin admin] PATH_INFO: `/v3/users/96badfb596894c24b624bef859ce30fa` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:23.317324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721c1d3-56e6-4f39-b632-2ae2f8b2bb71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96badfb596894c24b624bef859ce30fa)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:23.318616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72097e5-57c1-4b1d-8011-7c31a9ece247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:23.323437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72097e5-57c1-4b1d-8011-7c31a9ece247 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:23.323759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72097e5-57c1-4b1d-8011-7c31a9ece247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:23.328693 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72097e5-57c1-4b1d-8011-7c31a9ece247 admin admin] PATH_INFO: `/v3/projects/9b7d7de899ed4c83b1bdb4393dc7508c/users/255bed72ec254910868c97d3576bf125/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:23.330711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721c1d3-56e6-4f39-b632-2ae2f8b2bb71 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:23.426730 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72097e5-57c1-4b1d-8011-7c31a9ece247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b7d7de899ed4c83b1bdb4393dc7508c, user_id=255bed72ec254910868c97d3576bf125, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:23.438977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72097e5-57c1-4b1d-8011-7c31a9ece247 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:23.515127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 880/1735] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:23 2022] PUT /identity/v3/projects/9b7d7de899ed4c83b1bdb4393dc7508c/users/255bed72ec254910868c97d3576bf125/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:23.527648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6001cd-1916-4abd-91c8-087ed21acf48 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:23.528350 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6001cd-1916-4abd-91c8-087ed21acf48 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:23.538402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0721c1d3-56e6-4f39-b632-2ae2f8b2bb71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96badfb596894c24b624bef859ce30fa'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:23.539656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6001cd-1916-4abd-91c8-087ed21acf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:23.566687 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0721c1d3-56e6-4f39-b632-2ae2f8b2bb71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96badfb596894c24b624bef859ce30fa'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:23.567927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0721c1d3-56e6-4f39-b632-2ae2f8b2bb71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96badfb596894c24b624bef859ce30fa'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:23.599472 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0721c1d3-56e6-4f39-b632-2ae2f8b2bb71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96badfb596894c24b624bef859ce30fa'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:23.667853 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0721c1d3-56e6-4f39-b632-2ae2f8b2bb71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96badfb596894c24b624bef859ce30fa'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:23.707922 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 856/1736] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:23 2022] DELETE /identity/v3/users/96badfb596894c24b624bef859ce30fa => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:23.709733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1c6001cd-1916-4abd-91c8-087ed21acf48 None None] MFA Rules not processed for user `255bed72ec254910868c97d3576bf125`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:23.717537 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ed123-3798-453f-8170-e3c388ad750c None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:23.721583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1c6001cd-1916-4abd-91c8-087ed21acf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:23.726492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ed123-3798-453f-8170-e3c388ad750c None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:23.726957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ed123-3798-453f-8170-e3c388ad750c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:23.786620 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-a55ed123-3798-453f-8170-e3c388ad750c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:23.788947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a55ed123-3798-453f-8170-e3c388ad750c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:23.995888 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:24.041647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 881/1737] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:24.044772 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6001cd-1916-4abd-91c8-087ed21acf48 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:24.051378 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1c6001cd-1916-4abd-91c8-087ed21acf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:24.053057 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:24.152662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 857/1738] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:24.154442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e6939-d8c1-438d-b799-c52cdd768add None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:24.162061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e6939-d8c1-438d-b799-c52cdd768add None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:24.162775 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e6939-d8c1-438d-b799-c52cdd768add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:24.246833 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6001cd-1916-4abd-91c8-087ed21acf48 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:24.261571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c8542-6f2f-426d-b301-24f1e960f915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:24.262415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c8542-6f2f-426d-b301-24f1e960f915 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:24.262802 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c8542-6f2f-426d-b301-24f1e960f915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:24.263148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c8542-6f2f-426d-b301-24f1e960f915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:24.263911 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c8542-6f2f-426d-b301-24f1e960f915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:24.272142 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c8542-6f2f-426d-b301-24f1e960f915 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:24.360604 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 882/1739] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:24 2022] POST /identity/v3/projects => generated 387 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:24.360604 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c8542-6f2f-426d-b301-24f1e960f915 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:24.381690 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7a7c8542-6f2f-426d-b301-24f1e960f915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:24.437960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-cb4e6939-d8c1-438d-b799-c52cdd768add None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:24.442067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-cb4e6939-d8c1-438d-b799-c52cdd768add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:24.664363 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c8542-6f2f-426d-b301-24f1e960f915 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:24.675398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93352921-25be-4bc3-bf53-c1ccadedbb73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:24.676181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93352921-25be-4bc3-bf53-c1ccadedbb73 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:24.676517 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93352921-25be-4bc3-bf53-c1ccadedbb73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:24.676847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93352921-25be-4bc3-bf53-c1ccadedbb73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:24.727764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 858/1740] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Aug 9 11:19:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 574 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:24.731666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e6939-d8c1-438d-b799-c52cdd768add None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:24.871445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93352921-25be-4bc3-bf53-c1ccadedbb73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:24.873322 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93352921-25be-4bc3-bf53-c1ccadedbb73 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:24.888151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 883/1741] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:24.890657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706549f-4144-4a1a-a3f5-1022c4067689 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:24.891268 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706549f-4144-4a1a-a3f5-1022c4067689 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:24.891779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706549f-4144-4a1a-a3f5-1022c4067689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:24.897905 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e6939-d8c1-438d-b799-c52cdd768add None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:24.922007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff3ef0-0c0e-4d99-a36e-b8f1fba9efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:24.922727 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff3ef0-0c0e-4d99-a36e-b8f1fba9efc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:24.923057 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff3ef0-0c0e-4d99-a36e-b8f1fba9efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:24.923321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff3ef0-0c0e-4d99-a36e-b8f1fba9efc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:24.924149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff3ef0-0c0e-4d99-a36e-b8f1fba9efc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:24.926457 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff3ef0-0c0e-4d99-a36e-b8f1fba9efc1 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:24.936982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e706549f-4144-4a1a-a3f5-1022c4067689 None None] MFA Rules not processed for user `d98fa7056d4247edbda7c8e406e2dcb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:24.938474 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e706549f-4144-4a1a-a3f5-1022c4067689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:24.973965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:25.011889 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 859/1742] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:24 2022] POST /identity/v3/users => generated 300 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:25.019345 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff3ef0-0c0e-4d99-a36e-b8f1fba9efc1 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:25.061143 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff3ef0-0c0e-4d99-a36e-b8f1fba9efc1 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:25.073210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 884/1743] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:25.074467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706549f-4144-4a1a-a3f5-1022c4067689 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:25.076079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e706549f-4144-4a1a-a3f5-1022c4067689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:25.102432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3c889-56c8-4203-ac03-bb0f3a3867e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:25.103062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3c889-56c8-4203-ac03-bb0f3a3867e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:25.103404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3c889-56c8-4203-ac03-bb0f3a3867e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:25.103677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3c889-56c8-4203-ac03-bb0f3a3867e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:25.104413 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3c889-56c8-4203-ac03-bb0f3a3867e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:25.106162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3c889-56c8-4203-ac03-bb0f3a3867e9 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:25.143629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 860/1744] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:25.157249 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3c889-56c8-4203-ac03-bb0f3a3867e9 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:25.194303 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3c889-56c8-4203-ac03-bb0f3a3867e9 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:25.216955 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f46b20-9ab0-412a-b117-cc0797ef62cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:25.217769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f46b20-9ab0-412a-b117-cc0797ef62cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:25.218138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f46b20-9ab0-412a-b117-cc0797ef62cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:25.218506 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f46b20-9ab0-412a-b117-cc0797ef62cf admin admin] PATH_INFO: `/v3/projects/758f61e6df4444f283b4600a32d892d3/users/7d49008a8d324516a493a8c7a26a8402/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:25.269090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f46b20-9ab0-412a-b117-cc0797ef62cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=758f61e6df4444f283b4600a32d892d3, user_id=7d49008a8d324516a493a8c7a26a8402, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:25.280356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f46b20-9ab0-412a-b117-cc0797ef62cf admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:25.315082 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 861/1745] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:25 2022] PUT /identity/v3/projects/758f61e6df4444f283b4600a32d892d3/users/7d49008a8d324516a493a8c7a26a8402/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:25.317413 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f46b20-9ab0-412a-b117-cc0797ef62cf admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:25.328292 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e9f46b20-9ab0-412a-b117-cc0797ef62cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:25.378591 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:25.458849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706549f-4144-4a1a-a3f5-1022c4067689 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:25.540344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f46b20-9ab0-412a-b117-cc0797ef62cf admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:25.555279 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe13da-c945-4783-bff4-c7255de5432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:25.556128 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe13da-c945-4783-bff4-c7255de5432b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:25.556538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe13da-c945-4783-bff4-c7255de5432b admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:25.556939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe13da-c945-4783-bff4-c7255de5432b admin admin] PATH_INFO: `/v3/users/9ce10ded972c40aca2203a9b29e9b10a` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:25.558790 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe13da-c945-4783-bff4-c7255de5432b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce10ded972c40aca2203a9b29e9b10a)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:25.560985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe13da-c945-4783-bff4-c7255de5432b admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:25.762194 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-39fe13da-c945-4783-bff4-c7255de5432b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce10ded972c40aca2203a9b29e9b10a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:25.781330 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193001b-b2a1-4020-a48c-610f67fd4128 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:25.793689 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193001b-b2a1-4020-a48c-610f67fd4128 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:25.796069 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193001b-b2a1-4020-a48c-610f67fd4128 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:25.796522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193001b-b2a1-4020-a48c-610f67fd4128 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:25.816748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-39fe13da-c945-4783-bff4-c7255de5432b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce10ded972c40aca2203a9b29e9b10a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:25.820609 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-39fe13da-c945-4783-bff4-c7255de5432b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce10ded972c40aca2203a9b29e9b10a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:25.873255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-39fe13da-c945-4783-bff4-c7255de5432b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce10ded972c40aca2203a9b29e9b10a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:25.984373 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-39fe13da-c945-4783-bff4-c7255de5432b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce10ded972c40aca2203a9b29e9b10a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:26.009010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 862/1746] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:25 2022] DELETE /identity/v3/users/9ce10ded972c40aca2203a9b29e9b10a => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:26.010191 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe13da-c945-4783-bff4-c7255de5432b admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:26.013684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-39fe13da-c945-4783-bff4-c7255de5432b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:26.188726 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193001b-b2a1-4020-a48c-610f67fd4128 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:26.198086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193001b-b2a1-4020-a48c-610f67fd4128 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:26.201153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe13da-c945-4783-bff4-c7255de5432b admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:26.234622 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:26.254527 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa16ef-d65e-452c-848f-66dd327a2c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:26.255531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa16ef-d65e-452c-848f-66dd327a2c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:26.255985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa16ef-d65e-452c-848f-66dd327a2c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:26.256428 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa16ef-d65e-452c-848f-66dd327a2c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:26.257276 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa16ef-d65e-452c-848f-66dd327a2c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:26.260096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa16ef-d65e-452c-848f-66dd327a2c29 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:26.276932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 885/1747] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:19:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:19:26.287709 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de594e-ee06-4b0c-872b-e038060daff4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:26.298094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de594e-ee06-4b0c-872b-e038060daff4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:26.300676 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de594e-ee06-4b0c-872b-e038060daff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:26.331105 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 863/1748] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:26.335336 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa16ef-d65e-452c-848f-66dd327a2c29 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:26.395131 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-53de594e-ee06-4b0c-872b-e038060daff4 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:26.410487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-53de594e-ee06-4b0c-872b-e038060daff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:26.412623 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa16ef-d65e-452c-848f-66dd327a2c29 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:26.439487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 886/1749] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:26.439487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de594e-ee06-4b0c-872b-e038060daff4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:26.442166 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-53de594e-ee06-4b0c-872b-e038060daff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:26.464097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982ce1b-2837-4496-987f-aa163db46978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:26.468768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982ce1b-2837-4496-987f-aa163db46978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:26.470465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982ce1b-2837-4496-987f-aa163db46978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:26.471304 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982ce1b-2837-4496-987f-aa163db46978 admin admin] PATH_INFO: `/v3/projects/758f61e6df4444f283b4600a32d892d3/users/7d49008a8d324516a493a8c7a26a8402/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:26.475035 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de594e-ee06-4b0c-872b-e038060daff4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:26.479986 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982ce1b-2837-4496-987f-aa163db46978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758f61e6df4444f283b4600a32d892d3, user_id=7d49008a8d324516a493a8c7a26a8402, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:26.507404 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e958c-4dda-4cbe-953b-b131388e2028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:26.508164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e958c-4dda-4cbe-953b-b131388e2028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:26.508438 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e958c-4dda-4cbe-953b-b131388e2028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:26.508706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e958c-4dda-4cbe-953b-b131388e2028 admin admin] PATH_INFO: `/v3/projects/c4635fc24ed149008e9bd368b5fad746` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:26.511432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982ce1b-2837-4496-987f-aa163db46978 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:26.512669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e958c-4dda-4cbe-953b-b131388e2028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4635fc24ed149008e9bd368b5fad746)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:26.515015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e958c-4dda-4cbe-953b-b131388e2028 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:26.574914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 864/1750] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:26 2022] PUT /identity/v3/projects/758f61e6df4444f283b4600a32d892d3/users/7d49008a8d324516a493a8c7a26a8402/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:26.592506 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df01d68-f191-4c8e-a918-54b66f51cf83 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:26.594777 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df01d68-f191-4c8e-a918-54b66f51cf83 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:26.595711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df01d68-f191-4c8e-a918-54b66f51cf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:26.730146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:26.743792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-513e958c-4dda-4cbe-953b-b131388e2028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4635fc24ed149008e9bd368b5fad746', 'request_id': 'req-513e958c-4dda-4cbe-953b-b131388e2028'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:26.762441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-9df01d68-f191-4c8e-a918-54b66f51cf83 None None] MFA Rules not processed for user `7d49008a8d324516a493a8c7a26a8402`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:26.765206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9df01d68-f191-4c8e-a918-54b66f51cf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:26.768216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-513e958c-4dda-4cbe-953b-b131388e2028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4635fc24ed149008e9bd368b5fad746', 'request_id': 'req-513e958c-4dda-4cbe-953b-b131388e2028'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:26.790644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-513e958c-4dda-4cbe-953b-b131388e2028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4635fc24ed149008e9bd368b5fad746', 'request_id': 'req-513e958c-4dda-4cbe-953b-b131388e2028'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:26.841671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-513e958c-4dda-4cbe-953b-b131388e2028 admin admin] The token cache is being invalidate because project c4635fc24ed149008e9bd368b5fad746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:26.841671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-513e958c-4dda-4cbe-953b-b131388e2028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:26.847481 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-513e958c-4dda-4cbe-953b-b131388e2028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:26.858770 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 887/1751] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:26 2022] DELETE /identity/v3/projects/c4635fc24ed149008e9bd368b5fad746 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:26.860519 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e958c-4dda-4cbe-953b-b131388e2028 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:26.863036 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-513e958c-4dda-4cbe-953b-b131388e2028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:27.187145 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e958c-4dda-4cbe-953b-b131388e2028 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:27.219007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a053f12-fad3-4e74-9e9f-392ce27d5a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:27.220201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a053f12-fad3-4e74-9e9f-392ce27d5a60 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:27.224529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a053f12-fad3-4e74-9e9f-392ce27d5a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:27.225458 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a053f12-fad3-4e74-9e9f-392ce27d5a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:27.234670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0a053f12-fad3-4e74-9e9f-392ce27d5a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:27.300491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 865/1752] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 710 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:27.302030 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df01d68-f191-4c8e-a918-54b66f51cf83 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:27.308484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9df01d68-f191-4c8e-a918-54b66f51cf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:27.526360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a053f12-fad3-4e74-9e9f-392ce27d5a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:27.527688 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a053f12-fad3-4e74-9e9f-392ce27d5a60 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:27.530767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df01d68-f191-4c8e-a918-54b66f51cf83 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:27.538986 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790234a3-0fb0-4775-8ef9-6d57a973cfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:27.539637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790234a3-0fb0-4775-8ef9-6d57a973cfbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:27.540117 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790234a3-0fb0-4775-8ef9-6d57a973cfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:27.540386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790234a3-0fb0-4775-8ef9-6d57a973cfbd admin admin] PATH_INFO: `/v3/users/885232c30f2b43baad0d3adad1f36003` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:27.543354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790234a3-0fb0-4775-8ef9-6d57a973cfbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=885232c30f2b43baad0d3adad1f36003)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:27.549334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790234a3-0fb0-4775-8ef9-6d57a973cfbd admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:27.554409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 888/1753] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:27.556679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a053f12-fad3-4e74-9e9f-392ce27d5a60 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:27.567166 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0a053f12-fad3-4e74-9e9f-392ce27d5a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:27.652672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:27.683069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-790234a3-0fb0-4775-8ef9-6d57a973cfbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885232c30f2b43baad0d3adad1f36003'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:27.705867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-790234a3-0fb0-4775-8ef9-6d57a973cfbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885232c30f2b43baad0d3adad1f36003'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:27.706424 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-790234a3-0fb0-4775-8ef9-6d57a973cfbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885232c30f2b43baad0d3adad1f36003'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:27.734286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-790234a3-0fb0-4775-8ef9-6d57a973cfbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885232c30f2b43baad0d3adad1f36003'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:27.764571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a053f12-fad3-4e74-9e9f-392ce27d5a60 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:27.781244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063f38e-c725-4ae0-98aa-653fb983cc11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:27.782470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-790234a3-0fb0-4775-8ef9-6d57a973cfbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885232c30f2b43baad0d3adad1f36003'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:27.783137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063f38e-c725-4ae0-98aa-653fb983cc11 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:27.783708 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063f38e-c725-4ae0-98aa-653fb983cc11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:27.784074 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063f38e-c725-4ae0-98aa-653fb983cc11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:27.792653 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a063f38e-c725-4ae0-98aa-653fb983cc11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:27.811074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 866/1754] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:27 2022] DELETE /identity/v3/users/885232c30f2b43baad0d3adad1f36003 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:27.830798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063f38e-c725-4ae0-98aa-653fb983cc11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:27.838333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063f38e-c725-4ae0-98aa-653fb983cc11 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:27.891039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 889/1755] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:27 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:27.944402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790234a3-0fb0-4775-8ef9-6d57a973cfbd admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:27.946720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-790234a3-0fb0-4775-8ef9-6d57a973cfbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:28.002616 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:28.200369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1a72-8e57-4443-b25f-f0e12153d5bd None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:28.200915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1a72-8e57-4443-b25f-f0e12153d5bd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:28.201351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1a72-8e57-4443-b25f-f0e12153d5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:28.245828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-936f1a72-8e57-4443-b25f-f0e12153d5bd None None] MFA Rules not processed for user `84405f12c84a40d79493e02276e65266`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:28.248066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-936f1a72-8e57-4443-b25f-f0e12153d5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:28.284709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790234a3-0fb0-4775-8ef9-6d57a973cfbd admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:28.300067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc9b17-e3d6-4e6b-b9ad-b4647cb9938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:28.301670 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc9b17-e3d6-4e6b-b9ad-b4647cb9938f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:28.302571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc9b17-e3d6-4e6b-b9ad-b4647cb9938f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:28.306114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc9b17-e3d6-4e6b-b9ad-b4647cb9938f admin admin] PATH_INFO: `/v3/users/255bed72ec254910868c97d3576bf125` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:28.310425 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc9b17-e3d6-4e6b-b9ad-b4647cb9938f admin admin] RBAC: Authorizing `identity:delete_user(user_id=255bed72ec254910868c97d3576bf125)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:28.330667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc9b17-e3d6-4e6b-b9ad-b4647cb9938f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:28.502474 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 890/1756] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:28.547826 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-84fc9b17-e3d6-4e6b-b9ad-b4647cb9938f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '255bed72ec254910868c97d3576bf125'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:28.578280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-84fc9b17-e3d6-4e6b-b9ad-b4647cb9938f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '255bed72ec254910868c97d3576bf125'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:28.579593 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-84fc9b17-e3d6-4e6b-b9ad-b4647cb9938f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '255bed72ec254910868c97d3576bf125'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:28.603447 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-84fc9b17-e3d6-4e6b-b9ad-b4647cb9938f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '255bed72ec254910868c97d3576bf125'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:28.640469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-84fc9b17-e3d6-4e6b-b9ad-b4647cb9938f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '255bed72ec254910868c97d3576bf125'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:28.668100 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 867/1757] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:27 2022] DELETE /identity/v3/users/255bed72ec254910868c97d3576bf125 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:19:28.668509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4db50-e8a4-48dc-8168-1e35576bd23d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:28.668891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4db50-e8a4-48dc-8168-1e35576bd23d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:28.669263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4db50-e8a4-48dc-8168-1e35576bd23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:28.724425 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-96b4db50-e8a4-48dc-8168-1e35576bd23d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:28.730859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-96b4db50-e8a4-48dc-8168-1e35576bd23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:28.882739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 891/1758] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:28.918710 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc9b17-e3d6-4e6b-b9ad-b4647cb9938f admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:28.920349 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-84fc9b17-e3d6-4e6b-b9ad-b4647cb9938f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:29.085125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc9b17-e3d6-4e6b-b9ad-b4647cb9938f admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:29.094023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062bc32-cff3-451d-996a-9d8de988143a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:29.094845 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062bc32-cff3-451d-996a-9d8de988143a service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:29.095134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062bc32-cff3-451d-996a-9d8de988143a service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:29.095398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062bc32-cff3-451d-996a-9d8de988143a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:29.110735 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062bc32-cff3-451d-996a-9d8de988143a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:29.112179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e062bc32-cff3-451d-996a-9d8de988143a service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:29.123974 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 868/1759] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:30.714553 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4db50-e8a4-48dc-8168-1e35576bd23d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:30.716107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-96b4db50-e8a4-48dc-8168-1e35576bd23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:30.744352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4db50-e8a4-48dc-8168-1e35576bd23d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:30.760700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ef57f-61b0-436d-b78a-44933b46b434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:30.763006 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ef57f-61b0-436d-b78a-44933b46b434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:30.765245 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ef57f-61b0-436d-b78a-44933b46b434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:30.768684 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ef57f-61b0-436d-b78a-44933b46b434 admin admin] PATH_INFO: `/v3/projects/cae44e23b8934501a1c212ad600b88e1` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:30.771351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ef57f-61b0-436d-b78a-44933b46b434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae44e23b8934501a1c212ad600b88e1)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:30.778350 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ef57f-61b0-436d-b78a-44933b46b434 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:30.862168 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed0ef57f-61b0-436d-b78a-44933b46b434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae44e23b8934501a1c212ad600b88e1', 'request_id': 'req-ed0ef57f-61b0-436d-b78a-44933b46b434'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:30.873708 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed0ef57f-61b0-436d-b78a-44933b46b434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae44e23b8934501a1c212ad600b88e1', 'request_id': 'req-ed0ef57f-61b0-436d-b78a-44933b46b434'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:30.891957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed0ef57f-61b0-436d-b78a-44933b46b434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae44e23b8934501a1c212ad600b88e1', 'request_id': 'req-ed0ef57f-61b0-436d-b78a-44933b46b434'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:30.900270 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:30.926348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed0ef57f-61b0-436d-b78a-44933b46b434 admin admin] The token cache is being invalidate because project cae44e23b8934501a1c212ad600b88e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:30.926641 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed0ef57f-61b0-436d-b78a-44933b46b434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:30.928567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ed0ef57f-61b0-436d-b78a-44933b46b434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:30.934404 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 892/1760] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:30 2022] DELETE /identity/v3/projects/cae44e23b8934501a1c212ad600b88e1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:30.939641 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062bc32-cff3-451d-996a-9d8de988143a service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:30.973925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062bc32-cff3-451d-996a-9d8de988143a service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:31.098398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:31.104524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfe94c-9d3f-4f0d-bffb-1fe8402526a5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:31.105174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfe94c-9d3f-4f0d-bffb-1fe8402526a5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:31.105908 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfe94c-9d3f-4f0d-bffb-1fe8402526a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:31.136863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34ebfe-9146-4f04-a1b9-2788cd83da3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:31.137748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34ebfe-9146-4f04-a1b9-2788cd83da3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:31.138022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34ebfe-9146-4f04-a1b9-2788cd83da3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:31.138396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34ebfe-9146-4f04-a1b9-2788cd83da3c admin admin] PATH_INFO: `/v3/users/ab1d2e5bbbd3434294101793b9c907e5` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:31.140153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34ebfe-9146-4f04-a1b9-2788cd83da3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1d2e5bbbd3434294101793b9c907e5)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:31.144874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34ebfe-9146-4f04-a1b9-2788cd83da3c admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:31.151790 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8cbfe94c-9d3f-4f0d-bffb-1fe8402526a5 None None] MFA Rules not processed for user `0ee3889add1541418ccda24268831979`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:31.153391 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8cbfe94c-9d3f-4f0d-bffb-1fe8402526a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:31.295385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 893/1761] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Aug 9 11:19:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:31.360463 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfe94c-9d3f-4f0d-bffb-1fe8402526a5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:31.361865 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6c34ebfe-9146-4f04-a1b9-2788cd83da3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1d2e5bbbd3434294101793b9c907e5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:31.363470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8cbfe94c-9d3f-4f0d-bffb-1fe8402526a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:31.389847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfe94c-9d3f-4f0d-bffb-1fe8402526a5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:31.399897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857fe6a-6ebb-49c3-b12c-3f6a2b25173b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:31.400574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857fe6a-6ebb-49c3-b12c-3f6a2b25173b service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:31.400883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857fe6a-6ebb-49c3-b12c-3f6a2b25173b service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:31.401154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857fe6a-6ebb-49c3-b12c-3f6a2b25173b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:31.402038 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6c34ebfe-9146-4f04-a1b9-2788cd83da3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1d2e5bbbd3434294101793b9c907e5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:31.405937 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6c34ebfe-9146-4f04-a1b9-2788cd83da3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1d2e5bbbd3434294101793b9c907e5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:31.431200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857fe6a-6ebb-49c3-b12c-3f6a2b25173b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:31.437761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857fe6a-6ebb-49c3-b12c-3f6a2b25173b service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:31.439012 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6c34ebfe-9146-4f04-a1b9-2788cd83da3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1d2e5bbbd3434294101793b9c907e5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:31.467811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 894/1762] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:19:31.540944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6c34ebfe-9146-4f04-a1b9-2788cd83da3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1d2e5bbbd3434294101793b9c907e5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:31.567014 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 869/1763] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:30 2022] DELETE /identity/v3/users/ab1d2e5bbbd3434294101793b9c907e5 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:33.051496 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857fe6a-6ebb-49c3-b12c-3f6a2b25173b service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:33.053224 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1857fe6a-6ebb-49c3-b12c-3f6a2b25173b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:33.087256 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857fe6a-6ebb-49c3-b12c-3f6a2b25173b service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:33.320471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ebed9-7927-44c6-8641-2ca795726d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:33.322392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ebed9-7927-44c6-8641-2ca795726d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:33.323000 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ebed9-7927-44c6-8641-2ca795726d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:33.324711 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ebed9-7927-44c6-8641-2ca795726d95 admin admin] PATH_INFO: `/v3/projects/dbe60f930a9c4e6da24d3b4b97e12e6e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:33.328274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ebed9-7927-44c6-8641-2ca795726d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe60f930a9c4e6da24d3b4b97e12e6e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:33.343233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ebed9-7927-44c6-8641-2ca795726d95 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:33.530640 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df1ebed9-7927-44c6-8641-2ca795726d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe60f930a9c4e6da24d3b4b97e12e6e', 'request_id': 'req-df1ebed9-7927-44c6-8641-2ca795726d95'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:33.554029 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df1ebed9-7927-44c6-8641-2ca795726d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe60f930a9c4e6da24d3b4b97e12e6e', 'request_id': 'req-df1ebed9-7927-44c6-8641-2ca795726d95'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:33.574319 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df1ebed9-7927-44c6-8641-2ca795726d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe60f930a9c4e6da24d3b4b97e12e6e', 'request_id': 'req-df1ebed9-7927-44c6-8641-2ca795726d95'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:33.626426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df1ebed9-7927-44c6-8641-2ca795726d95 admin admin] The token cache is being invalidate because project dbe60f930a9c4e6da24d3b4b97e12e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:33.628103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df1ebed9-7927-44c6-8641-2ca795726d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:33.629348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-df1ebed9-7927-44c6-8641-2ca795726d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:33.639867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 895/1764] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:33 2022] DELETE /identity/v3/projects/dbe60f930a9c4e6da24d3b4b97e12e6e => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:33.642544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31da67-88d0-4148-90dd-174934e37793 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:33.643185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31da67-88d0-4148-90dd-174934e37793 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:33.643185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31da67-88d0-4148-90dd-174934e37793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:33.725432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-8a31da67-88d0-4148-90dd-174934e37793 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:33.729658 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8a31da67-88d0-4148-90dd-174934e37793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:33.953087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 870/1765] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:33.967334 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3b9fa-be9c-4889-a111-c5435adea33f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:33.967334 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3b9fa-be9c-4889-a111-c5435adea33f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:33.967334 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3b9fa-be9c-4889-a111-c5435adea33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:34.019604 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1ce3b9fa-be9c-4889-a111-c5435adea33f None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:34.028817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1ce3b9fa-be9c-4889-a111-c5435adea33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:34.057647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 896/1766] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:34.058640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31da67-88d0-4148-90dd-174934e37793 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:34.071997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31da67-88d0-4148-90dd-174934e37793 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:34.082914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc98236-812b-434d-b7a7-522b5388ed3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:34.083879 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc98236-812b-434d-b7a7-522b5388ed3f admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:34.084312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc98236-812b-434d-b7a7-522b5388ed3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:34.084899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc98236-812b-434d-b7a7-522b5388ed3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:34.100038 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc98236-812b-434d-b7a7-522b5388ed3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:19:34.100552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc98236-812b-434d-b7a7-522b5388ed3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:34.102680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc98236-812b-434d-b7a7-522b5388ed3f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:34.126935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 871/1767] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:19:34.128677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3b9fa-be9c-4889-a111-c5435adea33f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:34.167046 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3b9fa-be9c-4889-a111-c5435adea33f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:34.188341 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68ce97-2763-4b74-8ae9-3c7a7d4bc42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:34.190519 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68ce97-2763-4b74-8ae9-3c7a7d4bc42e admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:34.192864 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68ce97-2763-4b74-8ae9-3c7a7d4bc42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:34.193502 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68ce97-2763-4b74-8ae9-3c7a7d4bc42e admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:34.194348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68ce97-2763-4b74-8ae9-3c7a7d4bc42e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:34.198050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68ce97-2763-4b74-8ae9-3c7a7d4bc42e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:34.239551 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc98236-812b-434d-b7a7-522b5388ed3f admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:34.243372 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3bc98236-812b-434d-b7a7-522b5388ed3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:34.270577 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:34.288147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc98236-812b-434d-b7a7-522b5388ed3f admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:34.314194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 897/1768] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:34 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:34.318063 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:34.318899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:34.319153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:34.319428 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a admin admin] PATH_INFO: `/v3/projects/9b7d7de899ed4c83b1bdb4393dc7508c` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:34.319807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68ce97-2763-4b74-8ae9-3c7a7d4bc42e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:34.320730 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b7d7de899ed4c83b1bdb4393dc7508c)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:34.323170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:34.452461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:34.515952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7d7de899ed4c83b1bdb4393dc7508c', 'request_id': 'req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:34.536541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7d7de899ed4c83b1bdb4393dc7508c', 'request_id': 'req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:34.579885 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7d7de899ed4c83b1bdb4393dc7508c', 'request_id': 'req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:34.583864 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68ce97-2763-4b74-8ae9-3c7a7d4bc42e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:34.610807 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a admin admin] The token cache is being invalidate because project 9b7d7de899ed4c83b1bdb4393dc7508c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:34.610807 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:34.611924 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:34.616623 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 872/1769] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:34 2022] DELETE /identity/v3/projects/9b7d7de899ed4c83b1bdb4393dc7508c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:34.621737 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:34.623835 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:34.801518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa1eca-d22b-42c3-a58d-81ff5a641537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:34.802542 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa1eca-d22b-42c3-a58d-81ff5a641537 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:34.803253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa1eca-d22b-42c3-a58d-81ff5a641537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:34.803460 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa1eca-d22b-42c3-a58d-81ff5a641537 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:34.804535 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa1eca-d22b-42c3-a58d-81ff5a641537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:34.808093 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa1eca-d22b-42c3-a58d-81ff5a641537 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:34.906642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 898/1770] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:34 2022] POST /identity/v3/users => generated 294 bytes in 588 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:34.918793 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa1eca-d22b-42c3-a58d-81ff5a641537 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:34.927387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6eaa1eca-d22b-42c3-a58d-81ff5a641537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:34.947148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44d55f-9660-41aa-9f98-62f0d3fdfd2a admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:34.962591 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3f7b7-c285-4e96-b081-7667e89a801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:34.963384 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3f7b7-c285-4e96-b081-7667e89a801e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:34.963786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3f7b7-c285-4e96-b081-7667e89a801e admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:34.964107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3f7b7-c285-4e96-b081-7667e89a801e admin admin] PATH_INFO: `/v3/users/7d49008a8d324516a493a8c7a26a8402` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:34.967907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3f7b7-c285-4e96-b081-7667e89a801e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d49008a8d324516a493a8c7a26a8402)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:34.973440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3f7b7-c285-4e96-b081-7667e89a801e admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:34.996681 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa1eca-d22b-42c3-a58d-81ff5a641537 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:35.048230 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd92c88-9f0f-47e0-976d-a212eda04a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:35.052852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd92c88-9f0f-47e0-976d-a212eda04a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:35.055636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd92c88-9f0f-47e0-976d-a212eda04a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:35.056107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd92c88-9f0f-47e0-976d-a212eda04a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:35.063965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd92c88-9f0f-47e0-976d-a212eda04a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:35.074814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd92c88-9f0f-47e0-976d-a212eda04a26 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:35.080113 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fdd3f7b7-c285-4e96-b081-7667e89a801e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d49008a8d324516a493a8c7a26a8402'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:35.124929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fdd3f7b7-c285-4e96-b081-7667e89a801e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d49008a8d324516a493a8c7a26a8402'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:35.129654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fdd3f7b7-c285-4e96-b081-7667e89a801e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d49008a8d324516a493a8c7a26a8402'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:35.145888 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 899/1771] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:35.147201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd92c88-9f0f-47e0-976d-a212eda04a26 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:35.156309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dbd92c88-9f0f-47e0-976d-a212eda04a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:35.170039 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fdd3f7b7-c285-4e96-b081-7667e89a801e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d49008a8d324516a493a8c7a26a8402'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:35.189484 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd92c88-9f0f-47e0-976d-a212eda04a26 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:35.201305 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433bac3-b2fd-41b2-bff9-304ee7ffa72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:35.202739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433bac3-b2fd-41b2-bff9-304ee7ffa72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:35.203219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433bac3-b2fd-41b2-bff9-304ee7ffa72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:35.203701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433bac3-b2fd-41b2-bff9-304ee7ffa72f admin admin] PATH_INFO: `/v3/projects/82017deff278460b88e6dc3d1c838a03` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:35.206805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433bac3-b2fd-41b2-bff9-304ee7ffa72f admin admin] RBAC: Authorizing `identity:delete_project(project_id=82017deff278460b88e6dc3d1c838a03)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:35.209031 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433bac3-b2fd-41b2-bff9-304ee7ffa72f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:35.259343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-fdd3f7b7-c285-4e96-b081-7667e89a801e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d49008a8d324516a493a8c7a26a8402'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:35.300935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 873/1772] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:34 2022] DELETE /identity/v3/users/7d49008a8d324516a493a8c7a26a8402 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:35.308417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd625f51-ac11-4807-b266-beae7d17f343 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:35.311918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd625f51-ac11-4807-b266-beae7d17f343 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:35.314042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd625f51-ac11-4807-b266-beae7d17f343 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:35.324099 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 874/1773] 10.222.0.15 () {54 vars in 921 bytes} [Tue Aug 9 11:19:35 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:35.329805 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd625f51-ac11-4807-b266-beae7d17f343 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:35.339099 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-cd625f51-ac11-4807-b266-beae7d17f343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:35.401975 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d433bac3-b2fd-41b2-bff9-304ee7ffa72f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82017deff278460b88e6dc3d1c838a03', 'request_id': 'req-d433bac3-b2fd-41b2-bff9-304ee7ffa72f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:35.427689 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d433bac3-b2fd-41b2-bff9-304ee7ffa72f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82017deff278460b88e6dc3d1c838a03', 'request_id': 'req-d433bac3-b2fd-41b2-bff9-304ee7ffa72f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:35.447951 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d433bac3-b2fd-41b2-bff9-304ee7ffa72f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82017deff278460b88e6dc3d1c838a03', 'request_id': 'req-d433bac3-b2fd-41b2-bff9-304ee7ffa72f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:35.496360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d433bac3-b2fd-41b2-bff9-304ee7ffa72f admin admin] The token cache is being invalidate because project 82017deff278460b88e6dc3d1c838a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:35.496713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d433bac3-b2fd-41b2-bff9-304ee7ffa72f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:35.502207 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d433bac3-b2fd-41b2-bff9-304ee7ffa72f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:35.504232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 900/1774] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:35 2022] DELETE /identity/v3/projects/82017deff278460b88e6dc3d1c838a03 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:35.511065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98b855-7740-421f-b849-eef8bf519812 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:35.511370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98b855-7740-421f-b849-eef8bf519812 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:35.511678 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98b855-7740-421f-b849-eef8bf519812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:35.532108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:35.570025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4d98b855-7740-421f-b849-eef8bf519812 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:35.571239 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4d98b855-7740-421f-b849-eef8bf519812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:35.667086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:35.748837 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd625f51-ac11-4807-b266-beae7d17f343 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:35.797280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b64cb-a959-4824-af08-85b055f5c706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:35.798536 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b64cb-a959-4824-af08-85b055f5c706 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:35.800021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b64cb-a959-4824-af08-85b055f5c706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:35.800787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b64cb-a959-4824-af08-85b055f5c706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:35.802548 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b64cb-a959-4824-af08-85b055f5c706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:35.806335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b64cb-a959-4824-af08-85b055f5c706 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:35.825588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 901/1775] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:35.827138 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734fd3e-1cdc-42b2-aaeb-4afb048f5ecf None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:35.827423 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734fd3e-1cdc-42b2-aaeb-4afb048f5ecf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:35.827696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734fd3e-1cdc-42b2-aaeb-4afb048f5ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:35.847361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 875/1776] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:35.856899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b64cb-a959-4824-af08-85b055f5c706 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:35.870770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-849b64cb-a959-4824-af08-85b055f5c706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:35.880739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e734fd3e-1cdc-42b2-aaeb-4afb048f5ecf None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:35.883585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e734fd3e-1cdc-42b2-aaeb-4afb048f5ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:35.913712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 902/1777] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:35.915034 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f48e4-5eda-4e26-ac39-1cd72efed92e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:35.915314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f48e4-5eda-4e26-ac39-1cd72efed92e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:35.915582 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f48e4-5eda-4e26-ac39-1cd72efed92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:35.960086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-737f48e4-5eda-4e26-ac39-1cd72efed92e None None] MFA Rules not processed for user `881030d7605b40879762d1c199362ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:35.964044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-737f48e4-5eda-4e26-ac39-1cd72efed92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:35.978173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b64cb-a959-4824-af08-85b055f5c706 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:36.005671 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e959244-d328-436f-aebd-2c56d8b2bfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:36.006820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e959244-d328-436f-aebd-2c56d8b2bfad admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:36.007307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e959244-d328-436f-aebd-2c56d8b2bfad admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:36.012673 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e959244-d328-436f-aebd-2c56d8b2bfad admin admin] PATH_INFO: `/v3/projects/011793734b954abcaec114280679ea2b/users/8e7565ac056c4c1c9ecfb640eddc9917/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:36.073537 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e959244-d328-436f-aebd-2c56d8b2bfad admin admin] RBAC: Authorizing `identity:create_grant(project_id=011793734b954abcaec114280679ea2b, user_id=8e7565ac056c4c1c9ecfb640eddc9917, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:36.082859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e959244-d328-436f-aebd-2c56d8b2bfad admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:36.146396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 876/1778] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:35 2022] PUT /identity/v3/projects/011793734b954abcaec114280679ea2b/users/8e7565ac056c4c1c9ecfb640eddc9917/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:36.149598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e959244-d328-436f-aebd-2c56d8b2bfad admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:36.410529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 903/1779] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Aug 9 11:19:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:36.412691 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd5e26-1395-4ea1-aea8-606a6bb3e47a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:36.413148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd5e26-1395-4ea1-aea8-606a6bb3e47a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:36.413601 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd5e26-1395-4ea1-aea8-606a6bb3e47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:36.510839 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6bdd5e26-1395-4ea1-aea8-606a6bb3e47a None None] MFA Rules not processed for user `8e7565ac056c4c1c9ecfb640eddc9917`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:36.513757 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6bdd5e26-1395-4ea1-aea8-606a6bb3e47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:36.541038 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e959244-d328-436f-aebd-2c56d8b2bfad admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:36.573223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed203fd3-27a0-410f-a9c0-1d86e1831458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:36.574216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed203fd3-27a0-410f-a9c0-1d86e1831458 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:36.574609 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed203fd3-27a0-410f-a9c0-1d86e1831458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:36.575008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed203fd3-27a0-410f-a9c0-1d86e1831458 admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:36.576598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed203fd3-27a0-410f-a9c0-1d86e1831458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:19:36.578359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed203fd3-27a0-410f-a9c0-1d86e1831458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:36.583862 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed203fd3-27a0-410f-a9c0-1d86e1831458 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:36.622664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 877/1780] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:19:36.629767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed203fd3-27a0-410f-a9c0-1d86e1831458 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:36.709146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed203fd3-27a0-410f-a9c0-1d86e1831458 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:36.726055 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb446d2-78e8-498b-9c00-e00a6a13a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:36.727082 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb446d2-78e8-498b-9c00-e00a6a13a3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:36.727564 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb446d2-78e8-498b-9c00-e00a6a13a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:36.728018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb446d2-78e8-498b-9c00-e00a6a13a3a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:36.729185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb446d2-78e8-498b-9c00-e00a6a13a3a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:36.732556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb446d2-78e8-498b-9c00-e00a6a13a3a8 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:36.788440 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 904/1781] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:36.795382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd5e26-1395-4ea1-aea8-606a6bb3e47a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:36.846936 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd5e26-1395-4ea1-aea8-606a6bb3e47a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:36.878545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9848b4-071f-45d8-99df-db4ba547d390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:36.896122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9848b4-071f-45d8-99df-db4ba547d390 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:36.896584 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9848b4-071f-45d8-99df-db4ba547d390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:36.897033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9848b4-071f-45d8-99df-db4ba547d390 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:36.897962 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 878/1782] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:36 2022] POST /identity/v3/projects => generated 399 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:36.899933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb446d2-78e8-498b-9c00-e00a6a13a3a8 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:36.901610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9848b4-071f-45d8-99df-db4ba547d390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:36.912774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9848b4-071f-45d8-99df-db4ba547d390 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:37.007052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:37.066668 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 905/1783] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:36 2022] POST /identity/v3/projects => generated 387 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:37.072101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9848b4-071f-45d8-99df-db4ba547d390 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:37.288730 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb446d2-78e8-498b-9c00-e00a6a13a3a8 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:37.470454 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9848b4-071f-45d8-99df-db4ba547d390 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:37.478074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:37.510713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781ddbe-51e8-43dc-b0cd-6636bfc5eef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:37.511664 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781ddbe-51e8-43dc-b0cd-6636bfc5eef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:37.512095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781ddbe-51e8-43dc-b0cd-6636bfc5eef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:37.512520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781ddbe-51e8-43dc-b0cd-6636bfc5eef1 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:37.513602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781ddbe-51e8-43dc-b0cd-6636bfc5eef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:37.523216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781ddbe-51e8-43dc-b0cd-6636bfc5eef1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:37.591017 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ae37b-40af-4bf7-9149-278a9beb1372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:37.595274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ae37b-40af-4bf7-9149-278a9beb1372 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:37.595765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ae37b-40af-4bf7-9149-278a9beb1372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:37.596239 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ae37b-40af-4bf7-9149-278a9beb1372 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:37.600195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ae37b-40af-4bf7-9149-278a9beb1372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:37.624065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 906/1784] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:37 2022] POST /identity/v3/users => generated 294 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:19:37.626918 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781ddbe-51e8-43dc-b0cd-6636bfc5eef1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:37.631771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ae37b-40af-4bf7-9149-278a9beb1372 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:37.667923 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781ddbe-51e8-43dc-b0cd-6636bfc5eef1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:37.688801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182e34f-6cf0-4c59-97dc-8bee24f55592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:37.692518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182e34f-6cf0-4c59-97dc-8bee24f55592 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:37.692968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182e34f-6cf0-4c59-97dc-8bee24f55592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:37.693404 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182e34f-6cf0-4c59-97dc-8bee24f55592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:37.695495 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 879/1785] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:36 2022] POST /identity/v3/users => generated 300 bytes in 797 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:37.701223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ae37b-40af-4bf7-9149-278a9beb1372 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:37.702912 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182e34f-6cf0-4c59-97dc-8bee24f55592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:37.705812 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182e34f-6cf0-4c59-97dc-8bee24f55592 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:37.722994 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ae37b-40af-4bf7-9149-278a9beb1372 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:37.739557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b068e-d440-42b2-9ee0-20c48dae3440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:37.740554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b068e-d440-42b2-9ee0-20c48dae3440 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:37.740967 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b068e-d440-42b2-9ee0-20c48dae3440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:37.741704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b068e-d440-42b2-9ee0-20c48dae3440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:37.742629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b068e-d440-42b2-9ee0-20c48dae3440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:37.744608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b068e-d440-42b2-9ee0-20c48dae3440 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:37.757401 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 880/1786] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:19:37.763694 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7ae22-2296-469f-8601-5e9160ab6288 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:37.764104 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7ae22-2296-469f-8601-5e9160ab6288 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:37.764503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7ae22-2296-469f-8601-5e9160ab6288 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:37.766547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 881/1787] 10.222.0.15 () {54 vars in 921 bytes} [Tue Aug 9 11:19:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:37.767433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7ae22-2296-469f-8601-5e9160ab6288 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:37.784052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 907/1788] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:37.789709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7ae22-2296-469f-8601-5e9160ab6288 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:37.791141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182e34f-6cf0-4c59-97dc-8bee24f55592 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:37.803770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bb067-ab60-4491-ad95-32b144996188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:37.804627 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bb067-ab60-4491-ad95-32b144996188 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:37.804960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bb067-ab60-4491-ad95-32b144996188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:37.806169 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240bb067-ab60-4491-ad95-32b144996188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:37.806962 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240bb067-ab60-4491-ad95-32b144996188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:37.809843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240bb067-ab60-4491-ad95-32b144996188 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:37.811688 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182e34f-6cf0-4c59-97dc-8bee24f55592 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:37.836673 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 882/1789] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:37.841964 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152d505-9411-47f6-8cbd-a5bfa0b6e940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:37.843615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bb067-ab60-4491-ad95-32b144996188 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:37.846052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152d505-9411-47f6-8cbd-a5bfa0b6e940 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:37.851120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152d505-9411-47f6-8cbd-a5bfa0b6e940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:37.854814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152d505-9411-47f6-8cbd-a5bfa0b6e940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:37.863586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240bb067-ab60-4491-ad95-32b144996188 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:37.864747 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152d505-9411-47f6-8cbd-a5bfa0b6e940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:37.871952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e10a2-4342-4edb-87dd-106008fab868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:37.873347 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e10a2-4342-4edb-87dd-106008fab868 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:37.873866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e10a2-4342-4edb-87dd-106008fab868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:37.874563 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e10a2-4342-4edb-87dd-106008fab868 admin admin] PATH_INFO: `/v3/projects/539a52ad694741d8ac5baf83ea700a80/users/a07882a628764d96b73e4d0ec603eeb4/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:37.876494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152d505-9411-47f6-8cbd-a5bfa0b6e940 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:37.907059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e10a2-4342-4edb-87dd-106008fab868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=539a52ad694741d8ac5baf83ea700a80, user_id=a07882a628764d96b73e4d0ec603eeb4, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:37.912985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e10a2-4342-4edb-87dd-106008fab868 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:37.937021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 908/1790] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:37.947047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152d505-9411-47f6-8cbd-a5bfa0b6e940 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:37.985731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152d505-9411-47f6-8cbd-a5bfa0b6e940 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:37.989835 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 883/1791] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:37 2022] PUT /identity/v3/projects/539a52ad694741d8ac5baf83ea700a80/users/a07882a628764d96b73e4d0ec603eeb4/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:19:38.001478 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b72b-3907-429e-a808-575c75d2b349 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:38.001902 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b72b-3907-429e-a808-575c75d2b349 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:38.002315 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7b72b-3907-429e-a808-575c75d2b349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:38.088204 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-99b7b72b-3907-429e-a808-575c75d2b349 None None] MFA Rules not processed for user `a07882a628764d96b73e4d0ec603eeb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:38.092305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-99b7b72b-3907-429e-a808-575c75d2b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:38.150294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b7cae-0437-4559-8cae-07c9db6c2ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:38.153764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b7cae-0437-4559-8cae-07c9db6c2ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:38.154287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b7cae-0437-4559-8cae-07c9db6c2ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:38.154738 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b7cae-0437-4559-8cae-07c9db6c2ce5 admin admin] PATH_INFO: `/v3/projects/67f91d287f2946b7bdd1db9a9c6e906b/users/98594c2235c34cef810a6ccb244906c2/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:38.232418 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b7cae-0437-4559-8cae-07c9db6c2ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f91d287f2946b7bdd1db9a9c6e906b, user_id=98594c2235c34cef810a6ccb244906c2, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:38.238331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b7cae-0437-4559-8cae-07c9db6c2ce5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:38.282450 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 909/1792] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:37 2022] PUT /identity/v3/projects/67f91d287f2946b7bdd1db9a9c6e906b/users/98594c2235c34cef810a6ccb244906c2/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:38.287820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a41ff-66ac-4996-81b9-c5e626de27e8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:38.288327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a41ff-66ac-4996-81b9-c5e626de27e8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:38.288825 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a41ff-66ac-4996-81b9-c5e626de27e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:38.289559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 884/1793] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:38.291354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7b72b-3907-429e-a808-575c75d2b349 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:38.293262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-99b7b72b-3907-429e-a808-575c75d2b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:38.362818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1f4a41ff-66ac-4996-81b9-c5e626de27e8 None None] MFA Rules not processed for user `881030d7605b40879762d1c199362ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:38.364970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1f4a41ff-66ac-4996-81b9-c5e626de27e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:38.504326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7b72b-3907-429e-a808-575c75d2b349 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:38.530004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:38.533846 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:38.651498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 910/1794] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Aug 9 11:19:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:38.652202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a41ff-66ac-4996-81b9-c5e626de27e8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:38.790792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a41ff-66ac-4996-81b9-c5e626de27e8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:38.799167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b252f31-ad45-4343-8039-b00260c30dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:38.799818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b252f31-ad45-4343-8039-b00260c30dd3 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:38.800087 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b252f31-ad45-4343-8039-b00260c30dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:38.800728 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b252f31-ad45-4343-8039-b00260c30dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:38.802634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53f0a5-1732-4520-9815-ed2e8ff62572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:38.803262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53f0a5-1732-4520-9815-ed2e8ff62572 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:38.803530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53f0a5-1732-4520-9815-ed2e8ff62572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:38.804325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53f0a5-1732-4520-9815-ed2e8ff62572 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:38.808025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53f0a5-1732-4520-9815-ed2e8ff62572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:38.813143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53f0a5-1732-4520-9815-ed2e8ff62572 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:38.822149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b252f31-ad45-4343-8039-b00260c30dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:38.823843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b252f31-ad45-4343-8039-b00260c30dd3 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:38.858874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 885/1795] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:38.860624 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2f6ef-8a7e-4d00-85d9-82fe5e4fc04b None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:38.861511 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2f6ef-8a7e-4d00-85d9-82fe5e4fc04b None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:38.861818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2f6ef-8a7e-4d00-85d9-82fe5e4fc04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:38.881846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 911/1796] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:38 2022] POST /identity/v3/projects => generated 399 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:38.888346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53f0a5-1732-4520-9815-ed2e8ff62572 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:38.946720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-45b2f6ef-8a7e-4d00-85d9-82fe5e4fc04b None None] MFA Rules not processed for user `98594c2235c34cef810a6ccb244906c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:38.950606 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-45b2f6ef-8a7e-4d00-85d9-82fe5e4fc04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:39.100825 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53f0a5-1732-4520-9815-ed2e8ff62572 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:39.115677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fb8bc-9ba1-47f6-a5d4-f7c7afa75cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:39.119335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fb8bc-9ba1-47f6-a5d4-f7c7afa75cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:39.120313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fb8bc-9ba1-47f6-a5d4-f7c7afa75cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:39.120442 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fb8bc-9ba1-47f6-a5d4-f7c7afa75cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:39.121063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fb8bc-9ba1-47f6-a5d4-f7c7afa75cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:39.134377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fb8bc-9ba1-47f6-a5d4-f7c7afa75cf7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:39.191595 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 886/1797] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:39.194859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2f6ef-8a7e-4d00-85d9-82fe5e4fc04b None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:39.202021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 912/1798] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:38 2022] POST /identity/v3/users => generated 306 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:39.206515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fb8bc-9ba1-47f6-a5d4-f7c7afa75cf7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:39.228089 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fb8bc-9ba1-47f6-a5d4-f7c7afa75cf7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:39.238882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8636f-587a-4f26-b794-3476b11ce66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:39.239780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8636f-587a-4f26-b794-3476b11ce66d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:39.240060 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8636f-587a-4f26-b794-3476b11ce66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:39.240534 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8636f-587a-4f26-b794-3476b11ce66d admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:39.241754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8636f-587a-4f26-b794-3476b11ce66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:39.248327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8636f-587a-4f26-b794-3476b11ce66d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:39.260190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2f6ef-8a7e-4d00-85d9-82fe5e4fc04b None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:39.284806 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 913/1799] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:39.289334 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8636f-587a-4f26-b794-3476b11ce66d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:39.290707 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02e229-6ea1-41c6-a7b4-896ca84b466b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:39.291449 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02e229-6ea1-41c6-a7b4-896ca84b466b admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:39.295684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02e229-6ea1-41c6-a7b4-896ca84b466b admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:39.296101 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02e229-6ea1-41c6-a7b4-896ca84b466b admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:39.298933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02e229-6ea1-41c6-a7b4-896ca84b466b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:39.309436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02e229-6ea1-41c6-a7b4-896ca84b466b admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:39.317487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8636f-587a-4f26-b794-3476b11ce66d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:39.327875 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59145ec-f78d-4015-a15b-48461868d69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:39.329957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59145ec-f78d-4015-a15b-48461868d69f admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:39.330196 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59145ec-f78d-4015-a15b-48461868d69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:39.331211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59145ec-f78d-4015-a15b-48461868d69f admin admin] PATH_INFO: `/v3/projects/9534bc2e858c499db0c0fbdaee302aab/users/fe441202e90f49b6a13dd8581fec2b26/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:39.374222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59145ec-f78d-4015-a15b-48461868d69f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9534bc2e858c499db0c0fbdaee302aab, user_id=fe441202e90f49b6a13dd8581fec2b26, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:39.381198 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59145ec-f78d-4015-a15b-48461868d69f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:39.411600 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 887/1800] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:39 2022] POST /identity/v3/projects => generated 387 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:39.414652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02e229-6ea1-41c6-a7b4-896ca84b466b admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:39.423778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 914/1801] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:39 2022] PUT /identity/v3/projects/9534bc2e858c499db0c0fbdaee302aab/users/fe441202e90f49b6a13dd8581fec2b26/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:39.438514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59145ec-f78d-4015-a15b-48461868d69f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:39.500432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:39.597201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02e229-6ea1-41c6-a7b4-896ca84b466b admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:39.598452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59145ec-f78d-4015-a15b-48461868d69f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:39.612503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af502a-a1e4-438b-9083-83bf22f8281e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:39.613152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af502a-a1e4-438b-9083-83bf22f8281e admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:39.613414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa68e96-e6f5-4052-8573-d5d6e3d3c5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:39.613541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af502a-a1e4-438b-9083-83bf22f8281e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:39.613815 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af502a-a1e4-438b-9083-83bf22f8281e admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:39.614345 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af502a-a1e4-438b-9083-83bf22f8281e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:39.616309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af502a-a1e4-438b-9083-83bf22f8281e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:39.626692 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa68e96-e6f5-4052-8573-d5d6e3d3c5bd admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:39.627264 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa68e96-e6f5-4052-8573-d5d6e3d3c5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:39.627445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa68e96-e6f5-4052-8573-d5d6e3d3c5bd admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:39.628139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa68e96-e6f5-4052-8573-d5d6e3d3c5bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:39.632111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa68e96-e6f5-4052-8573-d5d6e3d3c5bd admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:39.651602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 915/1802] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:39.652600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af502a-a1e4-438b-9083-83bf22f8281e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:39.664534 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:39.681436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af502a-a1e4-438b-9083-83bf22f8281e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:39.682941 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 888/1803] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:39 2022] POST /identity/v3/users => generated 300 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:39.689996 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa68e96-e6f5-4052-8573-d5d6e3d3c5bd admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:39.702671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f575b7-e289-4fba-a0aa-8713ad763c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:39.703394 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f575b7-e289-4fba-a0aa-8713ad763c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:39.703668 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f575b7-e289-4fba-a0aa-8713ad763c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:39.703990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f575b7-e289-4fba-a0aa-8713ad763c47 admin admin] PATH_INFO: `/v3/projects/9534bc2e858c499db0c0fbdaee302aab/users/fe441202e90f49b6a13dd8581fec2b26/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:39.706938 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f575b7-e289-4fba-a0aa-8713ad763c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9534bc2e858c499db0c0fbdaee302aab, user_id=fe441202e90f49b6a13dd8581fec2b26, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:39.716648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f575b7-e289-4fba-a0aa-8713ad763c47 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:39.724886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa68e96-e6f5-4052-8573-d5d6e3d3c5bd admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:39.755631 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d31f87-6256-480a-87e3-84a2c82a5664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:39.755631 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d31f87-6256-480a-87e3-84a2c82a5664 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:39.755631 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d31f87-6256-480a-87e3-84a2c82a5664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:39.755631 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d31f87-6256-480a-87e3-84a2c82a5664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:39.756083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d31f87-6256-480a-87e3-84a2c82a5664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:39.756170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 916/1804] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:39 2022] PUT /identity/v3/projects/9534bc2e858c499db0c0fbdaee302aab/users/fe441202e90f49b6a13dd8581fec2b26/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:39.756170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f575b7-e289-4fba-a0aa-8713ad763c47 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:39.756335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d31f87-6256-480a-87e3-84a2c82a5664 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:39.759846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b6f575b7-e289-4fba-a0aa-8713ad763c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:39.792043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 889/1805] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:39.793526 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ceed4-3c36-42f7-9eb9-c01afe4ca1ce None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:39.793526 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ceed4-3c36-42f7-9eb9-c01afe4ca1ce None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:39.794004 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ceed4-3c36-42f7-9eb9-c01afe4ca1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:39.928879 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-c20ceed4-3c36-42f7-9eb9-c01afe4ca1ce None None] MFA Rules not processed for user `fe441202e90f49b6a13dd8581fec2b26`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:39.931571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c20ceed4-3c36-42f7-9eb9-c01afe4ca1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:39.951370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f575b7-e289-4fba-a0aa-8713ad763c47 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:39.959086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94171a7-e8a4-4f19-a923-bcdff7bebcc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:39.960051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94171a7-e8a4-4f19-a923-bcdff7bebcc4 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:39.960526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94171a7-e8a4-4f19-a923-bcdff7bebcc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:39.961907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94171a7-e8a4-4f19-a923-bcdff7bebcc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:39.983195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94171a7-e8a4-4f19-a923-bcdff7bebcc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:39.987537 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94171a7-e8a4-4f19-a923-bcdff7bebcc4 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:40.021713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 917/1806] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:40.024137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94171a7-e8a4-4f19-a923-bcdff7bebcc4 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:40.144985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 890/1807] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:39 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:40.161790 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ceed4-3c36-42f7-9eb9-c01afe4ca1ce None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:40.165583 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c20ceed4-3c36-42f7-9eb9-c01afe4ca1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:40.240372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94171a7-e8a4-4f19-a923-bcdff7bebcc4 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:40.256015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1738c3e-cc45-4a15-bac1-cc4f6b326ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:40.258216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1738c3e-cc45-4a15-bac1-cc4f6b326ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:40.258216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1738c3e-cc45-4a15-bac1-cc4f6b326ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:40.258531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1738c3e-cc45-4a15-bac1-cc4f6b326ef6 admin admin] PATH_INFO: `/v3/projects/9dee0758a5d14ad592c47ce21d617e32/users/15ba3df494d749c0b32e713f82c13e65/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:40.317091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ceed4-3c36-42f7-9eb9-c01afe4ca1ce None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:40.348805 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2080ba-286b-43b7-8f14-8ce73d33bbe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:40.349597 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2080ba-286b-43b7-8f14-8ce73d33bbe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:40.349896 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2080ba-286b-43b7-8f14-8ce73d33bbe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:40.350227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2080ba-286b-43b7-8f14-8ce73d33bbe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:40.377505 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1738c3e-cc45-4a15-bac1-cc4f6b326ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dee0758a5d14ad592c47ce21d617e32, user_id=15ba3df494d749c0b32e713f82c13e65, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:40.381706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1738c3e-cc45-4a15-bac1-cc4f6b326ef6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:40.396820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2080ba-286b-43b7-8f14-8ce73d33bbe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:40.398788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2080ba-286b-43b7-8f14-8ce73d33bbe2 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:40.413783 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 918/1808] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:40 2022] PUT /identity/v3/projects/9dee0758a5d14ad592c47ce21d617e32/users/15ba3df494d749c0b32e713f82c13e65/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:40.417108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1738c3e-cc45-4a15-bac1-cc4f6b326ef6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:40.426365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 891/1809] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:40 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:19:40.430808 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:40.535745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2080ba-286b-43b7-8f14-8ce73d33bbe2 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:40.537360 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2a2080ba-286b-43b7-8f14-8ce73d33bbe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:40.566035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2080ba-286b-43b7-8f14-8ce73d33bbe2 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:40.576089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b3648-04a3-460a-8002-0cfcc5288dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:40.577108 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b3648-04a3-460a-8002-0cfcc5288dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:40.577524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b3648-04a3-460a-8002-0cfcc5288dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:40.581129 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b3648-04a3-460a-8002-0cfcc5288dfc admin admin] PATH_INFO: `/v3/projects/758f61e6df4444f283b4600a32d892d3` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:40.582948 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b3648-04a3-460a-8002-0cfcc5288dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=758f61e6df4444f283b4600a32d892d3)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:40.585231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b3648-04a3-460a-8002-0cfcc5288dfc admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:40.598276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1738c3e-cc45-4a15-bac1-cc4f6b326ef6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:40.615242 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de725e-a229-4623-af05-dbc9b1227377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:40.615912 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de725e-a229-4623-af05-dbc9b1227377 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:40.616499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de725e-a229-4623-af05-dbc9b1227377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:40.616765 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de725e-a229-4623-af05-dbc9b1227377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:40.617581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de725e-a229-4623-af05-dbc9b1227377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:40.619122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de725e-a229-4623-af05-dbc9b1227377 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:40.649446 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 919/1810] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:40.649776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de725e-a229-4623-af05-dbc9b1227377 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:40.694275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-411b3648-04a3-460a-8002-0cfcc5288dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758f61e6df4444f283b4600a32d892d3', 'request_id': 'req-411b3648-04a3-460a-8002-0cfcc5288dfc'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:40.710264 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-411b3648-04a3-460a-8002-0cfcc5288dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758f61e6df4444f283b4600a32d892d3', 'request_id': 'req-411b3648-04a3-460a-8002-0cfcc5288dfc'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:40.724637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-411b3648-04a3-460a-8002-0cfcc5288dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758f61e6df4444f283b4600a32d892d3', 'request_id': 'req-411b3648-04a3-460a-8002-0cfcc5288dfc'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:40.739753 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:40.755936 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de725e-a229-4623-af05-dbc9b1227377 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:40.777437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-411b3648-04a3-460a-8002-0cfcc5288dfc admin admin] The token cache is being invalidate because project 758f61e6df4444f283b4600a32d892d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:40.778003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-411b3648-04a3-460a-8002-0cfcc5288dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:40.780754 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-411b3648-04a3-460a-8002-0cfcc5288dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:40.785115 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 892/1811] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:40 2022] DELETE /identity/v3/projects/758f61e6df4444f283b4600a32d892d3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:40.786360 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b3648-04a3-460a-8002-0cfcc5288dfc admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:40.794564 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-411b3648-04a3-460a-8002-0cfcc5288dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:40.854411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71aaa65-e03e-46ee-aea5-2cda87471f79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:40.856120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71aaa65-e03e-46ee-aea5-2cda87471f79 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:40.856518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71aaa65-e03e-46ee-aea5-2cda87471f79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:40.856886 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71aaa65-e03e-46ee-aea5-2cda87471f79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:40.859595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c71aaa65-e03e-46ee-aea5-2cda87471f79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:40.967662 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71aaa65-e03e-46ee-aea5-2cda87471f79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:40.969551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71aaa65-e03e-46ee-aea5-2cda87471f79 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:40.982379 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 920/1812] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:40 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:40.984898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd993c1b-9540-4c3e-b830-57ab619715c9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:40.984898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd993c1b-9540-4c3e-b830-57ab619715c9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:40.984898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd993c1b-9540-4c3e-b830-57ab619715c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:41.023932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-dd993c1b-9540-4c3e-b830-57ab619715c9 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:41.026280 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dd993c1b-9540-4c3e-b830-57ab619715c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:41.031916 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b3648-04a3-460a-8002-0cfcc5288dfc admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:41.051976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838563e0-33dd-4e2b-a7a3-1178de526774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:41.053510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838563e0-33dd-4e2b-a7a3-1178de526774 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:41.053818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838563e0-33dd-4e2b-a7a3-1178de526774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:41.054115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 921/1813] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:41.065573 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3345afb-66a7-486e-a631-c712c1d7f047 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:41.067406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3345afb-66a7-486e-a631-c712c1d7f047 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:41.070538 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3345afb-66a7-486e-a631-c712c1d7f047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:41.078468 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838563e0-33dd-4e2b-a7a3-1178de526774 admin admin] PATH_INFO: `/v3/projects/9dee0758a5d14ad592c47ce21d617e32/users/15ba3df494d749c0b32e713f82c13e65/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:41.085369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838563e0-33dd-4e2b-a7a3-1178de526774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dee0758a5d14ad592c47ce21d617e32, user_id=15ba3df494d749c0b32e713f82c13e65, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:41.088463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838563e0-33dd-4e2b-a7a3-1178de526774 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:41.102538 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c3345afb-66a7-486e-a631-c712c1d7f047 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:41.104009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c3345afb-66a7-486e-a631-c712c1d7f047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:41.121456 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 893/1814] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:40 2022] PUT /identity/v3/projects/9dee0758a5d14ad592c47ce21d617e32/users/15ba3df494d749c0b32e713f82c13e65/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:41.123920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439f8a3-ecd8-4dd4-b846-3fa71fa26922 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:41.124348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439f8a3-ecd8-4dd4-b846-3fa71fa26922 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:41.124776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439f8a3-ecd8-4dd4-b846-3fa71fa26922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:41.128279 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:41.184523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-b439f8a3-ecd8-4dd4-b846-3fa71fa26922 None None] MFA Rules not processed for user `15ba3df494d749c0b32e713f82c13e65`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:41.185945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b439f8a3-ecd8-4dd4-b846-3fa71fa26922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:41.256503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 922/1815] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:41.260012 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3345afb-66a7-486e-a631-c712c1d7f047 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:41.284225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3345afb-66a7-486e-a631-c712c1d7f047 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:41.314184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692daa1-ee0e-425b-96f0-62758c924ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:41.315537 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692daa1-ee0e-425b-96f0-62758c924ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:41.315838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692daa1-ee0e-425b-96f0-62758c924ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:41.316117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692daa1-ee0e-425b-96f0-62758c924ef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:41.322221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692daa1-ee0e-425b-96f0-62758c924ef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:19:41.324035 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692daa1-ee0e-425b-96f0-62758c924ef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:41.327504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692daa1-ee0e-425b-96f0-62758c924ef1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:41.389233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 923/1816] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:19:41.393781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692daa1-ee0e-425b-96f0-62758c924ef1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:41.398263 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 894/1817] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:41.434713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692daa1-ee0e-425b-96f0-62758c924ef1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:41.452714 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766ed60-3ac3-408b-965e-69688f9babcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:41.453354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766ed60-3ac3-408b-965e-69688f9babcf admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:41.453639 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766ed60-3ac3-408b-965e-69688f9babcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:41.454092 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766ed60-3ac3-408b-965e-69688f9babcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:41.454694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766ed60-3ac3-408b-965e-69688f9babcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:41.456662 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766ed60-3ac3-408b-965e-69688f9babcf admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:41.520646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439f8a3-ecd8-4dd4-b846-3fa71fa26922 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:41.523028 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 924/1818] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:41 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:41.554415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766ed60-3ac3-408b-965e-69688f9babcf admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:41.559014 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439f8a3-ecd8-4dd4-b846-3fa71fa26922 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:41.559716 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8766ed60-3ac3-408b-965e-69688f9babcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:41.689115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766ed60-3ac3-408b-965e-69688f9babcf admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:41.693185 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10c59e-0b49-40af-83bb-449117161677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:41.694372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10c59e-0b49-40af-83bb-449117161677 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:41.694372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10c59e-0b49-40af-83bb-449117161677 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:41.694612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10c59e-0b49-40af-83bb-449117161677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:41.761574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6137c5-c762-4fec-8ba7-fe6261dfe605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:41.762724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6137c5-c762-4fec-8ba7-fe6261dfe605 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:41.764283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6137c5-c762-4fec-8ba7-fe6261dfe605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:41.764283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6137c5-c762-4fec-8ba7-fe6261dfe605 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:41.765118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6137c5-c762-4fec-8ba7-fe6261dfe605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:41.779217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6137c5-c762-4fec-8ba7-fe6261dfe605 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:41.810682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10c59e-0b49-40af-83bb-449117161677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:41.812248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10c59e-0b49-40af-83bb-449117161677 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:41.821218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 895/1819] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:41 2022] POST /identity/v3/users => generated 292 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:41.826028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6137c5-c762-4fec-8ba7-fe6261dfe605 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:41.827898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 925/1820] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:41.831607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:41.841490 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6137c5-c762-4fec-8ba7-fe6261dfe605 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:41.848446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f5546-6b10-46e4-a1b9-9817a5b7cda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:41.849100 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f5546-6b10-46e4-a1b9-9817a5b7cda4 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:41.849372 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f5546-6b10-46e4-a1b9-9817a5b7cda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:41.849693 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f5546-6b10-46e4-a1b9-9817a5b7cda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:41.850331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f5546-6b10-46e4-a1b9-9817a5b7cda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:41.852017 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f5546-6b10-46e4-a1b9-9817a5b7cda4 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:41.864187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 896/1821] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:41.868732 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10c59e-0b49-40af-83bb-449117161677 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:41.887170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10c59e-0b49-40af-83bb-449117161677 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:41.892201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c27e5-3a01-48de-8706-e9e2e6a85996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:41.892817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c27e5-3a01-48de-8706-e9e2e6a85996 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:41.893090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c27e5-3a01-48de-8706-e9e2e6a85996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:41.893356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c27e5-3a01-48de-8706-e9e2e6a85996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:41.894029 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c27e5-3a01-48de-8706-e9e2e6a85996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:41.895985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c27e5-3a01-48de-8706-e9e2e6a85996 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:41.910077 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 926/1822] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:41.914502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f5546-6b10-46e4-a1b9-9817a5b7cda4 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:41.929954 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f5546-6b10-46e4-a1b9-9817a5b7cda4 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:41.934685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1ae3f-4e68-439e-a28c-6e19aa4232d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:41.935380 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1ae3f-4e68-439e-a28c-6e19aa4232d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:41.937791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1ae3f-4e68-439e-a28c-6e19aa4232d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:41.937791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1ae3f-4e68-439e-a28c-6e19aa4232d2 admin admin] PATH_INFO: `/v3/projects/7254ac992af64d9b93d5f0b8080f1e7f/users/90943ad71eb14c0c870191de9ef3a891/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:41.955372 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1ae3f-4e68-439e-a28c-6e19aa4232d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7254ac992af64d9b93d5f0b8080f1e7f, user_id=90943ad71eb14c0c870191de9ef3a891, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:41.958211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1ae3f-4e68-439e-a28c-6e19aa4232d2 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:41.975182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 897/1823] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:41 2022] PUT /identity/v3/projects/7254ac992af64d9b93d5f0b8080f1e7f/users/90943ad71eb14c0c870191de9ef3a891/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:41.987484 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ac68-e730-49bb-9a33-508283f2a46d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:41.987858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ac68-e730-49bb-9a33-508283f2a46d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:41.988250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9ac68-e730-49bb-9a33-508283f2a46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:42.016320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:42.019834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-34f9ac68-e730-49bb-9a33-508283f2a46d None None] MFA Rules not processed for user `90943ad71eb14c0c870191de9ef3a891`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:42.023092 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-34f9ac68-e730-49bb-9a33-508283f2a46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:42.116409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 927/1824] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:42.121038 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1ae3f-4e68-439e-a28c-6e19aa4232d2 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:42.217665 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1ae3f-4e68-439e-a28c-6e19aa4232d2 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:42.222335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d626e88-b24d-4642-a6ef-8173b2599391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:42.223219 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d626e88-b24d-4642-a6ef-8173b2599391 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:42.224338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d626e88-b24d-4642-a6ef-8173b2599391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:42.224338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d626e88-b24d-4642-a6ef-8173b2599391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:42.224788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d626e88-b24d-4642-a6ef-8173b2599391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:42.226861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d626e88-b24d-4642-a6ef-8173b2599391 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:42.270690 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 898/1825] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:42 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:42.270804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ac68-e730-49bb-9a33-508283f2a46d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:42.275626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9ac68-e730-49bb-9a33-508283f2a46d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:42.342655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2314f-40a5-491f-895f-1153bebee4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:42.343289 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2314f-40a5-491f-895f-1153bebee4dd admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:42.343563 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2314f-40a5-491f-895f-1153bebee4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:42.343833 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2314f-40a5-491f-895f-1153bebee4dd admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:42.344928 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2314f-40a5-491f-895f-1153bebee4dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:42.347444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2314f-40a5-491f-895f-1153bebee4dd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:42.371625 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 928/1826] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:42 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:42.375803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d626e88-b24d-4642-a6ef-8173b2599391 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:42.386136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d626e88-b24d-4642-a6ef-8173b2599391 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:42.400036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d183448-e20f-4ee5-9945-208c337bfc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:42.400036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d183448-e20f-4ee5-9945-208c337bfc5a admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:42.400036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d183448-e20f-4ee5-9945-208c337bfc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:42.400036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d183448-e20f-4ee5-9945-208c337bfc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:42.400803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d183448-e20f-4ee5-9945-208c337bfc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:42.400803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d183448-e20f-4ee5-9945-208c337bfc5a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:42.407758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 899/1827] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:42.412473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2314f-40a5-491f-895f-1153bebee4dd admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:42.423011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2314f-40a5-491f-895f-1153bebee4dd admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:42.427889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca870657-d3ef-4166-ae43-5a3e739a40bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:42.428572 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca870657-d3ef-4166-ae43-5a3e739a40bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:42.428842 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca870657-d3ef-4166-ae43-5a3e739a40bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:42.429110 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca870657-d3ef-4166-ae43-5a3e739a40bc admin admin] PATH_INFO: `/v3/projects/cb045e92e2e843c38496bc210b6930f0/users/5b885dff2f134d84b260f7bf7528eb92/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:42.448815 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca870657-d3ef-4166-ae43-5a3e739a40bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb045e92e2e843c38496bc210b6930f0, user_id=5b885dff2f134d84b260f7bf7528eb92, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:42.451432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca870657-d3ef-4166-ae43-5a3e739a40bc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:42.467930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 929/1828] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:42 2022] PUT /identity/v3/projects/cb045e92e2e843c38496bc210b6930f0/users/5b885dff2f134d84b260f7bf7528eb92/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:19:42.471781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d183448-e20f-4ee5-9945-208c337bfc5a admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:42.481997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d183448-e20f-4ee5-9945-208c337bfc5a admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:42.540107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca870657-d3ef-4166-ae43-5a3e739a40bc admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:42.548826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ca870657-d3ef-4166-ae43-5a3e739a40bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:42.563160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a80fd0-8882-4f46-a46e-1ceac3e899b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:42.563812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a80fd0-8882-4f46-a46e-1ceac3e899b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:42.564083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a80fd0-8882-4f46-a46e-1ceac3e899b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:42.564348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a80fd0-8882-4f46-a46e-1ceac3e899b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:42.565003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a80fd0-8882-4f46-a46e-1ceac3e899b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:42.566656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a80fd0-8882-4f46-a46e-1ceac3e899b8 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:42.578683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 900/1829] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:19:42.584837 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a80fd0-8882-4f46-a46e-1ceac3e899b8 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:42.599913 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a80fd0-8882-4f46-a46e-1ceac3e899b8 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:42.614150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c993010-f140-4f48-b00f-321e6d6df52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:42.614827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c993010-f140-4f48-b00f-321e6d6df52c admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:42.615100 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c993010-f140-4f48-b00f-321e6d6df52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:42.615364 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c993010-f140-4f48-b00f-321e6d6df52c admin admin] PATH_INFO: `/v3/projects/cb045e92e2e843c38496bc210b6930f0/users/5b885dff2f134d84b260f7bf7528eb92/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:42.618855 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c993010-f140-4f48-b00f-321e6d6df52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb045e92e2e843c38496bc210b6930f0, user_id=5b885dff2f134d84b260f7bf7528eb92, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:42.624473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c993010-f140-4f48-b00f-321e6d6df52c admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:42.645332 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 901/1830] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:42 2022] PUT /identity/v3/projects/cb045e92e2e843c38496bc210b6930f0/users/5b885dff2f134d84b260f7bf7528eb92/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:42.645568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca870657-d3ef-4166-ae43-5a3e739a40bc admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:42.647558 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e079b53-79e1-45ac-8a92-3347cfd3dd15 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:42.648019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e079b53-79e1-45ac-8a92-3347cfd3dd15 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:42.648461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e079b53-79e1-45ac-8a92-3347cfd3dd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:42.668757 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:42.684901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-8e079b53-79e1-45ac-8a92-3347cfd3dd15 None None] MFA Rules not processed for user `5b885dff2f134d84b260f7bf7528eb92`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:42.686150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8e079b53-79e1-45ac-8a92-3347cfd3dd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:42.707081 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225a844-4092-4f22-a4cc-962f12a52714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:42.707704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225a844-4092-4f22-a4cc-962f12a52714 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:42.708021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225a844-4092-4f22-a4cc-962f12a52714 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:42.708243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225a844-4092-4f22-a4cc-962f12a52714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:42.710439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d225a844-4092-4f22-a4cc-962f12a52714 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:42.715620 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:42.788166 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225a844-4092-4f22-a4cc-962f12a52714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:42.791769 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225a844-4092-4f22-a4cc-962f12a52714 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:42.805141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 930/1831] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:19:42.810990 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 902/1832] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:42.974851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225a844-4092-4f22-a4cc-962f12a52714 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:42.984823 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225a844-4092-4f22-a4cc-962f12a52714 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:42.991613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2712da-b79b-4c96-a344-1676c30b10a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:42.992387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2712da-b79b-4c96-a344-1676c30b10a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:42.992659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2712da-b79b-4c96-a344-1676c30b10a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:42.992919 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2712da-b79b-4c96-a344-1676c30b10a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:43.013192 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2712da-b79b-4c96-a344-1676c30b10a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:43.014771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2712da-b79b-4c96-a344-1676c30b10a9 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:43.025486 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 931/1833] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:43.759346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e079b53-79e1-45ac-8a92-3347cfd3dd15 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:43.773378 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e079b53-79e1-45ac-8a92-3347cfd3dd15 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:43.783230 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f552b92-60a9-4a4e-97c4-23e2399915e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:43.783955 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f552b92-60a9-4a4e-97c4-23e2399915e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:43.784298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f552b92-60a9-4a4e-97c4-23e2399915e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:43.784619 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f552b92-60a9-4a4e-97c4-23e2399915e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:43.898785 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f552b92-60a9-4a4e-97c4-23e2399915e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:43.900477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f552b92-60a9-4a4e-97c4-23e2399915e5 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:43.914826 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 903/1834] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:45.257359 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2712da-b79b-4c96-a344-1676c30b10a9 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:45.259446 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ad2712da-b79b-4c96-a344-1676c30b10a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:45.333487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2712da-b79b-4c96-a344-1676c30b10a9 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:45.338168 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e8b2d-c1ac-4c8e-950c-345ae3c1e539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:45.338765 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e8b2d-c1ac-4c8e-950c-345ae3c1e539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:45.339003 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e8b2d-c1ac-4c8e-950c-345ae3c1e539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:45.339451 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e8b2d-c1ac-4c8e-950c-345ae3c1e539 admin admin] PATH_INFO: `/v3/users/a07882a628764d96b73e4d0ec603eeb4` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:45.340603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e8b2d-c1ac-4c8e-950c-345ae3c1e539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07882a628764d96b73e4d0ec603eeb4)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:45.342500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e8b2d-c1ac-4c8e-950c-345ae3c1e539 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:45.403344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-384e8b2d-c1ac-4c8e-950c-345ae3c1e539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07882a628764d96b73e4d0ec603eeb4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:45.412500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-384e8b2d-c1ac-4c8e-950c-345ae3c1e539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07882a628764d96b73e4d0ec603eeb4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:45.421362 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:45.426358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-384e8b2d-c1ac-4c8e-950c-345ae3c1e539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07882a628764d96b73e4d0ec603eeb4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:45.427144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-384e8b2d-c1ac-4c8e-950c-345ae3c1e539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07882a628764d96b73e4d0ec603eeb4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:45.436005 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-384e8b2d-c1ac-4c8e-950c-345ae3c1e539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07882a628764d96b73e4d0ec603eeb4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:45.443311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 932/1835] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:45 2022] DELETE /identity/v3/users/a07882a628764d96b73e4d0ec603eeb4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:45.447939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3160e-d446-4a5c-9d9d-67489354796e None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:45.448469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3160e-d446-4a5c-9d9d-67489354796e None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:45.448469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3160e-d446-4a5c-9d9d-67489354796e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:45.470552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-e3b3160e-d446-4a5c-9d9d-67489354796e None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:45.472437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e3b3160e-d446-4a5c-9d9d-67489354796e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:45.603713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 904/1836] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:45.610967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e8b2d-c1ac-4c8e-950c-345ae3c1e539 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:45.626111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-384e8b2d-c1ac-4c8e-950c-345ae3c1e539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:45.717755 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e8b2d-c1ac-4c8e-950c-345ae3c1e539 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:45.721702 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6022ed-76e1-45f2-bd65-ab4bda1584a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:45.722203 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6022ed-76e1-45f2-bd65-ab4bda1584a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:45.722481 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6022ed-76e1-45f2-bd65-ab4bda1584a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:45.723141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6022ed-76e1-45f2-bd65-ab4bda1584a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:45.734013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6022ed-76e1-45f2-bd65-ab4bda1584a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:45.735605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6022ed-76e1-45f2-bd65-ab4bda1584a8 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:45.748263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 933/1837] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:46.108153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3160e-d446-4a5c-9d9d-67489354796e None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:46.110285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e3b3160e-d446-4a5c-9d9d-67489354796e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:46.137409 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3160e-d446-4a5c-9d9d-67489354796e None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:46.143059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b9b01-d853-43dc-b605-4f6b9ccd11f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:46.144298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b9b01-d853-43dc-b605-4f6b9ccd11f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:46.144597 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b9b01-d853-43dc-b605-4f6b9ccd11f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:46.144870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b9b01-d853-43dc-b605-4f6b9ccd11f6 admin admin] PATH_INFO: `/v3/projects/539a52ad694741d8ac5baf83ea700a80` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:46.149220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b9b01-d853-43dc-b605-4f6b9ccd11f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=539a52ad694741d8ac5baf83ea700a80)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:46.151691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b9b01-d853-43dc-b605-4f6b9ccd11f6 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:46.250411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:46.256857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-028b9b01-d853-43dc-b605-4f6b9ccd11f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '539a52ad694741d8ac5baf83ea700a80', 'request_id': 'req-028b9b01-d853-43dc-b605-4f6b9ccd11f6'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:46.271374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-028b9b01-d853-43dc-b605-4f6b9ccd11f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '539a52ad694741d8ac5baf83ea700a80', 'request_id': 'req-028b9b01-d853-43dc-b605-4f6b9ccd11f6'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:46.283050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-028b9b01-d853-43dc-b605-4f6b9ccd11f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '539a52ad694741d8ac5baf83ea700a80', 'request_id': 'req-028b9b01-d853-43dc-b605-4f6b9ccd11f6'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:46.295289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-028b9b01-d853-43dc-b605-4f6b9ccd11f6 admin admin] The token cache is being invalidate because project 539a52ad694741d8ac5baf83ea700a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:46.295577 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-028b9b01-d853-43dc-b605-4f6b9ccd11f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:46.296282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-028b9b01-d853-43dc-b605-4f6b9ccd11f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:46.297874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 905/1838] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:46 2022] DELETE /identity/v3/projects/539a52ad694741d8ac5baf83ea700a80 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:46.302199 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6022ed-76e1-45f2-bd65-ab4bda1584a8 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:46.312112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6022ed-76e1-45f2-bd65-ab4bda1584a8 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:46.374801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1db56d-5464-4077-9204-7ee62a445da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:46.375437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1db56d-5464-4077-9204-7ee62a445da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:46.375972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1db56d-5464-4077-9204-7ee62a445da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:46.376245 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1db56d-5464-4077-9204-7ee62a445da6 admin admin] PATH_INFO: `/v3/users/fe441202e90f49b6a13dd8581fec2b26` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:46.377572 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1db56d-5464-4077-9204-7ee62a445da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe441202e90f49b6a13dd8581fec2b26)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:46.379724 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1db56d-5464-4077-9204-7ee62a445da6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:46.432104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2b1db56d-5464-4077-9204-7ee62a445da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe441202e90f49b6a13dd8581fec2b26'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:46.439581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2b1db56d-5464-4077-9204-7ee62a445da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe441202e90f49b6a13dd8581fec2b26'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:46.453601 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2b1db56d-5464-4077-9204-7ee62a445da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe441202e90f49b6a13dd8581fec2b26'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:46.454549 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2b1db56d-5464-4077-9204-7ee62a445da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe441202e90f49b6a13dd8581fec2b26'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:46.464422 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2b1db56d-5464-4077-9204-7ee62a445da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe441202e90f49b6a13dd8581fec2b26'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:46.471169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 934/1839] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:46 2022] DELETE /identity/v3/users/fe441202e90f49b6a13dd8581fec2b26 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:19:46.872395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b9b01-d853-43dc-b605-4f6b9ccd11f6 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:46.873976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-028b9b01-d853-43dc-b605-4f6b9ccd11f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:46.898415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1db56d-5464-4077-9204-7ee62a445da6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:46.899492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b9b01-d853-43dc-b605-4f6b9ccd11f6 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:46.902404 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2b1db56d-5464-4077-9204-7ee62a445da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:46.932208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:46.982682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119989ba-ef1a-49e7-b4fd-f647b5318024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:46.983376 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119989ba-ef1a-49e7-b4fd-f647b5318024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:46.983647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119989ba-ef1a-49e7-b4fd-f647b5318024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:46.983910 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119989ba-ef1a-49e7-b4fd-f647b5318024 admin admin] PATH_INFO: `/v3/projects/9534bc2e858c499db0c0fbdaee302aab` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:46.985239 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119989ba-ef1a-49e7-b4fd-f647b5318024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9534bc2e858c499db0c0fbdaee302aab)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:46.987253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119989ba-ef1a-49e7-b4fd-f647b5318024 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:47.027763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1db56d-5464-4077-9204-7ee62a445da6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:47.035652 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fae6c-48b8-4637-98e3-c4e95c1286b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:47.036588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fae6c-48b8-4637-98e3-c4e95c1286b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:47.036902 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fae6c-48b8-4637-98e3-c4e95c1286b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:47.037178 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fae6c-48b8-4637-98e3-c4e95c1286b0 admin admin] PATH_INFO: `/v3/users/90943ad71eb14c0c870191de9ef3a891` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:47.038992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fae6c-48b8-4637-98e3-c4e95c1286b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90943ad71eb14c0c870191de9ef3a891)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:47.040607 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fae6c-48b8-4637-98e3-c4e95c1286b0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:47.055354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-119989ba-ef1a-49e7-b4fd-f647b5318024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9534bc2e858c499db0c0fbdaee302aab', 'request_id': 'req-119989ba-ef1a-49e7-b4fd-f647b5318024'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:47.066818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-119989ba-ef1a-49e7-b4fd-f647b5318024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9534bc2e858c499db0c0fbdaee302aab', 'request_id': 'req-119989ba-ef1a-49e7-b4fd-f647b5318024'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:47.076506 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-119989ba-ef1a-49e7-b4fd-f647b5318024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9534bc2e858c499db0c0fbdaee302aab', 'request_id': 'req-119989ba-ef1a-49e7-b4fd-f647b5318024'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:47.091169 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-119989ba-ef1a-49e7-b4fd-f647b5318024 admin admin] The token cache is being invalidate because project 9534bc2e858c499db0c0fbdaee302aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:47.092010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-119989ba-ef1a-49e7-b4fd-f647b5318024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:47.092470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-119989ba-ef1a-49e7-b4fd-f647b5318024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:47.095127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 906/1840] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:46 2022] DELETE /identity/v3/projects/9534bc2e858c499db0c0fbdaee302aab => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:47.101149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999bd73-fc69-48b2-bd4d-e407b0f29852 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:47.101685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999bd73-fc69-48b2-bd4d-e407b0f29852 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:47.102023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999bd73-fc69-48b2-bd4d-e407b0f29852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:47.121800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f28fae6c-48b8-4637-98e3-c4e95c1286b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90943ad71eb14c0c870191de9ef3a891'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:47.122471 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-6999bd73-fc69-48b2-bd4d-e407b0f29852 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:47.123730 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6999bd73-fc69-48b2-bd4d-e407b0f29852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:47.130446 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f28fae6c-48b8-4637-98e3-c4e95c1286b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90943ad71eb14c0c870191de9ef3a891'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:47.142695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f28fae6c-48b8-4637-98e3-c4e95c1286b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90943ad71eb14c0c870191de9ef3a891'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:47.143831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f28fae6c-48b8-4637-98e3-c4e95c1286b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90943ad71eb14c0c870191de9ef3a891'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:47.151585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f28fae6c-48b8-4637-98e3-c4e95c1286b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90943ad71eb14c0c870191de9ef3a891'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:47.157967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 935/1841] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:46 2022] DELETE /identity/v3/users/90943ad71eb14c0c870191de9ef3a891 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:47.162539 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4a76d-2ac4-4d1d-ac1c-7142f04628aa None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:47.162817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4a76d-2ac4-4d1d-ac1c-7142f04628aa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:47.163086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4a76d-2ac4-4d1d-ac1c-7142f04628aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:47.181894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-66d4a76d-2ac4-4d1d-ac1c-7142f04628aa None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:47.183110 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-66d4a76d-2ac4-4d1d-ac1c-7142f04628aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:47.188050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 907/1842] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:47.195937 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961dc1b-505f-4e9e-8512-ccdf3c8fbd1a None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:47.196212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961dc1b-505f-4e9e-8512-ccdf3c8fbd1a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:47.196478 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961dc1b-505f-4e9e-8512-ccdf3c8fbd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:47.205163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:47.218522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-d961dc1b-505f-4e9e-8512-ccdf3c8fbd1a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:47.219853 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d961dc1b-505f-4e9e-8512-ccdf3c8fbd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:47.259971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 936/1843] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:47.274231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4a76d-2ac4-4d1d-ac1c-7142f04628aa None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:47.276206 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-66d4a76d-2ac4-4d1d-ac1c-7142f04628aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:47.303014 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 908/1844] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:47.307168 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961dc1b-505f-4e9e-8512-ccdf3c8fbd1a None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:47.320219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:47.331379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961dc1b-505f-4e9e-8512-ccdf3c8fbd1a None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:47.339762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1044e3-39f8-4e21-b691-2c45467a5ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:47.340909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1044e3-39f8-4e21-b691-2c45467a5ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:47.341818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1044e3-39f8-4e21-b691-2c45467a5ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:47.342163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1044e3-39f8-4e21-b691-2c45467a5ca1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:47.342861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1044e3-39f8-4e21-b691-2c45467a5ca1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:19:47.343321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1044e3-39f8-4e21-b691-2c45467a5ca1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:47.345611 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1044e3-39f8-4e21-b691-2c45467a5ca1 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:47.364977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4a76d-2ac4-4d1d-ac1c-7142f04628aa None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:47.368404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 909/1845] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:19:47.369457 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1044e3-39f8-4e21-b691-2c45467a5ca1 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:47.373710 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290861a7-2f0b-433b-b462-b64da08d7677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:47.374253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290861a7-2f0b-433b-b462-b64da08d7677 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:47.374529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290861a7-2f0b-433b-b462-b64da08d7677 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:47.374797 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290861a7-2f0b-433b-b462-b64da08d7677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:47.387431 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290861a7-2f0b-433b-b462-b64da08d7677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:47.388210 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1044e3-39f8-4e21-b691-2c45467a5ca1 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:47.390385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290861a7-2f0b-433b-b462-b64da08d7677 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:47.395399 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79231eff-3614-4f13-8f44-c582b486b5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:47.396872 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231eff-3614-4f13-8f44-c582b486b5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:47.397246 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231eff-3614-4f13-8f44-c582b486b5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:47.398028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231eff-3614-4f13-8f44-c582b486b5b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:47.398815 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79231eff-3614-4f13-8f44-c582b486b5b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:47.401655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79231eff-3614-4f13-8f44-c582b486b5b1 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:47.402089 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 937/1846] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:19:47.441681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 910/1847] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:47 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:47.446852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290861a7-2f0b-433b-b462-b64da08d7677 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:47.457880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290861a7-2f0b-433b-b462-b64da08d7677 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:47.534690 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79231eff-3614-4f13-8f44-c582b486b5b1 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:47.537582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-79231eff-3614-4f13-8f44-c582b486b5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:47.591114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab1468-d7bf-4a6f-9377-6e434d9ed508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:47.592204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab1468-d7bf-4a6f-9377-6e434d9ed508 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:47.592783 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab1468-d7bf-4a6f-9377-6e434d9ed508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:47.593529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab1468-d7bf-4a6f-9377-6e434d9ed508 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:47.595079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab1468-d7bf-4a6f-9377-6e434d9ed508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:47.598944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab1468-d7bf-4a6f-9377-6e434d9ed508 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:47.643930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 938/1848] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:47 2022] POST /identity/v3/users => generated 284 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:47.644453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79231eff-3614-4f13-8f44-c582b486b5b1 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:47.648995 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab1468-d7bf-4a6f-9377-6e434d9ed508 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:47.662081 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdc062-210e-425d-9731-08e2695bb741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:47.662707 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdc062-210e-425d-9731-08e2695bb741 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:47.662977 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdc062-210e-425d-9731-08e2695bb741 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:47.663240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdc062-210e-425d-9731-08e2695bb741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:47.664663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab1468-d7bf-4a6f-9377-6e434d9ed508 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:47.665951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-bbfdc062-210e-425d-9731-08e2695bb741 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:47.670006 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dbc7b-4a8a-4401-bfb1-e34eb0c61982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:47.670627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dbc7b-4a8a-4401-bfb1-e34eb0c61982 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:47.670900 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dbc7b-4a8a-4401-bfb1-e34eb0c61982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:47.671168 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dbc7b-4a8a-4401-bfb1-e34eb0c61982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:47.671998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dbc7b-4a8a-4401-bfb1-e34eb0c61982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:47.673837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dbc7b-4a8a-4401-bfb1-e34eb0c61982 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:47.689819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 939/1849] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:47.691370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dbc7b-4a8a-4401-bfb1-e34eb0c61982 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:47.711802 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dbc7b-4a8a-4401-bfb1-e34eb0c61982 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:47.725601 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b645da-6a55-4847-b0eb-e78b468c1553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:47.727620 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b645da-6a55-4847-b0eb-e78b468c1553 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:47.727901 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b645da-6a55-4847-b0eb-e78b468c1553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:47.728190 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b645da-6a55-4847-b0eb-e78b468c1553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:47.728888 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b645da-6a55-4847-b0eb-e78b468c1553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:47.731113 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b645da-6a55-4847-b0eb-e78b468c1553 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:47.741726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdc062-210e-425d-9731-08e2695bb741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:47.743231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdc062-210e-425d-9731-08e2695bb741 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:47.749861 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 940/1850] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:19:47.754955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b645da-6a55-4847-b0eb-e78b468c1553 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:47.762404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 911/1851] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:47.776788 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b645da-6a55-4847-b0eb-e78b468c1553 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:47.784541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f89cb-e6d1-4851-addd-d8526b739cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:47.785639 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f89cb-e6d1-4851-addd-d8526b739cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:47.786336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f89cb-e6d1-4851-addd-d8526b739cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:47.786552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f89cb-e6d1-4851-addd-d8526b739cb0 admin admin] PATH_INFO: `/v3/projects/a6553ecdbaa84b6585f69a7240a298f5/users/9dfbce298e164b248264f07dce320c3a/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:47.807212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f89cb-e6d1-4851-addd-d8526b739cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6553ecdbaa84b6585f69a7240a298f5, user_id=9dfbce298e164b248264f07dce320c3a, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:47.810418 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f89cb-e6d1-4851-addd-d8526b739cb0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:47.832309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdc062-210e-425d-9731-08e2695bb741 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:47.834020 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-bbfdc062-210e-425d-9731-08e2695bb741 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:47.855673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 941/1852] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:47 2022] PUT /identity/v3/projects/a6553ecdbaa84b6585f69a7240a298f5/users/9dfbce298e164b248264f07dce320c3a/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:47.855771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdc062-210e-425d-9731-08e2695bb741 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:47.856190 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0602e0-5055-4cf9-b5c9-904cb80810af None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:47.856540 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0602e0-5055-4cf9-b5c9-904cb80810af None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:47.856733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0602e0-5055-4cf9-b5c9-904cb80810af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:47.895666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4d0602e0-5055-4cf9-b5c9-904cb80810af None None] MFA Rules not processed for user `9dfbce298e164b248264f07dce320c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:47.896904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4d0602e0-5055-4cf9-b5c9-904cb80810af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:47.920091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:47.996893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:47.997715 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:47.998069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:47.998433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c admin admin] PATH_INFO: `/v3/projects/7254ac992af64d9b93d5f0b8080f1e7f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:47.999891 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7254ac992af64d9b93d5f0b8080f1e7f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:48.002442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:48.077293 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 942/1853] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:48.082624 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0602e0-5055-4cf9-b5c9-904cb80810af None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:48.090942 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:48.095922 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7254ac992af64d9b93d5f0b8080f1e7f', 'request_id': 'req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:48.102145 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0602e0-5055-4cf9-b5c9-904cb80810af None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:48.112435 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7254ac992af64d9b93d5f0b8080f1e7f', 'request_id': 'req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:48.142722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7254ac992af64d9b93d5f0b8080f1e7f', 'request_id': 'req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:48.168657 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c admin admin] The token cache is being invalidate because project 7254ac992af64d9b93d5f0b8080f1e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:48.169216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:48.171228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:48.179787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 912/1854] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:47 2022] DELETE /identity/v3/projects/7254ac992af64d9b93d5f0b8080f1e7f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:48.181918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:48.185407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:48.259083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53e849-5b82-4b95-9d01-6b2162bca47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:48.259635 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53e849-5b82-4b95-9d01-6b2162bca47c admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:48.260364 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53e849-5b82-4b95-9d01-6b2162bca47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:48.260492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53e849-5b82-4b95-9d01-6b2162bca47c admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:48.261550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53e849-5b82-4b95-9d01-6b2162bca47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:48.268149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53e849-5b82-4b95-9d01-6b2162bca47c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:48.314614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e6914-a4c1-4fb8-b5ff-e9b6e8d2f36c admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:48.315856 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 943/1855] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:48 2022] POST /identity/v3/projects => generated 365 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:48.320160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53e849-5b82-4b95-9d01-6b2162bca47c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:48.322452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-eb53e849-5b82-4b95-9d01-6b2162bca47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:48.431159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53e849-5b82-4b95-9d01-6b2162bca47c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:48.434424 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4712c-fdd3-4940-bd4b-ea9f3ed5a574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:48.435500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4712c-fdd3-4940-bd4b-ea9f3ed5a574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:48.435986 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4712c-fdd3-4940-bd4b-ea9f3ed5a574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:48.436469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4712c-fdd3-4940-bd4b-ea9f3ed5a574 admin admin] PATH_INFO: `/v3/users/5b885dff2f134d84b260f7bf7528eb92` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:48.439082 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4712c-fdd3-4940-bd4b-ea9f3ed5a574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b885dff2f134d84b260f7bf7528eb92)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:48.442864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4712c-fdd3-4940-bd4b-ea9f3ed5a574 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:48.444464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bcb74-60bb-4ab8-be3d-3c6ab764a546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:48.445717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:48.445867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bcb74-60bb-4ab8-be3d-3c6ab764a546 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:48.446083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bcb74-60bb-4ab8-be3d-3c6ab764a546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:48.446351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bcb74-60bb-4ab8-be3d-3c6ab764a546 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:48.446989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9bcb74-60bb-4ab8-be3d-3c6ab764a546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:48.449754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9bcb74-60bb-4ab8-be3d-3c6ab764a546 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:48.497942 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 944/1856] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:48 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:48.500546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bcb74-60bb-4ab8-be3d-3c6ab764a546 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:48.518544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bcb74-60bb-4ab8-be3d-3c6ab764a546 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:48.524594 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534fc2e-07c7-4c7c-803c-3e1761f43900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:48.525406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534fc2e-07c7-4c7c-803c-3e1761f43900 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:48.525731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534fc2e-07c7-4c7c-803c-3e1761f43900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:48.526005 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534fc2e-07c7-4c7c-803c-3e1761f43900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:48.526983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534fc2e-07c7-4c7c-803c-3e1761f43900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:48.528934 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534fc2e-07c7-4c7c-803c-3e1761f43900 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:48.545087 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 945/1857] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:19:48.555390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534fc2e-07c7-4c7c-803c-3e1761f43900 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:48.555627 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3cc4712c-fdd3-4940-bd4b-ea9f3ed5a574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b885dff2f134d84b260f7bf7528eb92'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:48.561925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534fc2e-07c7-4c7c-803c-3e1761f43900 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:48.567234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91623b0d-930f-4721-815f-7dc84dfae374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:48.568154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91623b0d-930f-4721-815f-7dc84dfae374 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:48.568804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91623b0d-930f-4721-815f-7dc84dfae374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:48.569170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91623b0d-930f-4721-815f-7dc84dfae374 admin admin] PATH_INFO: `/v3/projects/16ca0bed7fae4ea893f93c5ce8a487d3/users/bed5e84e4a3740a888ebbbac2e67d511/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:48.574843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3cc4712c-fdd3-4940-bd4b-ea9f3ed5a574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b885dff2f134d84b260f7bf7528eb92'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:48.575882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3cc4712c-fdd3-4940-bd4b-ea9f3ed5a574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b885dff2f134d84b260f7bf7528eb92'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:48.585581 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3cc4712c-fdd3-4940-bd4b-ea9f3ed5a574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b885dff2f134d84b260f7bf7528eb92'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:48.587747 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91623b0d-930f-4721-815f-7dc84dfae374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ca0bed7fae4ea893f93c5ce8a487d3, user_id=bed5e84e4a3740a888ebbbac2e67d511, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:48.590909 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91623b0d-930f-4721-815f-7dc84dfae374 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:48.603714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3cc4712c-fdd3-4940-bd4b-ea9f3ed5a574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b885dff2f134d84b260f7bf7528eb92'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:48.609250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 946/1858] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:48 2022] PUT /identity/v3/projects/16ca0bed7fae4ea893f93c5ce8a487d3/users/bed5e84e4a3740a888ebbbac2e67d511/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:48.613954 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91623b0d-930f-4721-815f-7dc84dfae374 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:48.618661 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-91623b0d-930f-4721-815f-7dc84dfae374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:48.619344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 913/1859] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:48 2022] DELETE /identity/v3/users/5b885dff2f134d84b260f7bf7528eb92 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:48.679839 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:48.715186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91623b0d-930f-4721-815f-7dc84dfae374 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:48.802118 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683166ea-e4d8-4365-9ca1-e3203b1c5226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:48.803555 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683166ea-e4d8-4365-9ca1-e3203b1c5226 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:48.803896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683166ea-e4d8-4365-9ca1-e3203b1c5226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:48.804236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683166ea-e4d8-4365-9ca1-e3203b1c5226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:48.805225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683166ea-e4d8-4365-9ca1-e3203b1c5226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:48.808022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683166ea-e4d8-4365-9ca1-e3203b1c5226 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:48.833912 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 947/1860] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:48.835197 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4712c-fdd3-4940-bd4b-ea9f3ed5a574 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:48.847129 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4712c-fdd3-4940-bd4b-ea9f3ed5a574 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:48.852389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af439745-7d9f-4d55-8afc-69d3d4ab744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:48.853798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af439745-7d9f-4d55-8afc-69d3d4ab744f admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:48.854338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af439745-7d9f-4d55-8afc-69d3d4ab744f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:48.854983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af439745-7d9f-4d55-8afc-69d3d4ab744f admin admin] PATH_INFO: `/v3/projects/16ca0bed7fae4ea893f93c5ce8a487d3/users/bed5e84e4a3740a888ebbbac2e67d511/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:48.858502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af439745-7d9f-4d55-8afc-69d3d4ab744f admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ca0bed7fae4ea893f93c5ce8a487d3, user_id=bed5e84e4a3740a888ebbbac2e67d511, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:48.862070 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af439745-7d9f-4d55-8afc-69d3d4ab744f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:48.886040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 914/1861] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:48 2022] PUT /identity/v3/projects/16ca0bed7fae4ea893f93c5ce8a487d3/users/bed5e84e4a3740a888ebbbac2e67d511/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:48.892653 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78784b71-e006-4856-875d-5e7f5d327a25 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:48.893383 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78784b71-e006-4856-875d-5e7f5d327a25 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:48.894135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78784b71-e006-4856-875d-5e7f5d327a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:48.947504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-78784b71-e006-4856-875d-5e7f5d327a25 None None] MFA Rules not processed for user `bed5e84e4a3740a888ebbbac2e67d511`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:48.948845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-78784b71-e006-4856-875d-5e7f5d327a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:49.085213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 948/1862] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:49.096223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af439745-7d9f-4d55-8afc-69d3d4ab744f admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:49.099034 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-af439745-7d9f-4d55-8afc-69d3d4ab744f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:49.186490 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af439745-7d9f-4d55-8afc-69d3d4ab744f admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:49.193061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3bf0d-9f04-49c9-b47d-d3668cc16e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:49.193812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3bf0d-9f04-49c9-b47d-d3668cc16e27 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:49.194090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3bf0d-9f04-49c9-b47d-d3668cc16e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:49.194618 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3bf0d-9f04-49c9-b47d-d3668cc16e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:49.205930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3bf0d-9f04-49c9-b47d-d3668cc16e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:49.209413 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3bf0d-9f04-49c9-b47d-d3668cc16e27 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:49.228690 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 915/1863] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:49.410900 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78784b71-e006-4856-875d-5e7f5d327a25 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:49.426317 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78784b71-e006-4856-875d-5e7f5d327a25 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:49.439389 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbb11f-5735-4001-bc0c-26d2de2f33cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:49.440082 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbb11f-5735-4001-bc0c-26d2de2f33cd service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:49.440363 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbb11f-5735-4001-bc0c-26d2de2f33cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:49.440633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbb11f-5735-4001-bc0c-26d2de2f33cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:49.445974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a6bbb11f-5735-4001-bc0c-26d2de2f33cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:49.549122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbb11f-5735-4001-bc0c-26d2de2f33cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:49.555497 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbb11f-5735-4001-bc0c-26d2de2f33cd service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:49.570444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 949/1864] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:49.816669 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3bf0d-9f04-49c9-b47d-d3668cc16e27 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:49.819078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e2a3bf0d-9f04-49c9-b47d-d3668cc16e27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:49.932585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbb11f-5735-4001-bc0c-26d2de2f33cd service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:49.933968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a6bbb11f-5735-4001-bc0c-26d2de2f33cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:49.955178 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:49.995151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3bf0d-9f04-49c9-b47d-d3668cc16e27 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:50.010857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfd232-f8d3-41aa-a14e-48bb4780283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:50.011901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfd232-f8d3-41aa-a14e-48bb4780283f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:50.012108 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfd232-f8d3-41aa-a14e-48bb4780283f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:50.012379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfd232-f8d3-41aa-a14e-48bb4780283f admin admin] PATH_INFO: `/v3/projects/cb045e92e2e843c38496bc210b6930f0` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:50.017510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfd232-f8d3-41aa-a14e-48bb4780283f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb045e92e2e843c38496bc210b6930f0)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:50.021963 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfd232-f8d3-41aa-a14e-48bb4780283f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:50.053002 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:50.172197 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbb11f-5735-4001-bc0c-26d2de2f33cd service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:50.223842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8cbfd232-f8d3-41aa-a14e-48bb4780283f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb045e92e2e843c38496bc210b6930f0', 'request_id': 'req-8cbfd232-f8d3-41aa-a14e-48bb4780283f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:50.257700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8cbfd232-f8d3-41aa-a14e-48bb4780283f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb045e92e2e843c38496bc210b6930f0', 'request_id': 'req-8cbfd232-f8d3-41aa-a14e-48bb4780283f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:50.285567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8cbfd232-f8d3-41aa-a14e-48bb4780283f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb045e92e2e843c38496bc210b6930f0', 'request_id': 'req-8cbfd232-f8d3-41aa-a14e-48bb4780283f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:50.343156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8cbfd232-f8d3-41aa-a14e-48bb4780283f admin admin] The token cache is being invalidate because project cb045e92e2e843c38496bc210b6930f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:50.343467 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8cbfd232-f8d3-41aa-a14e-48bb4780283f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:50.352221 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8cbfd232-f8d3-41aa-a14e-48bb4780283f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:50.357103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 916/1865] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:49 2022] DELETE /identity/v3/projects/cb045e92e2e843c38496bc210b6930f0 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:50.366160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1293f8-ed10-4874-b575-ecce10fade9f None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:50.366160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1293f8-ed10-4874-b575-ecce10fade9f None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:50.366160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1293f8-ed10-4874-b575-ecce10fade9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:50.422546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-5f1293f8-ed10-4874-b575-ecce10fade9f None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:50.424736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5f1293f8-ed10-4874-b575-ecce10fade9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:50.433133 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa10cc5-fb05-4695-aec9-46095eb65ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:50.434625 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa10cc5-fb05-4695-aec9-46095eb65ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:50.434625 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa10cc5-fb05-4695-aec9-46095eb65ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:50.434874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa10cc5-fb05-4695-aec9-46095eb65ff4 admin admin] PATH_INFO: `/v3/users/108c7b66a3024cffb30f44681a087f9f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:50.436191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa10cc5-fb05-4695-aec9-46095eb65ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=108c7b66a3024cffb30f44681a087f9f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:50.438461 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa10cc5-fb05-4695-aec9-46095eb65ff4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:50.546827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 917/1866] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:50.557515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4fa10cc5-fb05-4695-aec9-46095eb65ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '108c7b66a3024cffb30f44681a087f9f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:50.564010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d1cce-88ce-4c89-b4e0-1cd98e6d7f6e None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:50.564589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d1cce-88ce-4c89-b4e0-1cd98e6d7f6e None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:50.564894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d1cce-88ce-4c89-b4e0-1cd98e6d7f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:50.572261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4fa10cc5-fb05-4695-aec9-46095eb65ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '108c7b66a3024cffb30f44681a087f9f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:50.593326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-f12d1cce-88ce-4c89-b4e0-1cd98e6d7f6e None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:50.595469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f12d1cce-88ce-4c89-b4e0-1cd98e6d7f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:50.597879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4fa10cc5-fb05-4695-aec9-46095eb65ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '108c7b66a3024cffb30f44681a087f9f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:50.598609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4fa10cc5-fb05-4695-aec9-46095eb65ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '108c7b66a3024cffb30f44681a087f9f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:50.608501 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-4fa10cc5-fb05-4695-aec9-46095eb65ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '108c7b66a3024cffb30f44681a087f9f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:50.613025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 918/1867] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:50.619199 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d1cce-88ce-4c89-b4e0-1cd98e6d7f6e None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:50.619675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 950/1868] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:49 2022] DELETE /identity/v3/users/108c7b66a3024cffb30f44681a087f9f => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:19:50.624768 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ae25a-c439-4b76-9560-e01fc7f2f080 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:50.625160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ae25a-c439-4b76-9560-e01fc7f2f080 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:50.625522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ae25a-c439-4b76-9560-e01fc7f2f080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:50.629981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d1cce-88ce-4c89-b4e0-1cd98e6d7f6e None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:50.645577 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-488ae25a-c439-4b76-9560-e01fc7f2f080 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:50.646655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-488ae25a-c439-4b76-9560-e01fc7f2f080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:50.684608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:50.704648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58019dfa-556f-40ff-a15a-4cd62a9029e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:50.705272 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58019dfa-556f-40ff-a15a-4cd62a9029e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:50.705522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58019dfa-556f-40ff-a15a-4cd62a9029e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:50.705858 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58019dfa-556f-40ff-a15a-4cd62a9029e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:50.706611 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58019dfa-556f-40ff-a15a-4cd62a9029e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:19:50.706892 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58019dfa-556f-40ff-a15a-4cd62a9029e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:50.708881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58019dfa-556f-40ff-a15a-4cd62a9029e5 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:50.723750 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 951/1869] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:50.723955 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 919/1870] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:19:50.728366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ae25a-c439-4b76-9560-e01fc7f2f080 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:50.734912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58019dfa-556f-40ff-a15a-4cd62a9029e5 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:50.736991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-58019dfa-556f-40ff-a15a-4cd62a9029e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:50.739456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ae25a-c439-4b76-9560-e01fc7f2f080 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:50.745081 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10493f-82db-46d5-9f63-c553de66e413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:50.746413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10493f-82db-46d5-9f63-c553de66e413 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:50.746766 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10493f-82db-46d5-9f63-c553de66e413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:50.747103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10493f-82db-46d5-9f63-c553de66e413 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:50.747937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10493f-82db-46d5-9f63-c553de66e413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:50.749937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10493f-82db-46d5-9f63-c553de66e413 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:50.779217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:50.786907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 952/1871] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:50 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:50.788787 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10493f-82db-46d5-9f63-c553de66e413 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:50.817540 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58019dfa-556f-40ff-a15a-4cd62a9029e5 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:50.869059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10493f-82db-46d5-9f63-c553de66e413 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:50.874709 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e4516-4cee-4e6e-8064-213bfc6fa06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:50.875996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e4516-4cee-4e6e-8064-213bfc6fa06b admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:50.876486 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e4516-4cee-4e6e-8064-213bfc6fa06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:50.876771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e4516-4cee-4e6e-8064-213bfc6fa06b admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:50.877527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e4516-4cee-4e6e-8064-213bfc6fa06b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:50.880135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e4516-4cee-4e6e-8064-213bfc6fa06b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:50.901411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703751e-bc12-4b9f-8e1f-373fff1c840b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:50.902086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703751e-bc12-4b9f-8e1f-373fff1c840b service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:50.902355 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703751e-bc12-4b9f-8e1f-373fff1c840b service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:50.902625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703751e-bc12-4b9f-8e1f-373fff1c840b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:50.911031 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 953/1872] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:50 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:50.915607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703751e-bc12-4b9f-8e1f-373fff1c840b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:50.916217 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e4516-4cee-4e6e-8064-213bfc6fa06b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:50.917061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c703751e-bc12-4b9f-8e1f-373fff1c840b service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:50.929935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 920/1873] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:50.930763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703751e-bc12-4b9f-8e1f-373fff1c840b service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:50.931392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e4516-4cee-4e6e-8064-213bfc6fa06b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:50.932257 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c703751e-bc12-4b9f-8e1f-373fff1c840b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:50.936874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32d947-03af-40d6-91b8-6e2ddf62112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:50.938564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32d947-03af-40d6-91b8-6e2ddf62112d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:50.938942 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32d947-03af-40d6-91b8-6e2ddf62112d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:50.939551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32d947-03af-40d6-91b8-6e2ddf62112d admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:50.940193 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32d947-03af-40d6-91b8-6e2ddf62112d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:50.943066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32d947-03af-40d6-91b8-6e2ddf62112d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:50.946103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703751e-bc12-4b9f-8e1f-373fff1c840b service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:50.952263 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafb849-ead6-4507-af33-ff7ea6a809ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:50.953000 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafb849-ead6-4507-af33-ff7ea6a809ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:50.953178 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafb849-ead6-4507-af33-ff7ea6a809ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:50.953449 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafb849-ead6-4507-af33-ff7ea6a809ef admin admin] PATH_INFO: `/v3/users/8e7565ac056c4c1c9ecfb640eddc9917` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:50.955111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafb849-ead6-4507-af33-ff7ea6a809ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e7565ac056c4c1c9ecfb640eddc9917)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:50.957667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafb849-ead6-4507-af33-ff7ea6a809ef admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:50.957818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 954/1874] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:50.961130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32d947-03af-40d6-91b8-6e2ddf62112d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:50.973096 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32d947-03af-40d6-91b8-6e2ddf62112d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:50.979518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68398282-c41b-445c-9fdc-4646a51e3046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:50.981571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68398282-c41b-445c-9fdc-4646a51e3046 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:50.981571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68398282-c41b-445c-9fdc-4646a51e3046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:50.981571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68398282-c41b-445c-9fdc-4646a51e3046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:50.981571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68398282-c41b-445c-9fdc-4646a51e3046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:50.983342 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68398282-c41b-445c-9fdc-4646a51e3046 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:50.997689 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 955/1875] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:19:51.002794 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68398282-c41b-445c-9fdc-4646a51e3046 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:51.014947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68398282-c41b-445c-9fdc-4646a51e3046 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:51.021669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fa297-5b24-466c-8ef3-4dc162f6c4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:51.022445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa297-5b24-466c-8ef3-4dc162f6c4e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:51.022789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa297-5b24-466c-8ef3-4dc162f6c4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:51.023136 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa297-5b24-466c-8ef3-4dc162f6c4e7 admin admin] PATH_INFO: `/v3/projects/203965196a15456bae1603c6c752d2e0/users/2ca706ea266a4ebabb127b99f847b33f/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:51.025755 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7fafb849-ead6-4507-af33-ff7ea6a809ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e7565ac056c4c1c9ecfb640eddc9917'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:51.036049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7fafb849-ead6-4507-af33-ff7ea6a809ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e7565ac056c4c1c9ecfb640eddc9917'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:51.036825 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7fafb849-ead6-4507-af33-ff7ea6a809ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e7565ac056c4c1c9ecfb640eddc9917'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:51.043825 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fa297-5b24-466c-8ef3-4dc162f6c4e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=203965196a15456bae1603c6c752d2e0, user_id=2ca706ea266a4ebabb127b99f847b33f, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:51.046821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7fafb849-ead6-4507-af33-ff7ea6a809ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e7565ac056c4c1c9ecfb640eddc9917'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:51.046978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fa297-5b24-466c-8ef3-4dc162f6c4e7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:51.064935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 956/1876] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:51 2022] PUT /identity/v3/projects/203965196a15456bae1603c6c752d2e0/users/2ca706ea266a4ebabb127b99f847b33f/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:19:51.072864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7fafb849-ead6-4507-af33-ff7ea6a809ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e7565ac056c4c1c9ecfb640eddc9917'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:51.077523 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d521cf7-70e9-4c7c-b74a-f69a72a6d94d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:51.078637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d521cf7-70e9-4c7c-b74a-f69a72a6d94d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:51.078919 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d521cf7-70e9-4c7c-b74a-f69a72a6d94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:51.081807 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 921/1877] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:50 2022] DELETE /identity/v3/users/8e7565ac056c4c1c9ecfb640eddc9917 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:51.086841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd8c76-5f0b-414d-93fe-2be4485497d1 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:51.087199 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd8c76-5f0b-414d-93fe-2be4485497d1 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:51.087484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd8c76-5f0b-414d-93fe-2be4485497d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:51.108258 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-59bd8c76-5f0b-414d-93fe-2be4485497d1 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:51.109712 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-59bd8c76-5f0b-414d-93fe-2be4485497d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:51.136631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6d521cf7-70e9-4c7c-b74a-f69a72a6d94d None None] MFA Rules not processed for user `2ca706ea266a4ebabb127b99f847b33f`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:51.137927 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6d521cf7-70e9-4c7c-b74a-f69a72a6d94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:51.168332 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:51.185198 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 922/1878] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:51.196309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd8c76-5f0b-414d-93fe-2be4485497d1 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:51.198086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-59bd8c76-5f0b-414d-93fe-2be4485497d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:51.220732 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:51.250104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 957/1879] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:51.255695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d521cf7-70e9-4c7c-b74a-f69a72a6d94d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:51.256711 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6d521cf7-70e9-4c7c-b74a-f69a72a6d94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:51.273110 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d521cf7-70e9-4c7c-b74a-f69a72a6d94d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:51.280822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9a6c0-0278-4031-b554-d9c31755b1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:51.281671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9a6c0-0278-4031-b554-d9c31755b1be admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:51.282288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9a6c0-0278-4031-b554-d9c31755b1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:51.282740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9a6c0-0278-4031-b554-d9c31755b1be admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:51.284863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9a6c0-0278-4031-b554-d9c31755b1be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:51.286407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9a6c0-0278-4031-b554-d9c31755b1be admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:51.290568 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd8c76-5f0b-414d-93fe-2be4485497d1 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:51.299149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992cf46-f591-4833-9f58-a470391a2766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:51.300088 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992cf46-f591-4833-9f58-a470391a2766 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:51.300530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992cf46-f591-4833-9f58-a470391a2766 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:51.300952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992cf46-f591-4833-9f58-a470391a2766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:51.313130 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992cf46-f591-4833-9f58-a470391a2766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:51.314781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992cf46-f591-4833-9f58-a470391a2766 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:51.335588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 958/1880] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:51 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:19:51.339949 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9a6c0-0278-4031-b554-d9c31755b1be admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:51.353805 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 923/1881] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:51.451322 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9a6c0-0278-4031-b554-d9c31755b1be admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:51.456792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e90066-1336-4d8e-8d29-a09156dafc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:51.457612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e90066-1336-4d8e-8d29-a09156dafc5b admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:51.457984 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e90066-1336-4d8e-8d29-a09156dafc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:51.458244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e90066-1336-4d8e-8d29-a09156dafc5b admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:51.458973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e90066-1336-4d8e-8d29-a09156dafc5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:51.461849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e90066-1336-4d8e-8d29-a09156dafc5b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:51.499467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 959/1882] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:51 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:51.504006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992cf46-f591-4833-9f58-a470391a2766 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:51.522503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992cf46-f591-4833-9f58-a470391a2766 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:51.529612 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf65ba-f155-4452-a70a-ac6711108cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:51.530580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf65ba-f155-4452-a70a-ac6711108cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:51.531837 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf65ba-f155-4452-a70a-ac6711108cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:51.531837 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf65ba-f155-4452-a70a-ac6711108cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:51.532014 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf65ba-f155-4452-a70a-ac6711108cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:51.534924 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bf65ba-f155-4452-a70a-ac6711108cdb admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:51.569014 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 924/1883] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:51.573551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e90066-1336-4d8e-8d29-a09156dafc5b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:51.588526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e90066-1336-4d8e-8d29-a09156dafc5b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:51.606759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bda96d-ba9c-4fbc-8915-c1a8da624d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:51.608032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bda96d-ba9c-4fbc-8915-c1a8da624d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:51.608299 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bda96d-ba9c-4fbc-8915-c1a8da624d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:51.610913 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bda96d-ba9c-4fbc-8915-c1a8da624d48 admin admin] PATH_INFO: `/v3/projects/9c7c62bf2482494ea492a34a4e2421ff/users/1548a12d75b841a2a76ecfccb0cb5c05/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:51.632030 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf65ba-f155-4452-a70a-ac6711108cdb admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:51.632331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bda96d-ba9c-4fbc-8915-c1a8da624d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7c62bf2482494ea492a34a4e2421ff, user_id=1548a12d75b841a2a76ecfccb0cb5c05, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:51.633766 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c9bf65ba-f155-4452-a70a-ac6711108cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:51.635391 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bda96d-ba9c-4fbc-8915-c1a8da624d48 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:51.657041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf65ba-f155-4452-a70a-ac6711108cdb admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:51.671611 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5141fd1-f56a-4cf8-a88a-3d682584a49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:51.672445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5141fd1-f56a-4cf8-a88a-3d682584a49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:51.673259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5141fd1-f56a-4cf8-a88a-3d682584a49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:51.673259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5141fd1-f56a-4cf8-a88a-3d682584a49f admin admin] PATH_INFO: `/v3/projects/7ad44dac41634f6783857c31c4513b7d` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:51.674453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5141fd1-f56a-4cf8-a88a-3d682584a49f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad44dac41634f6783857c31c4513b7d)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:51.677457 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 960/1884] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:51 2022] PUT /identity/v3/projects/9c7c62bf2482494ea492a34a4e2421ff/users/1548a12d75b841a2a76ecfccb0cb5c05/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:19:51.680889 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5141fd1-f56a-4cf8-a88a-3d682584a49f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:51.682301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bda96d-ba9c-4fbc-8915-c1a8da624d48 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:51.804654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-e5141fd1-f56a-4cf8-a88a-3d682584a49f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad44dac41634f6783857c31c4513b7d', 'request_id': 'req-e5141fd1-f56a-4cf8-a88a-3d682584a49f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:51.820296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-e5141fd1-f56a-4cf8-a88a-3d682584a49f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad44dac41634f6783857c31c4513b7d', 'request_id': 'req-e5141fd1-f56a-4cf8-a88a-3d682584a49f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:51.835264 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-e5141fd1-f56a-4cf8-a88a-3d682584a49f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad44dac41634f6783857c31c4513b7d', 'request_id': 'req-e5141fd1-f56a-4cf8-a88a-3d682584a49f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:51.864287 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-e5141fd1-f56a-4cf8-a88a-3d682584a49f admin admin] The token cache is being invalidate because project 7ad44dac41634f6783857c31c4513b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:51.864700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-e5141fd1-f56a-4cf8-a88a-3d682584a49f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:51.865593 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-e5141fd1-f56a-4cf8-a88a-3d682584a49f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:51.867919 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 925/1885] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:51 2022] DELETE /identity/v3/projects/7ad44dac41634f6783857c31c4513b7d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:51.869465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39c3d7-3249-4638-99ff-958b4c153451 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:51.869848 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39c3d7-3249-4638-99ff-958b4c153451 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:51.871480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39c3d7-3249-4638-99ff-958b4c153451 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:51.871859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bda96d-ba9c-4fbc-8915-c1a8da624d48 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:51.873305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 926/1886] 10.222.0.15 () {54 vars in 921 bytes} [Tue Aug 9 11:19:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:19:51.876717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39c3d7-3249-4638-99ff-958b4c153451 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:51.881422 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7f39c3d7-3249-4638-99ff-958b4c153451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:51.964007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:51.999581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd373114-dc67-4c78-99f9-1c83fa66fae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:51.999850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd373114-dc67-4c78-99f9-1c83fa66fae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:52.000102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd373114-dc67-4c78-99f9-1c83fa66fae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:52.000406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd373114-dc67-4c78-99f9-1c83fa66fae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:52.001209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd373114-dc67-4c78-99f9-1c83fa66fae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:52.002885 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd373114-dc67-4c78-99f9-1c83fa66fae8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:52.025681 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 961/1887] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:52.025681 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e5ab9-85e2-4922-851f-026718d31a70 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:52.025984 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e5ab9-85e2-4922-851f-026718d31a70 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:52.026064 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e5ab9-85e2-4922-851f-026718d31a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:52.031078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39c3d7-3249-4638-99ff-958b4c153451 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:52.039259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23567514-7b9e-4ade-ae5a-b89ea11d0689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:52.039920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23567514-7b9e-4ade-ae5a-b89ea11d0689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:52.040200 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23567514-7b9e-4ade-ae5a-b89ea11d0689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:52.041104 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23567514-7b9e-4ade-ae5a-b89ea11d0689 admin admin] PATH_INFO: `/v3/users/7bb4fc7733b84d1f99c03bddfe1efc23` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:52.042276 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23567514-7b9e-4ade-ae5a-b89ea11d0689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb4fc7733b84d1f99c03bddfe1efc23)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:52.044250 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23567514-7b9e-4ade-ae5a-b89ea11d0689 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:52.066856 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f02e5ab9-85e2-4922-851f-026718d31a70 None None] MFA Rules not processed for user `881030d7605b40879762d1c199362ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:52.069131 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f02e5ab9-85e2-4922-851f-026718d31a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:52.070020 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:52.108459 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-23567514-7b9e-4ade-ae5a-b89ea11d0689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb4fc7733b84d1f99c03bddfe1efc23'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.118428 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-23567514-7b9e-4ade-ae5a-b89ea11d0689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb4fc7733b84d1f99c03bddfe1efc23'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.119043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-23567514-7b9e-4ade-ae5a-b89ea11d0689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb4fc7733b84d1f99c03bddfe1efc23'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.128993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-23567514-7b9e-4ade-ae5a-b89ea11d0689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb4fc7733b84d1f99c03bddfe1efc23'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.143432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-23567514-7b9e-4ade-ae5a-b89ea11d0689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb4fc7733b84d1f99c03bddfe1efc23'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.149787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 927/1888] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:51 2022] DELETE /identity/v3/users/7bb4fc7733b84d1f99c03bddfe1efc23 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:52.153073 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23567514-7b9e-4ade-ae5a-b89ea11d0689 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:52.153196 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 962/1889] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Aug 9 11:19:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:52.153749 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e5ab9-85e2-4922-851f-026718d31a70 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:52.156528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f02e5ab9-85e2-4922-851f-026718d31a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:52.157727 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-23567514-7b9e-4ade-ae5a-b89ea11d0689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:52.170678 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e5ab9-85e2-4922-851f-026718d31a70 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:52.266553 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ce023-dc66-4e9d-9140-2e10bef2f745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:52.268170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ce023-dc66-4e9d-9140-2e10bef2f745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:52.270464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ce023-dc66-4e9d-9140-2e10bef2f745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:52.272107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ce023-dc66-4e9d-9140-2e10bef2f745 admin admin] PATH_INFO: `/v3/projects/011793734b954abcaec114280679ea2b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:52.279365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ce023-dc66-4e9d-9140-2e10bef2f745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=011793734b954abcaec114280679ea2b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:52.279898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23567514-7b9e-4ade-ae5a-b89ea11d0689 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:52.282969 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ce023-dc66-4e9d-9140-2e10bef2f745 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:52.287029 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cb6b0-be7f-4170-9bda-dcf68a3362da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:52.287995 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cb6b0-be7f-4170-9bda-dcf68a3362da admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:52.288275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cb6b0-be7f-4170-9bda-dcf68a3362da admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:52.288548 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cb6b0-be7f-4170-9bda-dcf68a3362da admin admin] PATH_INFO: `/v3/projects/9c7c62bf2482494ea492a34a4e2421ff/users/1548a12d75b841a2a76ecfccb0cb5c05/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:52.290820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cb6b0-be7f-4170-9bda-dcf68a3362da admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c7c62bf2482494ea492a34a4e2421ff, user_id=1548a12d75b841a2a76ecfccb0cb5c05, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:52.302949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cb6b0-be7f-4170-9bda-dcf68a3362da admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:52.321282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 928/1890] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:52 2022] PUT /identity/v3/projects/9c7c62bf2482494ea492a34a4e2421ff/users/1548a12d75b841a2a76ecfccb0cb5c05/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:52.323037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cb6b0-be7f-4170-9bda-dcf68a3362da admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:52.325893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-de1cb6b0-be7f-4170-9bda-dcf68a3362da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:52.380958 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f83ce023-dc66-4e9d-9140-2e10bef2f745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011793734b954abcaec114280679ea2b', 'request_id': 'req-f83ce023-dc66-4e9d-9140-2e10bef2f745'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.391201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f83ce023-dc66-4e9d-9140-2e10bef2f745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011793734b954abcaec114280679ea2b', 'request_id': 'req-f83ce023-dc66-4e9d-9140-2e10bef2f745'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.406995 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f83ce023-dc66-4e9d-9140-2e10bef2f745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011793734b954abcaec114280679ea2b', 'request_id': 'req-f83ce023-dc66-4e9d-9140-2e10bef2f745'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.409570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:52.428808 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f83ce023-dc66-4e9d-9140-2e10bef2f745 admin admin] The token cache is being invalidate because project 011793734b954abcaec114280679ea2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:52.434831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f83ce023-dc66-4e9d-9140-2e10bef2f745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.435030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f83ce023-dc66-4e9d-9140-2e10bef2f745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.439702 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 963/1891] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:52 2022] DELETE /identity/v3/projects/011793734b954abcaec114280679ea2b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:52.439702 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713dfec-c9c4-436b-9b6c-2abab56c8803 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:52.439702 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713dfec-c9c4-436b-9b6c-2abab56c8803 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:52.439702 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713dfec-c9c4-436b-9b6c-2abab56c8803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:52.472859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b713dfec-c9c4-436b-9b6c-2abab56c8803 None None] MFA Rules not processed for user `1548a12d75b841a2a76ecfccb0cb5c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:52.479134 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b713dfec-c9c4-436b-9b6c-2abab56c8803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:52.489781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cb6b0-be7f-4170-9bda-dcf68a3362da admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:52.519239 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:52.575093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1214157-abd7-4993-b494-9d9fad7ee339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:52.575721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1214157-abd7-4993-b494-9d9fad7ee339 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:52.575992 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1214157-abd7-4993-b494-9d9fad7ee339 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:52.576260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1214157-abd7-4993-b494-9d9fad7ee339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:52.578094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 964/1892] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:52.578225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c1214157-abd7-4993-b494-9d9fad7ee339 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:52.580609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713dfec-c9c4-436b-9b6c-2abab56c8803 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:52.586731 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b713dfec-c9c4-436b-9b6c-2abab56c8803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:52.594274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1214157-abd7-4993-b494-9d9fad7ee339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:52.596298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1214157-abd7-4993-b494-9d9fad7ee339 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:52.609677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 929/1893] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:52.610773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1214157-abd7-4993-b494-9d9fad7ee339 service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:52.612193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c1214157-abd7-4993-b494-9d9fad7ee339 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:52.689786 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713dfec-c9c4-436b-9b6c-2abab56c8803 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:52.692942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1214157-abd7-4993-b494-9d9fad7ee339 service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:52.694890 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362f9e7-59d3-4426-928c-81366ccd9db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:52.695857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362f9e7-59d3-4426-928c-81366ccd9db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:52.696413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362f9e7-59d3-4426-928c-81366ccd9db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:52.696889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362f9e7-59d3-4426-928c-81366ccd9db8 admin admin] PATH_INFO: `/v3/users/98594c2235c34cef810a6ccb244906c2` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:52.697449 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13731df9-0e77-4c4d-b8c5-c8fde63234d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:52.698111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13731df9-0e77-4c4d-b8c5-c8fde63234d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:52.698382 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13731df9-0e77-4c4d-b8c5-c8fde63234d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:52.698547 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362f9e7-59d3-4426-928c-81366ccd9db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98594c2235c34cef810a6ccb244906c2)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:52.698650 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13731df9-0e77-4c4d-b8c5-c8fde63234d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:52.700913 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362f9e7-59d3-4426-928c-81366ccd9db8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:52.710651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13731df9-0e77-4c4d-b8c5-c8fde63234d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:52.712226 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13731df9-0e77-4c4d-b8c5-c8fde63234d0 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:52.740487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 930/1894] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:52.758597 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13731df9-0e77-4c4d-b8c5-c8fde63234d0 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:52.762426 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-13731df9-0e77-4c4d-b8c5-c8fde63234d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:52.809137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0362f9e7-59d3-4426-928c-81366ccd9db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98594c2235c34cef810a6ccb244906c2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.811980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13731df9-0e77-4c4d-b8c5-c8fde63234d0 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:52.820368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0362f9e7-59d3-4426-928c-81366ccd9db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98594c2235c34cef810a6ccb244906c2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.824569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc28284-23e1-4e91-a157-50ab7a043d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:52.825519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc28284-23e1-4e91-a157-50ab7a043d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:52.825918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc28284-23e1-4e91-a157-50ab7a043d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:52.826842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc28284-23e1-4e91-a157-50ab7a043d9b admin admin] PATH_INFO: `/v3/projects/eb03de620a6142ea8e99757e3c75d105` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:52.830348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc28284-23e1-4e91-a157-50ab7a043d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb03de620a6142ea8e99757e3c75d105)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:52.833229 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc28284-23e1-4e91-a157-50ab7a043d9b admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:52.867000 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0362f9e7-59d3-4426-928c-81366ccd9db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98594c2235c34cef810a6ccb244906c2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.868354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0362f9e7-59d3-4426-928c-81366ccd9db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98594c2235c34cef810a6ccb244906c2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.891140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0362f9e7-59d3-4426-928c-81366ccd9db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98594c2235c34cef810a6ccb244906c2'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.895201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:52.920915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 965/1895] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:52 2022] DELETE /identity/v3/users/98594c2235c34cef810a6ccb244906c2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:52.943936 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362f9e7-59d3-4426-928c-81366ccd9db8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:52.945677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0362f9e7-59d3-4426-928c-81366ccd9db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:52.966402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6dc28284-23e1-4e91-a157-50ab7a043d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb03de620a6142ea8e99757e3c75d105', 'request_id': 'req-6dc28284-23e1-4e91-a157-50ab7a043d9b'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:52.992883 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6dc28284-23e1-4e91-a157-50ab7a043d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb03de620a6142ea8e99757e3c75d105', 'request_id': 'req-6dc28284-23e1-4e91-a157-50ab7a043d9b'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:53.001839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6dc28284-23e1-4e91-a157-50ab7a043d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb03de620a6142ea8e99757e3c75d105', 'request_id': 'req-6dc28284-23e1-4e91-a157-50ab7a043d9b'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:53.023211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6dc28284-23e1-4e91-a157-50ab7a043d9b admin admin] The token cache is being invalidate because project eb03de620a6142ea8e99757e3c75d105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:53.024697 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6dc28284-23e1-4e91-a157-50ab7a043d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:53.026681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6dc28284-23e1-4e91-a157-50ab7a043d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:53.034800 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 931/1896] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:52 2022] DELETE /identity/v3/projects/eb03de620a6142ea8e99757e3c75d105 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:53.038275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e1550-4b1b-4cd9-b4fc-c9e28d96c56a None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:53.038569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e1550-4b1b-4cd9-b4fc-c9e28d96c56a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:53.038841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e1550-4b1b-4cd9-b4fc-c9e28d96c56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:53.041755 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362f9e7-59d3-4426-928c-81366ccd9db8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:53.086254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-e87e1550-4b1b-4cd9-b4fc-c9e28d96c56a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:53.087559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e87e1550-4b1b-4cd9-b4fc-c9e28d96c56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:53.148561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf0129-323d-4ac0-994f-ff575d27199d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:53.149098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf0129-323d-4ac0-994f-ff575d27199d service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:53.149363 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf0129-323d-4ac0-994f-ff575d27199d service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:53.149647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf0129-323d-4ac0-994f-ff575d27199d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:53.155636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-48cf0129-323d-4ac0-994f-ff575d27199d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:53.198144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:53.286051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf0129-323d-4ac0-994f-ff575d27199d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:53.288109 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf0129-323d-4ac0-994f-ff575d27199d service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:53.288294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 932/1897] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:53.297177 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15ff29-bdc4-4d85-9eb2-d8d75ac303fd None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:53.297923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15ff29-bdc4-4d85-9eb2-d8d75ac303fd None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:53.297923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15ff29-bdc4-4d85-9eb2-d8d75ac303fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:53.319456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 966/1898] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:19:53.367555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-0f15ff29-bdc4-4d85-9eb2-d8d75ac303fd None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:53.369232 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0f15ff29-bdc4-4d85-9eb2-d8d75ac303fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:53.387782 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 933/1899] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:53.391437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf0129-323d-4ac0-994f-ff575d27199d service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:53.414783 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf0129-323d-4ac0-994f-ff575d27199d service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:53.426367 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4a277-05b8-46d0-90ac-81239ec2c2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:53.427713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4a277-05b8-46d0-90ac-81239ec2c2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:53.428172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4a277-05b8-46d0-90ac-81239ec2c2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:53.428648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4a277-05b8-46d0-90ac-81239ec2c2a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:53.456946 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4a277-05b8-46d0-90ac-81239ec2c2a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:19:53.458333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4a277-05b8-46d0-90ac-81239ec2c2a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:53.462780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4a277-05b8-46d0-90ac-81239ec2c2a3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:53.519109 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 967/1900] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:19:53.520911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15ff29-bdc4-4d85-9eb2-d8d75ac303fd None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:53.544546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15ff29-bdc4-4d85-9eb2-d8d75ac303fd None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:53.567088 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6d94a-a482-405c-904b-06bd6901b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:53.567732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6d94a-a482-405c-904b-06bd6901b1da admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:53.568040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6d94a-a482-405c-904b-06bd6901b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:53.568271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6d94a-a482-405c-904b-06bd6901b1da admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:53.568946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6d94a-a482-405c-904b-06bd6901b1da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:53.574540 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6d94a-a482-405c-904b-06bd6901b1da admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:53.648249 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 934/1901] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:53 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:53.649386 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4a277-05b8-46d0-90ac-81239ec2c2a3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:53.677883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4a277-05b8-46d0-90ac-81239ec2c2a3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:53.703240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6d94a-a482-405c-904b-06bd6901b1da admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:53.709225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7dc6d94a-a482-405c-904b-06bd6901b1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:53.826511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:53.840189 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab998b-127f-4198-bef8-37651f428a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:53.840854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab998b-127f-4198-bef8-37651f428a79 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:53.841085 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab998b-127f-4198-bef8-37651f428a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:53.841357 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab998b-127f-4198-bef8-37651f428a79 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:53.842040 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab998b-127f-4198-bef8-37651f428a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:53.844004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab998b-127f-4198-bef8-37651f428a79 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:53.854041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6d94a-a482-405c-904b-06bd6901b1da admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:53.874630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b785c-4357-429d-9e4b-00e3da421d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:53.875380 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b785c-4357-429d-9e4b-00e3da421d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:53.875747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b785c-4357-429d-9e4b-00e3da421d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:53.876019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b785c-4357-429d-9e4b-00e3da421d1f admin admin] PATH_INFO: `/v3/projects/67f91d287f2946b7bdd1db9a9c6e906b` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:53.882531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b785c-4357-429d-9e4b-00e3da421d1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f91d287f2946b7bdd1db9a9c6e906b)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:53.889876 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b785c-4357-429d-9e4b-00e3da421d1f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:53.903577 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 968/1902] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:53 2022] POST /identity/v3/users => generated 291 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:19:53.908639 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab998b-127f-4198-bef8-37651f428a79 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:53.930244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab998b-127f-4198-bef8-37651f428a79 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:53.939113 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450a30e-9206-45d3-99cb-7d925d70a2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:53.941190 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450a30e-9206-45d3-99cb-7d925d70a2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:53.941899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450a30e-9206-45d3-99cb-7d925d70a2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:53.942366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450a30e-9206-45d3-99cb-7d925d70a2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:53.943372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450a30e-9206-45d3-99cb-7d925d70a2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:53.945394 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450a30e-9206-45d3-99cb-7d925d70a2a3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:53.988429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 969/1903] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:53.989480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450a30e-9206-45d3-99cb-7d925d70a2a3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:53.993572 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c450a30e-9206-45d3-99cb-7d925d70a2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:53.995379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6c6b785c-4357-429d-9e4b-00e3da421d1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f91d287f2946b7bdd1db9a9c6e906b', 'request_id': 'req-6c6b785c-4357-429d-9e4b-00e3da421d1f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:54.008080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6c6b785c-4357-429d-9e4b-00e3da421d1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f91d287f2946b7bdd1db9a9c6e906b', 'request_id': 'req-6c6b785c-4357-429d-9e4b-00e3da421d1f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:54.017502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6c6b785c-4357-429d-9e4b-00e3da421d1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f91d287f2946b7bdd1db9a9c6e906b', 'request_id': 'req-6c6b785c-4357-429d-9e4b-00e3da421d1f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:54.020130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450a30e-9206-45d3-99cb-7d925d70a2a3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:54.030372 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6c6b785c-4357-429d-9e4b-00e3da421d1f admin admin] The token cache is being invalidate because project 67f91d287f2946b7bdd1db9a9c6e906b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:54.030662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6c6b785c-4357-429d-9e4b-00e3da421d1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:54.032915 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6c6b785c-4357-429d-9e4b-00e3da421d1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:54.035280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 935/1904] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:53 2022] DELETE /identity/v3/projects/67f91d287f2946b7bdd1db9a9c6e906b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:19:54.035873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b785c-4357-429d-9e4b-00e3da421d1f admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:54.039433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6c6b785c-4357-429d-9e4b-00e3da421d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:54.087033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b0ea0-89ea-4059-bccc-bf2169316f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:54.087688 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b0ea0-89ea-4059-bccc-bf2169316f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:54.087965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b0ea0-89ea-4059-bccc-bf2169316f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:54.088513 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b0ea0-89ea-4059-bccc-bf2169316f70 admin admin] PATH_INFO: `/v3/users/2ca706ea266a4ebabb127b99f847b33f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:54.090183 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b0ea0-89ea-4059-bccc-bf2169316f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca706ea266a4ebabb127b99f847b33f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:54.092592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b0ea0-89ea-4059-bccc-bf2169316f70 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:54.096635 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:54.141217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b785c-4357-429d-9e4b-00e3da421d1f admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:54.148138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5939e94-d966-40b7-8498-3b77fc3447c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:54.149004 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5939e94-d966-40b7-8498-3b77fc3447c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:54.149282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5939e94-d966-40b7-8498-3b77fc3447c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:54.149551 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5939e94-d966-40b7-8498-3b77fc3447c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:54.150359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5939e94-d966-40b7-8498-3b77fc3447c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:54.153190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5939e94-d966-40b7-8498-3b77fc3447c9 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:54.159629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0b3b0ea0-89ea-4059-bccc-bf2169316f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca706ea266a4ebabb127b99f847b33f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:54.169177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0b3b0ea0-89ea-4059-bccc-bf2169316f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca706ea266a4ebabb127b99f847b33f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:54.173847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 936/1905] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:54.176342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5939e94-d966-40b7-8498-3b77fc3447c9 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:54.179130 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d5939e94-d966-40b7-8498-3b77fc3447c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:54.194336 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5939e94-d966-40b7-8498-3b77fc3447c9 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:54.195997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0b3b0ea0-89ea-4059-bccc-bf2169316f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca706ea266a4ebabb127b99f847b33f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:54.197282 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0b3b0ea0-89ea-4059-bccc-bf2169316f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca706ea266a4ebabb127b99f847b33f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:54.199339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cb149-6744-4a75-a4db-950cafc93c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:54.199977 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cb149-6744-4a75-a4db-950cafc93c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:54.200249 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cb149-6744-4a75-a4db-950cafc93c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:54.200519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cb149-6744-4a75-a4db-950cafc93c96 admin admin] PATH_INFO: `/v3/users/15ba3df494d749c0b32e713f82c13e65` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:54.201868 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cb149-6744-4a75-a4db-950cafc93c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ba3df494d749c0b32e713f82c13e65)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:54.204061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cb149-6744-4a75-a4db-950cafc93c96 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:54.211993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0b3b0ea0-89ea-4059-bccc-bf2169316f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca706ea266a4ebabb127b99f847b33f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:54.221314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 970/1906] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:53 2022] DELETE /identity/v3/users/2ca706ea266a4ebabb127b99f847b33f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:54.223023 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b0ea0-89ea-4059-bccc-bf2169316f70 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:54.224577 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0b3b0ea0-89ea-4059-bccc-bf2169316f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:54.291849 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-135cb149-6744-4a75-a4db-950cafc93c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ba3df494d749c0b32e713f82c13e65'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:54.305483 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:54.311263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b0ea0-89ea-4059-bccc-bf2169316f70 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:54.313349 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-135cb149-6744-4a75-a4db-950cafc93c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ba3df494d749c0b32e713f82c13e65'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:54.314020 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-135cb149-6744-4a75-a4db-950cafc93c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ba3df494d749c0b32e713f82c13e65'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:54.320586 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40102f7-e1f1-4df5-bea7-b509e4e8a335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:54.321544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40102f7-e1f1-4df5-bea7-b509e4e8a335 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:54.322684 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40102f7-e1f1-4df5-bea7-b509e4e8a335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:54.322967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40102f7-e1f1-4df5-bea7-b509e4e8a335 admin admin] PATH_INFO: `/v3/projects/7dc9f6a160004af9aede66adb17fdff6/users/61be6ebed03743579866119b2af644bf/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:54.327535 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-135cb149-6744-4a75-a4db-950cafc93c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ba3df494d749c0b32e713f82c13e65'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:54.340228 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40102f7-e1f1-4df5-bea7-b509e4e8a335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc9f6a160004af9aede66adb17fdff6, user_id=61be6ebed03743579866119b2af644bf, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:54.342415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40102f7-e1f1-4df5-bea7-b509e4e8a335 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:54.344727 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-135cb149-6744-4a75-a4db-950cafc93c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ba3df494d749c0b32e713f82c13e65'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:54.354429 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 937/1907] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:54 2022] DELETE /identity/v3/users/15ba3df494d749c0b32e713f82c13e65 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:54.354429 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9e693-76eb-4787-a4e5-63b09981cc95 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:54.354429 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9e693-76eb-4787-a4e5-63b09981cc95 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:54.354429 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9e693-76eb-4787-a4e5-63b09981cc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:54.362519 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 971/1908] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:54 2022] PUT /identity/v3/projects/7dc9f6a160004af9aede66adb17fdff6/users/61be6ebed03743579866119b2af644bf/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:54.369436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed0907-70ff-42e1-a593-7af69b62aae3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:54.369747 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed0907-70ff-42e1-a593-7af69b62aae3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:54.370010 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed0907-70ff-42e1-a593-7af69b62aae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:54.375820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-d8c9e693-76eb-4787-a4e5-63b09981cc95 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:54.377305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d8c9e693-76eb-4787-a4e5-63b09981cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:54.404100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-47ed0907-70ff-42e1-a593-7af69b62aae3 None None] MFA Rules not processed for user `61be6ebed03743579866119b2af644bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:54.406109 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-47ed0907-70ff-42e1-a593-7af69b62aae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:54.454665 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 938/1909] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:54.467141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9e693-76eb-4787-a4e5-63b09981cc95 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:54.469154 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d8c9e693-76eb-4787-a4e5-63b09981cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:54.484827 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 972/1910] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:54.490540 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed0907-70ff-42e1-a593-7af69b62aae3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:54.492963 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-47ed0907-70ff-42e1-a593-7af69b62aae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:54.530077 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed0907-70ff-42e1-a593-7af69b62aae3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:54.539814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8848f6-03b4-4907-8894-c978b7b2e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:54.540873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8848f6-03b4-4907-8894-c978b7b2e85e admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:54.541360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8848f6-03b4-4907-8894-c978b7b2e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:54.541856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:54.542493 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8848f6-03b4-4907-8894-c978b7b2e85e admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:54.543691 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8848f6-03b4-4907-8894-c978b7b2e85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:54.549279 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9e693-76eb-4787-a4e5-63b09981cc95 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:54.559212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015bbe0-2cf5-4683-9898-ea245102142c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:54.560624 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015bbe0-2cf5-4683-9898-ea245102142c service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:54.560883 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015bbe0-2cf5-4683-9898-ea245102142c service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:54.561151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015bbe0-2cf5-4683-9898-ea245102142c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:54.564952 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8848f6-03b4-4907-8894-c978b7b2e85e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:54.574844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015bbe0-2cf5-4683-9898-ea245102142c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:54.576404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015bbe0-2cf5-4683-9898-ea245102142c service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:54.589018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 939/1911] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:19:54.622402 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 973/1912] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:54 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:54.627731 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015bbe0-2cf5-4683-9898-ea245102142c service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:54.643143 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015bbe0-2cf5-4683-9898-ea245102142c service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:54.747723 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e1a47-4ae5-431d-8117-1d61536ba9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:54.748405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e1a47-4ae5-431d-8117-1d61536ba9ec admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:54.748724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e1a47-4ae5-431d-8117-1d61536ba9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:54.749000 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e1a47-4ae5-431d-8117-1d61536ba9ec admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:54.749649 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e1a47-4ae5-431d-8117-1d61536ba9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:54.751964 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e1a47-4ae5-431d-8117-1d61536ba9ec admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:54.784487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 940/1913] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:54 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:19:54.788956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8848f6-03b4-4907-8894-c978b7b2e85e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:54.807296 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8848f6-03b4-4907-8894-c978b7b2e85e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:54.812574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b91738-8c30-4a3f-9ba2-70f7930f02ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:54.813337 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b91738-8c30-4a3f-9ba2-70f7930f02ce admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:54.813611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b91738-8c30-4a3f-9ba2-70f7930f02ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:54.813939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b91738-8c30-4a3f-9ba2-70f7930f02ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:54.814581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b91738-8c30-4a3f-9ba2-70f7930f02ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:54.816364 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b91738-8c30-4a3f-9ba2-70f7930f02ce admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:54.832135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 974/1914] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:54.835372 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e1a47-4ae5-431d-8117-1d61536ba9ec admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:54.849550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e1a47-4ae5-431d-8117-1d61536ba9ec admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:54.859046 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f589fb-630d-4231-9785-f38972c57746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:54.859516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b91738-8c30-4a3f-9ba2-70f7930f02ce admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:54.859874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f589fb-630d-4231-9785-f38972c57746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:54.860152 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f589fb-630d-4231-9785-f38972c57746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:54.860535 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f589fb-630d-4231-9785-f38972c57746 admin admin] PATH_INFO: `/v3/projects/885fd6b944684f90be0771605c360c91/users/ff432328e8e04ac69d570ab36872f948/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:54.863521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-43b91738-8c30-4a3f-9ba2-70f7930f02ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:54.880880 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f589fb-630d-4231-9785-f38972c57746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=885fd6b944684f90be0771605c360c91, user_id=ff432328e8e04ac69d570ab36872f948, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:54.882294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b91738-8c30-4a3f-9ba2-70f7930f02ce admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:54.887103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f589fb-630d-4231-9785-f38972c57746 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:54.888999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c903d-fba8-4196-aafc-a39fda830fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:54.890224 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c903d-fba8-4196-aafc-a39fda830fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:54.890962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c903d-fba8-4196-aafc-a39fda830fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:54.891059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c903d-fba8-4196-aafc-a39fda830fed admin admin] PATH_INFO: `/v3/projects/9dee0758a5d14ad592c47ce21d617e32` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:54.892587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c903d-fba8-4196-aafc-a39fda830fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dee0758a5d14ad592c47ce21d617e32)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:54.894790 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c903d-fba8-4196-aafc-a39fda830fed admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:54.917604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 941/1915] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:54 2022] PUT /identity/v3/projects/885fd6b944684f90be0771605c360c91/users/ff432328e8e04ac69d570ab36872f948/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:54.922474 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f589fb-630d-4231-9785-f38972c57746 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:54.999211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fa0c903d-fba8-4196-aafc-a39fda830fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dee0758a5d14ad592c47ce21d617e32', 'request_id': 'req-fa0c903d-fba8-4196-aafc-a39fda830fed'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:55.001879 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f589fb-630d-4231-9785-f38972c57746 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:55.006393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fa0c903d-fba8-4196-aafc-a39fda830fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dee0758a5d14ad592c47ce21d617e32', 'request_id': 'req-fa0c903d-fba8-4196-aafc-a39fda830fed'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:55.018396 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fa0c903d-fba8-4196-aafc-a39fda830fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dee0758a5d14ad592c47ce21d617e32', 'request_id': 'req-fa0c903d-fba8-4196-aafc-a39fda830fed'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:55.043221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fa0c903d-fba8-4196-aafc-a39fda830fed admin admin] The token cache is being invalidate because project 9dee0758a5d14ad592c47ce21d617e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:55.043656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fa0c903d-fba8-4196-aafc-a39fda830fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:55.044434 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-fa0c903d-fba8-4196-aafc-a39fda830fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:55.049896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 975/1916] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:54 2022] DELETE /identity/v3/projects/9dee0758a5d14ad592c47ce21d617e32 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:55.049896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c903d-fba8-4196-aafc-a39fda830fed admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:55.050915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fa0c903d-fba8-4196-aafc-a39fda830fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:55.074554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:55.091521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794896a-c4d5-459b-a75e-f8096b298126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:55.093351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794896a-c4d5-459b-a75e-f8096b298126 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:55.093774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794896a-c4d5-459b-a75e-f8096b298126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:55.094126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794896a-c4d5-459b-a75e-f8096b298126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:55.094853 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794896a-c4d5-459b-a75e-f8096b298126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:55.096883 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794896a-c4d5-459b-a75e-f8096b298126 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:55.099948 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:55.109436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 942/1917] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:55.112549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe3098-eedf-4686-ad49-6ae6ad0c0150 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:55.112549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe3098-eedf-4686-ad49-6ae6ad0c0150 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:55.112549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe3098-eedf-4686-ad49-6ae6ad0c0150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:55.130126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c903d-fba8-4196-aafc-a39fda830fed admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:55.134318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-88fe3098-eedf-4686-ad49-6ae6ad0c0150 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:55.135597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a32a07-8c59-4eee-9776-431430dc7a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:55.135722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-88fe3098-eedf-4686-ad49-6ae6ad0c0150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:55.136236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a32a07-8c59-4eee-9776-431430dc7a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:55.136507 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a32a07-8c59-4eee-9776-431430dc7a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:55.136933 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a32a07-8c59-4eee-9776-431430dc7a8f admin admin] PATH_INFO: `/v3/projects/203965196a15456bae1603c6c752d2e0` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:55.138175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a32a07-8c59-4eee-9776-431430dc7a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=203965196a15456bae1603c6c752d2e0)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:55.140080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a32a07-8c59-4eee-9776-431430dc7a8f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:55.144612 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 943/1918] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:55.145372 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe3098-eedf-4686-ad49-6ae6ad0c0150 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:55.146951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-88fe3098-eedf-4686-ad49-6ae6ad0c0150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:55.159693 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe3098-eedf-4686-ad49-6ae6ad0c0150 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:55.165153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc8a53-6436-4f92-9b46-3331f585eedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:55.165944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc8a53-6436-4f92-9b46-3331f585eedb admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:55.166280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc8a53-6436-4f92-9b46-3331f585eedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:55.166613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc8a53-6436-4f92-9b46-3331f585eedb admin admin] PATH_INFO: `/v3/projects/885fd6b944684f90be0771605c360c91/users/ff432328e8e04ac69d570ab36872f948/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:55.168928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc8a53-6436-4f92-9b46-3331f585eedb admin admin] RBAC: Authorizing `identity:create_grant(project_id=885fd6b944684f90be0771605c360c91, user_id=ff432328e8e04ac69d570ab36872f948, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:55.171429 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc8a53-6436-4f92-9b46-3331f585eedb admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:55.184972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 944/1919] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:55 2022] PUT /identity/v3/projects/885fd6b944684f90be0771605c360c91/users/ff432328e8e04ac69d570ab36872f948/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:55.186204 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0b6bd-20c7-47d5-9254-a69d7bd6b1d7 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:55.186477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0b6bd-20c7-47d5-9254-a69d7bd6b1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:55.186744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0b6bd-20c7-47d5-9254-a69d7bd6b1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:55.214922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-62a32a07-8c59-4eee-9776-431430dc7a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203965196a15456bae1603c6c752d2e0', 'request_id': 'req-62a32a07-8c59-4eee-9776-431430dc7a8f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:55.223400 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-62a32a07-8c59-4eee-9776-431430dc7a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203965196a15456bae1603c6c752d2e0', 'request_id': 'req-62a32a07-8c59-4eee-9776-431430dc7a8f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:55.224374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-81c0b6bd-20c7-47d5-9254-a69d7bd6b1d7 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:55.226524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-81c0b6bd-20c7-47d5-9254-a69d7bd6b1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:55.234701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-62a32a07-8c59-4eee-9776-431430dc7a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203965196a15456bae1603c6c752d2e0', 'request_id': 'req-62a32a07-8c59-4eee-9776-431430dc7a8f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:55.250998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-62a32a07-8c59-4eee-9776-431430dc7a8f admin admin] The token cache is being invalidate because project 203965196a15456bae1603c6c752d2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:55.251698 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-62a32a07-8c59-4eee-9776-431430dc7a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:55.252759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-62a32a07-8c59-4eee-9776-431430dc7a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:55.256109 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 976/1920] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:55 2022] DELETE /identity/v3/projects/203965196a15456bae1603c6c752d2e0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:55.257838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77514e03-05fe-4ccc-8836-4b8533280200 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:55.258440 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77514e03-05fe-4ccc-8836-4b8533280200 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:55.258869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77514e03-05fe-4ccc-8836-4b8533280200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:55.298940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-77514e03-05fe-4ccc-8836-4b8533280200 None None] MFA Rules not processed for user `ff432328e8e04ac69d570ab36872f948`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:55.300373 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-77514e03-05fe-4ccc-8836-4b8533280200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:55.356844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 945/1921] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:55.359390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0b6bd-20c7-47d5-9254-a69d7bd6b1d7 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:55.362359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-81c0b6bd-20c7-47d5-9254-a69d7bd6b1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:55.390728 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0b6bd-20c7-47d5-9254-a69d7bd6b1d7 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:55.403994 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c3ea6-4d08-426c-9314-05831e434ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:55.405140 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c3ea6-4d08-426c-9314-05831e434ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:55.405662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c3ea6-4d08-426c-9314-05831e434ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:55.407021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c3ea6-4d08-426c-9314-05831e434ca6 admin admin] PATH_INFO: `/v3/users/1548a12d75b841a2a76ecfccb0cb5c05` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:55.411132 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c3ea6-4d08-426c-9314-05831e434ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1548a12d75b841a2a76ecfccb0cb5c05)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:55.415764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c3ea6-4d08-426c-9314-05831e434ca6 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:55.435894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 977/1922] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:55.436574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77514e03-05fe-4ccc-8836-4b8533280200 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:55.455068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77514e03-05fe-4ccc-8836-4b8533280200 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:55.465311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686d226-44ee-4a79-a498-2ba69bd4e5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:55.466226 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686d226-44ee-4a79-a498-2ba69bd4e5ac admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:55.466495 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686d226-44ee-4a79-a498-2ba69bd4e5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:55.466896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686d226-44ee-4a79-a498-2ba69bd4e5ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:55.467547 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686d226-44ee-4a79-a498-2ba69bd4e5ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:19:55.467853 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686d226-44ee-4a79-a498-2ba69bd4e5ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:55.471483 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686d226-44ee-4a79-a498-2ba69bd4e5ac admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:55.495843 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 978/1923] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:19:55.499046 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-451c3ea6-4d08-426c-9314-05831e434ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1548a12d75b841a2a76ecfccb0cb5c05'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:55.500805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686d226-44ee-4a79-a498-2ba69bd4e5ac admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:55.504794 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d686d226-44ee-4a79-a498-2ba69bd4e5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:55.510419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-451c3ea6-4d08-426c-9314-05831e434ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1548a12d75b841a2a76ecfccb0cb5c05'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:55.511174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-451c3ea6-4d08-426c-9314-05831e434ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1548a12d75b841a2a76ecfccb0cb5c05'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:55.526426 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-451c3ea6-4d08-426c-9314-05831e434ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1548a12d75b841a2a76ecfccb0cb5c05'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:55.537516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:55.542057 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-451c3ea6-4d08-426c-9314-05831e434ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1548a12d75b841a2a76ecfccb0cb5c05'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:55.553889 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 946/1924] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:55 2022] DELETE /identity/v3/users/1548a12d75b841a2a76ecfccb0cb5c05 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:55.556075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c3ea6-4d08-426c-9314-05831e434ca6 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:55.564605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-451c3ea6-4d08-426c-9314-05831e434ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:55.596539 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686d226-44ee-4a79-a498-2ba69bd4e5ac admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:55.647410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:55.663605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c3ea6-4d08-426c-9314-05831e434ca6 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:55.677011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea3ac-bf35-46f4-b0e2-d07843ac72da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:55.677806 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea3ac-bf35-46f4-b0e2-d07843ac72da service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:55.677998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea3ac-bf35-46f4-b0e2-d07843ac72da service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:55.678237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea3ac-bf35-46f4-b0e2-d07843ac72da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:55.678375 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafca81-706f-4b95-b5c3-e3a1b9022e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:55.679548 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafca81-706f-4b95-b5c3-e3a1b9022e67 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:55.679548 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafca81-706f-4b95-b5c3-e3a1b9022e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:55.679548 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafca81-706f-4b95-b5c3-e3a1b9022e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:55.680185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafca81-706f-4b95-b5c3-e3a1b9022e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:55.680847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-69bea3ac-bf35-46f4-b0e2-d07843ac72da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:55.682227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafca81-706f-4b95-b5c3-e3a1b9022e67 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:55.726215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 947/1925] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:55 2022] POST /identity/v3/projects => generated 391 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:55.730942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafca81-706f-4b95-b5c3-e3a1b9022e67 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:55.772660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bea3ac-bf35-46f4-b0e2-d07843ac72da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:55.781935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bea3ac-bf35-46f4-b0e2-d07843ac72da service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:55.794018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 979/1926] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:55.794887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea3ac-bf35-46f4-b0e2-d07843ac72da service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:55.796513 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-69bea3ac-bf35-46f4-b0e2-d07843ac72da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:55.810872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea3ac-bf35-46f4-b0e2-d07843ac72da service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:55.839506 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafca81-706f-4b95-b5c3-e3a1b9022e67 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:55.845733 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6ce96-f9c8-4216-b8aa-873337163949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:55.846732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6ce96-f9c8-4216-b8aa-873337163949 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:55.847245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6ce96-f9c8-4216-b8aa-873337163949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:55.847588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6ce96-f9c8-4216-b8aa-873337163949 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:55.848468 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6ce96-f9c8-4216-b8aa-873337163949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:55.850410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6ce96-f9c8-4216-b8aa-873337163949 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:55.887418 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 948/1927] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:55 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:19:55.889124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6ce96-f9c8-4216-b8aa-873337163949 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:55.915651 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6ce96-f9c8-4216-b8aa-873337163949 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:55.922388 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cfcc7-d1e8-48dc-af86-9e774bacb4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:55.923059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cfcc7-d1e8-48dc-af86-9e774bacb4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:55.923402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cfcc7-d1e8-48dc-af86-9e774bacb4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:55.923673 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cfcc7-d1e8-48dc-af86-9e774bacb4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:55.925717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cfcc7-d1e8-48dc-af86-9e774bacb4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:55.928515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cfcc7-d1e8-48dc-af86-9e774bacb4e3 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:55.959825 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263fc3b-9f89-4a79-b3e7-a92a0ae4719e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:55.960362 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263fc3b-9f89-4a79-b3e7-a92a0ae4719e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:55.960780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263fc3b-9f89-4a79-b3e7-a92a0ae4719e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:55.961246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263fc3b-9f89-4a79-b3e7-a92a0ae4719e admin admin] PATH_INFO: `/v3/users/9dfbce298e164b248264f07dce320c3a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:55.964360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263fc3b-9f89-4a79-b3e7-a92a0ae4719e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dfbce298e164b248264f07dce320c3a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:55.964693 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 949/1928] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:55.965892 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cfcc7-d1e8-48dc-af86-9e774bacb4e3 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:55.967585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263fc3b-9f89-4a79-b3e7-a92a0ae4719e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:55.969584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-890cfcc7-d1e8-48dc-af86-9e774bacb4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:56.022884 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:56.104520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f263fc3b-9f89-4a79-b3e7-a92a0ae4719e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dfbce298e164b248264f07dce320c3a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:56.125999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f263fc3b-9f89-4a79-b3e7-a92a0ae4719e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dfbce298e164b248264f07dce320c3a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:56.148634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f263fc3b-9f89-4a79-b3e7-a92a0ae4719e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dfbce298e164b248264f07dce320c3a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:56.149768 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f263fc3b-9f89-4a79-b3e7-a92a0ae4719e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dfbce298e164b248264f07dce320c3a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:56.168798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cfcc7-d1e8-48dc-af86-9e774bacb4e3 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:56.169457 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f263fc3b-9f89-4a79-b3e7-a92a0ae4719e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dfbce298e164b248264f07dce320c3a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:56.173850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb18d92-06df-4472-96b1-bdd4069610bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:56.174470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb18d92-06df-4472-96b1-bdd4069610bc service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:56.174738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb18d92-06df-4472-96b1-bdd4069610bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:56.174996 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb18d92-06df-4472-96b1-bdd4069610bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:56.177048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ddb18d92-06df-4472-96b1-bdd4069610bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:56.196351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 980/1929] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:55 2022] DELETE /identity/v3/users/9dfbce298e164b248264f07dce320c3a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:56.197571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263fc3b-9f89-4a79-b3e7-a92a0ae4719e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:56.200867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f263fc3b-9f89-4a79-b3e7-a92a0ae4719e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:56.304941 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb18d92-06df-4472-96b1-bdd4069610bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:56.306465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb18d92-06df-4472-96b1-bdd4069610bc service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:56.328762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 950/1930] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:56.329771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb18d92-06df-4472-96b1-bdd4069610bc service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:56.331697 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ddb18d92-06df-4472-96b1-bdd4069610bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:56.349990 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb18d92-06df-4472-96b1-bdd4069610bc service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:56.352828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263fc3b-9f89-4a79-b3e7-a92a0ae4719e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:56.355716 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3343e2-4344-4292-8f29-f6a82b7029e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:56.356366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3343e2-4344-4292-8f29-f6a82b7029e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:56.356638 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3343e2-4344-4292-8f29-f6a82b7029e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:56.357009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3343e2-4344-4292-8f29-f6a82b7029e0 admin admin] PATH_INFO: `/v3/projects/9c7c62bf2482494ea492a34a4e2421ff` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:56.359307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3343e2-4344-4292-8f29-f6a82b7029e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c7c62bf2482494ea492a34a4e2421ff)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:56.361322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3343e2-4344-4292-8f29-f6a82b7029e0 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:56.363167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cca3f-0e8a-4fb0-b7f7-b6f0cd44b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:56.363866 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cca3f-0e8a-4fb0-b7f7-b6f0cd44b809 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:56.364144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cca3f-0e8a-4fb0-b7f7-b6f0cd44b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:56.364434 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cca3f-0e8a-4fb0-b7f7-b6f0cd44b809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:56.365070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cca3f-0e8a-4fb0-b7f7-b6f0cd44b809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:56.365646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:56.367521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cca3f-0e8a-4fb0-b7f7-b6f0cd44b809 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:56.386658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 981/1931] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:56.386658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd032b6-de9f-4824-a47c-4de2cfa78ff9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:56.386658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd032b6-de9f-4824-a47c-4de2cfa78ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:56.386658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd032b6-de9f-4824-a47c-4de2cfa78ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:56.407172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4bd032b6-de9f-4824-a47c-4de2cfa78ff9 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:56.408563 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4bd032b6-de9f-4824-a47c-4de2cfa78ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:56.427400 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cd3343e2-4344-4292-8f29-f6a82b7029e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c7c62bf2482494ea492a34a4e2421ff', 'request_id': 'req-cd3343e2-4344-4292-8f29-f6a82b7029e0'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:56.448236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cd3343e2-4344-4292-8f29-f6a82b7029e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c7c62bf2482494ea492a34a4e2421ff', 'request_id': 'req-cd3343e2-4344-4292-8f29-f6a82b7029e0'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:56.456513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cd3343e2-4344-4292-8f29-f6a82b7029e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c7c62bf2482494ea492a34a4e2421ff', 'request_id': 'req-cd3343e2-4344-4292-8f29-f6a82b7029e0'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:56.471612 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cd3343e2-4344-4292-8f29-f6a82b7029e0 admin admin] The token cache is being invalidate because project 9c7c62bf2482494ea492a34a4e2421ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:56.472666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cd3343e2-4344-4292-8f29-f6a82b7029e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:56.473566 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cd3343e2-4344-4292-8f29-f6a82b7029e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:56.489322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 951/1932] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:56 2022] DELETE /identity/v3/projects/9c7c62bf2482494ea492a34a4e2421ff => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:56.489322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3343e2-4344-4292-8f29-f6a82b7029e0 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:56.489322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-cd3343e2-4344-4292-8f29-f6a82b7029e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:56.505056 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3343e2-4344-4292-8f29-f6a82b7029e0 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:56.513070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 982/1933] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:56.513070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191083a-9aa1-4087-b6fc-a39fc57a9435 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:56.513070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191083a-9aa1-4087-b6fc-a39fc57a9435 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:56.513862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191083a-9aa1-4087-b6fc-a39fc57a9435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:56.516711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1e5a3-a4c8-496d-84f4-54619c58b5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:56.517489 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1e5a3-a4c8-496d-84f4-54619c58b5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:56.518002 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1e5a3-a4c8-496d-84f4-54619c58b5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:56.518185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1e5a3-a4c8-496d-84f4-54619c58b5bb admin admin] PATH_INFO: `/v3/projects/040cc16eca7a4801b9d2f4f7cb47c2b9/users/fa3001d3500142d2a2a7f9a3d1f3ffee/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:56.542078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1e5a3-a4c8-496d-84f4-54619c58b5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=040cc16eca7a4801b9d2f4f7cb47c2b9, user_id=fa3001d3500142d2a2a7f9a3d1f3ffee, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:56.544769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1e5a3-a4c8-496d-84f4-54619c58b5bb admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:56.548920 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f191083a-9aa1-4087-b6fc-a39fc57a9435 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:56.556396 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f191083a-9aa1-4087-b6fc-a39fc57a9435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:56.566502 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 983/1934] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:56.570701 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 952/1935] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:56 2022] PUT /identity/v3/projects/040cc16eca7a4801b9d2f4f7cb47c2b9/users/fa3001d3500142d2a2a7f9a3d1f3ffee/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:56.571630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1e5a3-a4c8-496d-84f4-54619c58b5bb admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:56.573507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-dee1e5a3-a4c8-496d-84f4-54619c58b5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:56.575930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7028af-1200-4b9e-a488-f32abbe79c6a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:56.576442 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7028af-1200-4b9e-a488-f32abbe79c6a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:56.576762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7028af-1200-4b9e-a488-f32abbe79c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:56.622129 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1b7028af-1200-4b9e-a488-f32abbe79c6a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:56.626300 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1b7028af-1200-4b9e-a488-f32abbe79c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:56.659776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1e5a3-a4c8-496d-84f4-54619c58b5bb admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:56.664014 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f49aa7-f4db-4217-b2e7-7470ef556a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:56.664680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f49aa7-f4db-4217-b2e7-7470ef556a90 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:56.664962 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f49aa7-f4db-4217-b2e7-7470ef556a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:56.665223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f49aa7-f4db-4217-b2e7-7470ef556a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:56.674126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:56.728824 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 984/1936] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:56.734914 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e85db-0191-40c1-bdff-5603ff3f9f93 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:56.735419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e85db-0191-40c1-bdff-5603ff3f9f93 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:56.735845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e85db-0191-40c1-bdff-5603ff3f9f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:56.749102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f49aa7-f4db-4217-b2e7-7470ef556a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:56.750693 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f49aa7-f4db-4217-b2e7-7470ef556a90 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:56.763036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 953/1937] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:56.772850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f49aa7-f4db-4217-b2e7-7470ef556a90 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:56.773185 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-942e85db-0191-40c1-bdff-5603ff3f9f93 None None] MFA Rules not processed for user `fa3001d3500142d2a2a7f9a3d1f3ffee`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:56.774724 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-942e85db-0191-40c1-bdff-5603ff3f9f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:56.793821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f49aa7-f4db-4217-b2e7-7470ef556a90 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:56.800972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dfd13-e949-45fb-b17e-c6b31b3912ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:56.801230 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dfd13-e949-45fb-b17e-c6b31b3912ef admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:56.801819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dfd13-e949-45fb-b17e-c6b31b3912ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:56.802220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dfd13-e949-45fb-b17e-c6b31b3912ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:56.802934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1dfd13-e949-45fb-b17e-c6b31b3912ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:19:56.803487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1dfd13-e949-45fb-b17e-c6b31b3912ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:56.805344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1dfd13-e949-45fb-b17e-c6b31b3912ef admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:56.830207 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 954/1938] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:19:56.834758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dfd13-e949-45fb-b17e-c6b31b3912ef admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:56.843349 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:56.848847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dfd13-e949-45fb-b17e-c6b31b3912ef admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:56.858742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f5bf8-9da8-4f68-b1ca-d6a595079246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:56.860522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f5bf8-9da8-4f68-b1ca-d6a595079246 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:56.861041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f5bf8-9da8-4f68-b1ca-d6a595079246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:56.861565 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f5bf8-9da8-4f68-b1ca-d6a595079246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:56.863398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f5bf8-9da8-4f68-b1ca-d6a595079246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:56.867160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f5bf8-9da8-4f68-b1ca-d6a595079246 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:56.883930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 985/1939] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:56.893229 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e85db-0191-40c1-bdff-5603ff3f9f93 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:56.916908 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e85db-0191-40c1-bdff-5603ff3f9f93 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:56.922023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 955/1940] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:56 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:56.925981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a10c6e-eec6-421e-9ccd-f7c231b84328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:56.927466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a10c6e-eec6-421e-9ccd-f7c231b84328 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:56.927905 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a10c6e-eec6-421e-9ccd-f7c231b84328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:56.928169 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f5bf8-9da8-4f68-b1ca-d6a595079246 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:56.928480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a10c6e-eec6-421e-9ccd-f7c231b84328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:56.929371 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a10c6e-eec6-421e-9ccd-f7c231b84328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:56.932092 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a10c6e-eec6-421e-9ccd-f7c231b84328 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:56.974115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 986/1941] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:56 2022] POST /identity/v3/projects => generated 391 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:19:56.975660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a10c6e-eec6-421e-9ccd-f7c231b84328 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:57.002454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f5bf8-9da8-4f68-b1ca-d6a595079246 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:57.048080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a10c6e-eec6-421e-9ccd-f7c231b84328 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:57.053610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccab43-8533-4218-be25-86b88279ac18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:57.054253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccab43-8533-4218-be25-86b88279ac18 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:57.054537 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccab43-8533-4218-be25-86b88279ac18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:57.054807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccab43-8533-4218-be25-86b88279ac18 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:57.055424 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccab43-8533-4218-be25-86b88279ac18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:57.057449 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccab43-8533-4218-be25-86b88279ac18 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:57.069110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11072bc5-3b02-4586-b577-4b93af5c204a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:57.070241 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11072bc5-3b02-4586-b577-4b93af5c204a admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:57.070672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11072bc5-3b02-4586-b577-4b93af5c204a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:57.071201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11072bc5-3b02-4586-b577-4b93af5c204a admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:57.071938 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11072bc5-3b02-4586-b577-4b93af5c204a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:57.074206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11072bc5-3b02-4586-b577-4b93af5c204a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:57.084255 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 987/1942] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:56 2022] POST /identity/v3/users => generated 302 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:57.085219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccab43-8533-4218-be25-86b88279ac18 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:57.086973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2fccab43-8533-4218-be25-86b88279ac18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:57.098624 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 956/1943] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:56 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:57.101897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccab43-8533-4218-be25-86b88279ac18 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:57.102906 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11072bc5-3b02-4586-b577-4b93af5c204a admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:57.113322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11072bc5-3b02-4586-b577-4b93af5c204a admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:57.118411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f3375-172a-487f-b0b5-cda65cb2e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:57.119022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f3375-172a-487f-b0b5-cda65cb2e85e admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:57.119194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76acace-f8da-414e-8230-7f083023ad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:57.119807 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f3375-172a-487f-b0b5-cda65cb2e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:57.119884 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76acace-f8da-414e-8230-7f083023ad85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:57.120062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f3375-172a-487f-b0b5-cda65cb2e85e admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:57.120151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76acace-f8da-414e-8230-7f083023ad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:57.120498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76acace-f8da-414e-8230-7f083023ad85 admin admin] PATH_INFO: `/v3/projects/a6553ecdbaa84b6585f69a7240a298f5` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:57.120742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f3375-172a-487f-b0b5-cda65cb2e85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:57.122091 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76acace-f8da-414e-8230-7f083023ad85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6553ecdbaa84b6585f69a7240a298f5)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:57.122587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f3375-172a-487f-b0b5-cda65cb2e85e admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:57.124066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76acace-f8da-414e-8230-7f083023ad85 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:57.133577 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 957/1944] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:57.134592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f3375-172a-487f-b0b5-cda65cb2e85e admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:57.144774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f3375-172a-487f-b0b5-cda65cb2e85e admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:57.149668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8152be0-0274-42b5-90c4-18f4c480ab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:57.150274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8152be0-0274-42b5-90c4-18f4c480ab76 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:57.150550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8152be0-0274-42b5-90c4-18f4c480ab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:57.150847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8152be0-0274-42b5-90c4-18f4c480ab76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:57.151492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8152be0-0274-42b5-90c4-18f4c480ab76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:57.153108 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8152be0-0274-42b5-90c4-18f4c480ab76 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:57.161014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:57.165604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 958/1945] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:57.166663 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8152be0-0274-42b5-90c4-18f4c480ab76 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:57.176675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8152be0-0274-42b5-90c4-18f4c480ab76 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:57.180682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b76acace-f8da-414e-8230-7f083023ad85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6553ecdbaa84b6585f69a7240a298f5', 'request_id': 'req-b76acace-f8da-414e-8230-7f083023ad85'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:57.186325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b76acace-f8da-414e-8230-7f083023ad85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6553ecdbaa84b6585f69a7240a298f5', 'request_id': 'req-b76acace-f8da-414e-8230-7f083023ad85'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:57.194883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b76acace-f8da-414e-8230-7f083023ad85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6553ecdbaa84b6585f69a7240a298f5', 'request_id': 'req-b76acace-f8da-414e-8230-7f083023ad85'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:57.209476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b76acace-f8da-414e-8230-7f083023ad85 admin admin] The token cache is being invalidate because project a6553ecdbaa84b6585f69a7240a298f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:57.209797 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b76acace-f8da-414e-8230-7f083023ad85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:57.210558 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b76acace-f8da-414e-8230-7f083023ad85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:57.215019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 988/1946] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:57 2022] DELETE /identity/v3/projects/a6553ecdbaa84b6585f69a7240a298f5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:57.215019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76acace-f8da-414e-8230-7f083023ad85 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:57.215019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b76acace-f8da-414e-8230-7f083023ad85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:57.236708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:57.244077 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295992c6-118b-47e6-b724-d481ef0d5e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:57.245825 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295992c6-118b-47e6-b724-d481ef0d5e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:57.246338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295992c6-118b-47e6-b724-d481ef0d5e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:57.250070 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295992c6-118b-47e6-b724-d481ef0d5e87 admin admin] PATH_INFO: `/v3/projects/dbea44eebd4b48faaf7bf5b4f34d379a/users/27a850f9b14143e6aa34235f993a1a81/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:57.268507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295992c6-118b-47e6-b724-d481ef0d5e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbea44eebd4b48faaf7bf5b4f34d379a, user_id=27a850f9b14143e6aa34235f993a1a81, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:57.271244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295992c6-118b-47e6-b724-d481ef0d5e87 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:57.291591 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 959/1947] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:57 2022] PUT /identity/v3/projects/dbea44eebd4b48faaf7bf5b4f34d379a/users/27a850f9b14143e6aa34235f993a1a81/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:57.292771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295992c6-118b-47e6-b724-d481ef0d5e87 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:57.292903 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76acace-f8da-414e-8230-7f083023ad85 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:57.295445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-295992c6-118b-47e6-b724-d481ef0d5e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:57.373378 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41e3c8-d6ca-4a3d-b7fa-e2e82da5f3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:57.374059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41e3c8-d6ca-4a3d-b7fa-e2e82da5f3bb admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:57.374331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41e3c8-d6ca-4a3d-b7fa-e2e82da5f3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:57.374904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41e3c8-d6ca-4a3d-b7fa-e2e82da5f3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:57.375285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41e3c8-d6ca-4a3d-b7fa-e2e82da5f3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:57.376904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41e3c8-d6ca-4a3d-b7fa-e2e82da5f3bb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:57.381699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295992c6-118b-47e6-b724-d481ef0d5e87 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:57.386924 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de73f9f-bfae-4f7c-ab9e-189c78e9bbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:57.387727 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de73f9f-bfae-4f7c-ab9e-189c78e9bbd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:57.387909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de73f9f-bfae-4f7c-ab9e-189c78e9bbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:57.392012 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de73f9f-bfae-4f7c-ab9e-189c78e9bbd4 admin admin] PATH_INFO: `/v3/users/bed5e84e4a3740a888ebbbac2e67d511` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:57.392234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 989/1948] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:57.392234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41e3c8-d6ca-4a3d-b7fa-e2e82da5f3bb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:57.392701 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de73f9f-bfae-4f7c-ab9e-189c78e9bbd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed5e84e4a3740a888ebbbac2e67d511)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:57.394922 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de73f9f-bfae-4f7c-ab9e-189c78e9bbd4 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:57.395524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dc41e3c8-d6ca-4a3d-b7fa-e2e82da5f3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:57.427968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41e3c8-d6ca-4a3d-b7fa-e2e82da5f3bb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:57.435145 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba14ee9-cc1b-40c4-8f76-a80284064c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:57.436015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba14ee9-cc1b-40c4-8f76-a80284064c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:57.436143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba14ee9-cc1b-40c4-8f76-a80284064c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:57.436375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba14ee9-cc1b-40c4-8f76-a80284064c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:57.437037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba14ee9-cc1b-40c4-8f76-a80284064c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:57.439243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba14ee9-cc1b-40c4-8f76-a80284064c0b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:57.451441 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 990/1949] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:57.452381 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba14ee9-cc1b-40c4-8f76-a80284064c0b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:57.456066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9de73f9f-bfae-4f7c-ab9e-189c78e9bbd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed5e84e4a3740a888ebbbac2e67d511'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:57.464154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba14ee9-cc1b-40c4-8f76-a80284064c0b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:57.467159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9de73f9f-bfae-4f7c-ab9e-189c78e9bbd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed5e84e4a3740a888ebbbac2e67d511'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:57.467925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9de73f9f-bfae-4f7c-ab9e-189c78e9bbd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed5e84e4a3740a888ebbbac2e67d511'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:57.470275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a5eaf-273c-4477-9271-2171bcea982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:57.471117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a5eaf-273c-4477-9271-2171bcea982d admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:57.471392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a5eaf-273c-4477-9271-2171bcea982d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:57.471672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a5eaf-273c-4477-9271-2171bcea982d admin admin] PATH_INFO: `/v3/projects/b3d752006ef744f9b09c6fed8d71bce6/users/7e1058e220394bdbad81f81b9487d556/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:57.485126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9de73f9f-bfae-4f7c-ab9e-189c78e9bbd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed5e84e4a3740a888ebbbac2e67d511'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:57.489007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a5eaf-273c-4477-9271-2171bcea982d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d752006ef744f9b09c6fed8d71bce6, user_id=7e1058e220394bdbad81f81b9487d556, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:57.492583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a5eaf-273c-4477-9271-2171bcea982d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:57.508379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9de73f9f-bfae-4f7c-ab9e-189c78e9bbd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed5e84e4a3740a888ebbbac2e67d511'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:57.518832 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 960/1951] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:19:57 2022] DELETE /identity/v3/users/bed5e84e4a3740a888ebbbac2e67d511 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:57.518832 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de73f9f-bfae-4f7c-ab9e-189c78e9bbd4 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:57.518832 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9de73f9f-bfae-4f7c-ab9e-189c78e9bbd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:57.519807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 991/1951] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:57 2022] PUT /identity/v3/projects/b3d752006ef744f9b09c6fed8d71bce6/users/7e1058e220394bdbad81f81b9487d556/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:57.526094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6107f-adab-4bdf-9f4e-061942585d5f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:57.526632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6107f-adab-4bdf-9f4e-061942585d5f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:57.527086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6107f-adab-4bdf-9f4e-061942585d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:57.594633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-20b6107f-adab-4bdf-9f4e-061942585d5f None None] MFA Rules not processed for user `7e1058e220394bdbad81f81b9487d556`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:57.597657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-20b6107f-adab-4bdf-9f4e-061942585d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:57.629652 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:57.666705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de73f9f-bfae-4f7c-ab9e-189c78e9bbd4 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:57.672587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e9075-2ef4-4bca-8a86-7c830eb9cd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:57.673331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e9075-2ef4-4bca-8a86-7c830eb9cd15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:57.673684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e9075-2ef4-4bca-8a86-7c830eb9cd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:57.673961 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e9075-2ef4-4bca-8a86-7c830eb9cd15 admin admin] PATH_INFO: `/v3/projects/dbea44eebd4b48faaf7bf5b4f34d379a/users/27a850f9b14143e6aa34235f993a1a81/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:57.676134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e9075-2ef4-4bca-8a86-7c830eb9cd15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbea44eebd4b48faaf7bf5b4f34d379a, user_id=27a850f9b14143e6aa34235f993a1a81, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:57.679018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e9075-2ef4-4bca-8a86-7c830eb9cd15 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:57.682100 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:57.706531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 961/1952] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:57 2022] PUT /identity/v3/projects/dbea44eebd4b48faaf7bf5b4f34d379a/users/27a850f9b14143e6aa34235f993a1a81/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:57.713134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fabfe7-a686-4db4-91f4-3f6adacda551 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:57.713424 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fabfe7-a686-4db4-91f4-3f6adacda551 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:57.713719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fabfe7-a686-4db4-91f4-3f6adacda551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:57.725666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 992/1953] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:57.739463 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6107f-adab-4bdf-9f4e-061942585d5f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:57.741847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-20b6107f-adab-4bdf-9f4e-061942585d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:57.800806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-a4fabfe7-a686-4db4-91f4-3f6adacda551 None None] MFA Rules not processed for user `27a850f9b14143e6aa34235f993a1a81`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:57.804696 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a4fabfe7-a686-4db4-91f4-3f6adacda551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:57.829769 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6107f-adab-4bdf-9f4e-061942585d5f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:57.941249 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4460050-329b-4552-aa5f-0ccd45e81d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:57.949286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4460050-329b-4552-aa5f-0ccd45e81d4e service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:57.949587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4460050-329b-4552-aa5f-0ccd45e81d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:57.949876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4460050-329b-4552-aa5f-0ccd45e81d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:57.972326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 962/1954] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:58.052500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4460050-329b-4552-aa5f-0ccd45e81d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:58.054329 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4460050-329b-4552-aa5f-0ccd45e81d4e service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:58.067237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 993/1955] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:58.154505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fabfe7-a686-4db4-91f4-3f6adacda551 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:58.167628 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fabfe7-a686-4db4-91f4-3f6adacda551 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:58.180465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4460050-329b-4552-aa5f-0ccd45e81d4e service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:58.181797 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a4460050-329b-4552-aa5f-0ccd45e81d4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:58.187999 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a27f1-a35e-4e6d-a563-325a57a05c06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:58.188632 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a27f1-a35e-4e6d-a563-325a57a05c06 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:58.188900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a27f1-a35e-4e6d-a563-325a57a05c06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:58.190843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a27f1-a35e-4e6d-a563-325a57a05c06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:58.216216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a27f1-a35e-4e6d-a563-325a57a05c06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:58.219634 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a27f1-a35e-4e6d-a563-325a57a05c06 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:58.252659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:58.257788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 963/1956] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:58.361960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4460050-329b-4552-aa5f-0ccd45e81d4e service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:58.368475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8daf21d-a477-48ff-b0d1-91e7b1507003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:58.369122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8daf21d-a477-48ff-b0d1-91e7b1507003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:58.369498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8daf21d-a477-48ff-b0d1-91e7b1507003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:58.369688 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8daf21d-a477-48ff-b0d1-91e7b1507003 admin admin] PATH_INFO: `/v3/projects/16ca0bed7fae4ea893f93c5ce8a487d3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:58.370961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8daf21d-a477-48ff-b0d1-91e7b1507003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ca0bed7fae4ea893f93c5ce8a487d3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:58.372896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8daf21d-a477-48ff-b0d1-91e7b1507003 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:58.443240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a27f1-a35e-4e6d-a563-325a57a05c06 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:58.445086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d8daf21d-a477-48ff-b0d1-91e7b1507003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ca0bed7fae4ea893f93c5ce8a487d3', 'request_id': 'req-d8daf21d-a477-48ff-b0d1-91e7b1507003'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:58.452714 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d8daf21d-a477-48ff-b0d1-91e7b1507003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ca0bed7fae4ea893f93c5ce8a487d3', 'request_id': 'req-d8daf21d-a477-48ff-b0d1-91e7b1507003'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:58.462835 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a27f1-a35e-4e6d-a563-325a57a05c06 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:58.463152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d8daf21d-a477-48ff-b0d1-91e7b1507003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ca0bed7fae4ea893f93c5ce8a487d3', 'request_id': 'req-d8daf21d-a477-48ff-b0d1-91e7b1507003'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:58.477771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d8daf21d-a477-48ff-b0d1-91e7b1507003 admin admin] The token cache is being invalidate because project 16ca0bed7fae4ea893f93c5ce8a487d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:19:58.478234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d8daf21d-a477-48ff-b0d1-91e7b1507003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:58.479043 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d8daf21d-a477-48ff-b0d1-91e7b1507003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:19:58.481211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 994/1957] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:19:58 2022] DELETE /identity/v3/projects/16ca0bed7fae4ea893f93c5ce8a487d3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:58.490239 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f473a-457d-43c1-842b-be1c825cc457 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:58.490546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f473a-457d-43c1-842b-be1c825cc457 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:58.491170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f473a-457d-43c1-842b-be1c825cc457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:58.514238 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c32f473a-457d-43c1-842b-be1c825cc457 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:58.515478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c32f473a-457d-43c1-842b-be1c825cc457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:58.540111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dad71-6d4b-4e5c-b0c6-0a20f273b666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:58.541439 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dad71-6d4b-4e5c-b0c6-0a20f273b666 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:58.541839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dad71-6d4b-4e5c-b0c6-0a20f273b666 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:58.542321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dad71-6d4b-4e5c-b0c6-0a20f273b666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:58.545027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8a1dad71-6d4b-4e5c-b0c6-0a20f273b666 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:58.626584 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 995/1958] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:58.630618 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab51259-1fc1-4d5c-8df6-7207f14dcac5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:58.631515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab51259-1fc1-4d5c-8df6-7207f14dcac5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:58.632327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab51259-1fc1-4d5c-8df6-7207f14dcac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:58.655286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1dad71-6d4b-4e5c-b0c6-0a20f273b666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:58.656882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1dad71-6d4b-4e5c-b0c6-0a20f273b666 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:58.668689 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 964/1959] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:19:58.679002 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2ab51259-1fc1-4d5c-8df6-7207f14dcac5 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:58.682432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2ab51259-1fc1-4d5c-8df6-7207f14dcac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:58.697266 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 996/1960] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:19:58.701275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dad71-6d4b-4e5c-b0c6-0a20f273b666 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:58.720592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dad71-6d4b-4e5c-b0c6-0a20f273b666 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:58.733347 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de06e2c-58d5-443b-8ac7-a452798f2bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:58.734546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de06e2c-58d5-443b-8ac7-a452798f2bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:58.734889 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de06e2c-58d5-443b-8ac7-a452798f2bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:58.735312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de06e2c-58d5-443b-8ac7-a452798f2bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:58.735982 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de06e2c-58d5-443b-8ac7-a452798f2bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:19:58.738705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de06e2c-58d5-443b-8ac7-a452798f2bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:58.741842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de06e2c-58d5-443b-8ac7-a452798f2bdc admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:58.775448 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 965/1961] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:19:58.776511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab51259-1fc1-4d5c-8df6-7207f14dcac5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:58.787552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab51259-1fc1-4d5c-8df6-7207f14dcac5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:58.793435 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0390849-4bda-4cfb-9538-7673da1dc693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:58.794549 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0390849-4bda-4cfb-9538-7673da1dc693 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:58.795684 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0390849-4bda-4cfb-9538-7673da1dc693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:58.795684 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0390849-4bda-4cfb-9538-7673da1dc693 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:58.795881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0390849-4bda-4cfb-9538-7673da1dc693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:58.798215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0390849-4bda-4cfb-9538-7673da1dc693 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:58.840800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 997/1962] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:19:58 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:58.842175 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de06e2c-58d5-443b-8ac7-a452798f2bdc admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:58.858390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de06e2c-58d5-443b-8ac7-a452798f2bdc admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:58.863940 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:58.932319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23040ec6-3356-4325-8624-efd1f10c8598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:58.932951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23040ec6-3356-4325-8624-efd1f10c8598 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:58.933212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23040ec6-3356-4325-8624-efd1f10c8598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:58.933487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23040ec6-3356-4325-8624-efd1f10c8598 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:58.934171 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23040ec6-3356-4325-8624-efd1f10c8598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:58.936552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23040ec6-3356-4325-8624-efd1f10c8598 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:58.961848 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 966/1963] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:19:58 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:19:58.963167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0390849-4bda-4cfb-9538-7673da1dc693 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:58.974114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0390849-4bda-4cfb-9538-7673da1dc693 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:58.979330 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5cfe2-ba6b-426e-af0d-21e6cb679ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:58.979952 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5cfe2-ba6b-426e-af0d-21e6cb679ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:58.980230 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5cfe2-ba6b-426e-af0d-21e6cb679ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:58.980499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5cfe2-ba6b-426e-af0d-21e6cb679ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:58.981144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5cfe2-ba6b-426e-af0d-21e6cb679ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:58.982792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5cfe2-ba6b-426e-af0d-21e6cb679ba5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:58.997939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 998/1964] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:58.999516 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23040ec6-3356-4325-8624-efd1f10c8598 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:59.010931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23040ec6-3356-4325-8624-efd1f10c8598 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:59.023252 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f8a48-37b7-41e2-aad4-788a00016347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:59.024104 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8a48-37b7-41e2-aad4-788a00016347 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:59.025865 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8a48-37b7-41e2-aad4-788a00016347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:59.026324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8a48-37b7-41e2-aad4-788a00016347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:59.027139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f8a48-37b7-41e2-aad4-788a00016347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:59.028959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f8a48-37b7-41e2-aad4-788a00016347 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:59.042245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 967/1965] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:19:59.046922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5cfe2-ba6b-426e-af0d-21e6cb679ba5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:59.059581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5cfe2-ba6b-426e-af0d-21e6cb679ba5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:59.085934 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a955830-b2a2-4a9c-8fb5-62ef64e35e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:59.087095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a955830-b2a2-4a9c-8fb5-62ef64e35e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:59.087587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a955830-b2a2-4a9c-8fb5-62ef64e35e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:59.088074 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a955830-b2a2-4a9c-8fb5-62ef64e35e7a admin admin] PATH_INFO: `/v3/projects/7e8b736000564feebead556938c9212a/users/c1956f67f9b642db9bcc06271bd300b4/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:59.111210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:19:59.118154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a955830-b2a2-4a9c-8fb5-62ef64e35e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8b736000564feebead556938c9212a, user_id=c1956f67f9b642db9bcc06271bd300b4, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:59.121522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a955830-b2a2-4a9c-8fb5-62ef64e35e7a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:59.138437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 999/1966] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:19:59 2022] PUT /identity/v3/projects/7e8b736000564feebead556938c9212a/users/c1956f67f9b642db9bcc06271bd300b4/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:19:59.143626 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4af4e5-8fa9-4ca4-ad58-c4890383802d None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:59.143899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4af4e5-8fa9-4ca4-ad58-c4890383802d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:59.144193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4af4e5-8fa9-4ca4-ad58-c4890383802d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:59.165333 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-9e4af4e5-8fa9-4ca4-ad58-c4890383802d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:19:59.166666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9e4af4e5-8fa9-4ca4-ad58-c4890383802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:59.261660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 968/1967] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:19:59.270073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a955830-b2a2-4a9c-8fb5-62ef64e35e7a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:19:59.271818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5a955830-b2a2-4a9c-8fb5-62ef64e35e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:19:59.339105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a955830-b2a2-4a9c-8fb5-62ef64e35e7a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:19:59.352112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a66954-c00e-4efd-87e6-a721466ca846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:19:59.352558 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a66954-c00e-4efd-87e6-a721466ca846 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:19:59.352831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a66954-c00e-4efd-87e6-a721466ca846 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:19:59.353095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a66954-c00e-4efd-87e6-a721466ca846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:19:59.365173 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a66954-c00e-4efd-87e6-a721466ca846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:19:59.367855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a66954-c00e-4efd-87e6-a721466ca846 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:19:59.386676 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1000/1968] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:00.385248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d6dd2-a1e8-4ad3-a538-d434275a6f13 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:00.385957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d6dd2-a1e8-4ad3-a538-d434275a6f13 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:00.386339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d6dd2-a1e8-4ad3-a538-d434275a6f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:00.433912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-5a7d6dd2-a1e8-4ad3-a538-d434275a6f13 None None] MFA Rules not processed for user `c1956f67f9b642db9bcc06271bd300b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:00.438634 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5a7d6dd2-a1e8-4ad3-a538-d434275a6f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:00.595286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 969/1969] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:00.598976 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a66954-c00e-4efd-87e6-a721466ca846 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:00.617469 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a66954-c00e-4efd-87e6-a721466ca846 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:00.625156 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f3a8e-4cf4-43e6-80eb-a2210f7b413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:00.626280 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f3a8e-4cf4-43e6-80eb-a2210f7b413d admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:00.627327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f3a8e-4cf4-43e6-80eb-a2210f7b413d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:00.627807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f3a8e-4cf4-43e6-80eb-a2210f7b413d admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:00.629052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f3a8e-4cf4-43e6-80eb-a2210f7b413d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:00.631278 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f3a8e-4cf4-43e6-80eb-a2210f7b413d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:00.667230 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1001/1970] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:00 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:00.671022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d6dd2-a1e8-4ad3-a538-d434275a6f13 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:00.682242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d6dd2-a1e8-4ad3-a538-d434275a6f13 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:00.696821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:00.754437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c066209-6626-42e3-8589-032972f4e4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:00.755130 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c066209-6626-42e3-8589-032972f4e4ed admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:00.755386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c066209-6626-42e3-8589-032972f4e4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:00.755743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c066209-6626-42e3-8589-032972f4e4ed admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:00.756596 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c066209-6626-42e3-8589-032972f4e4ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:00.758763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c066209-6626-42e3-8589-032972f4e4ed admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:00.783706 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 970/1971] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:00 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:00.789038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f3a8e-4cf4-43e6-80eb-a2210f7b413d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:00.805250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f3a8e-4cf4-43e6-80eb-a2210f7b413d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:00.813314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156a4c2-cadc-4969-88dd-877977f379b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:00.814180 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156a4c2-cadc-4969-88dd-877977f379b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:00.814636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156a4c2-cadc-4969-88dd-877977f379b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:00.815447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156a4c2-cadc-4969-88dd-877977f379b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:00.816757 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156a4c2-cadc-4969-88dd-877977f379b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:00.819679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156a4c2-cadc-4969-88dd-877977f379b9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:00.840850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1002/1972] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:00.845083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c066209-6626-42e3-8589-032972f4e4ed admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:00.858227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c066209-6626-42e3-8589-032972f4e4ed admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:00.863513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff01e3-eee6-4d98-b924-94aa476c0a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:00.864303 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff01e3-eee6-4d98-b924-94aa476c0a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:00.864664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff01e3-eee6-4d98-b924-94aa476c0a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:00.864998 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff01e3-eee6-4d98-b924-94aa476c0a4e admin admin] PATH_INFO: `/v3/projects/c991ca0930ae466d8f0d4658d4d25714/users/0014fa9041b4403ab36d0b0bd4e44352/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:00.887174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff01e3-eee6-4d98-b924-94aa476c0a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c991ca0930ae466d8f0d4658d4d25714, user_id=0014fa9041b4403ab36d0b0bd4e44352, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:00.891099 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff01e3-eee6-4d98-b924-94aa476c0a4e admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:00.916138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 971/1973] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:00 2022] PUT /identity/v3/projects/c991ca0930ae466d8f0d4658d4d25714/users/0014fa9041b4403ab36d0b0bd4e44352/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:00.920369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156a4c2-cadc-4969-88dd-877977f379b9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:00.938212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156a4c2-cadc-4969-88dd-877977f379b9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:01.108040 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cca33-ad88-49ed-914e-2622ee2d6c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:01.108749 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cca33-ad88-49ed-914e-2622ee2d6c72 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:01.109069 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cca33-ad88-49ed-914e-2622ee2d6c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:01.109347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cca33-ad88-49ed-914e-2622ee2d6c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:01.110414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cca33-ad88-49ed-914e-2622ee2d6c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:01.112691 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cca33-ad88-49ed-914e-2622ee2d6c72 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:01.127301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1003/1974] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:01.131400 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff01e3-eee6-4d98-b924-94aa476c0a4e admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:01.147890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff01e3-eee6-4d98-b924-94aa476c0a4e admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:01.160199 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee42c8bb-c179-42a8-a5da-ffe5c00f42c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:01.161936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42c8bb-c179-42a8-a5da-ffe5c00f42c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:01.162300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42c8bb-c179-42a8-a5da-ffe5c00f42c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:01.162748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee42c8bb-c179-42a8-a5da-ffe5c00f42c8 admin admin] PATH_INFO: `/v3/projects/c991ca0930ae466d8f0d4658d4d25714/users/0014fa9041b4403ab36d0b0bd4e44352/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:01.166667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42c8bb-c179-42a8-a5da-ffe5c00f42c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c991ca0930ae466d8f0d4658d4d25714, user_id=0014fa9041b4403ab36d0b0bd4e44352, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:01.170469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee42c8bb-c179-42a8-a5da-ffe5c00f42c8 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:01.189029 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 972/1975] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:01 2022] PUT /identity/v3/projects/c991ca0930ae466d8f0d4658d4d25714/users/0014fa9041b4403ab36d0b0bd4e44352/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:02.415033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72df780-cdab-4823-848b-772fedb799a5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:02.416137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72df780-cdab-4823-848b-772fedb799a5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:02.416561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72df780-cdab-4823-848b-772fedb799a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:02.452217 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b72df780-cdab-4823-848b-772fedb799a5 None None] MFA Rules not processed for user `0014fa9041b4403ab36d0b0bd4e44352`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:02.453747 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b72df780-cdab-4823-848b-772fedb799a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:02.513275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:02.544677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1004/1976] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:02.556478 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a332fb-1fce-4e25-ba1a-cb66dc9dbbce None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:02.557085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a332fb-1fce-4e25-ba1a-cb66dc9dbbce None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:02.557247 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a332fb-1fce-4e25-ba1a-cb66dc9dbbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:02.578710 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-57a332fb-1fce-4e25-ba1a-cb66dc9dbbce None None] MFA Rules not processed for user `c1956f67f9b642db9bcc06271bd300b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:02.579975 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-57a332fb-1fce-4e25-ba1a-cb66dc9dbbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:02.640528 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 973/1977] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:02.652160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72df780-cdab-4823-848b-772fedb799a5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:02.653782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b72df780-cdab-4823-848b-772fedb799a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:02.729780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72df780-cdab-4823-848b-772fedb799a5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:02.736386 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434d85a-bdde-4e59-8ffa-9ac2f0804b08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:02.737656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434d85a-bdde-4e59-8ffa-9ac2f0804b08 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:02.737656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434d85a-bdde-4e59-8ffa-9ac2f0804b08 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:02.737656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434d85a-bdde-4e59-8ffa-9ac2f0804b08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:02.747289 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434d85a-bdde-4e59-8ffa-9ac2f0804b08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:02.749004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434d85a-bdde-4e59-8ffa-9ac2f0804b08 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:02.759552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1005/1978] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:03.024854 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a332fb-1fce-4e25-ba1a-cb66dc9dbbce None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:03.027064 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-57a332fb-1fce-4e25-ba1a-cb66dc9dbbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:03.189952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a332fb-1fce-4e25-ba1a-cb66dc9dbbce None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:03.199035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee03f8c-b439-4728-8d5e-3f007fada7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:03.199775 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee03f8c-b439-4728-8d5e-3f007fada7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:03.200051 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee03f8c-b439-4728-8d5e-3f007fada7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:03.200319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee03f8c-b439-4728-8d5e-3f007fada7d8 admin admin] PATH_INFO: `/v3/users/fa3001d3500142d2a2a7f9a3d1f3ffee` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:03.201859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee03f8c-b439-4728-8d5e-3f007fada7d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3001d3500142d2a2a7f9a3d1f3ffee)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:03.207253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee03f8c-b439-4728-8d5e-3f007fada7d8 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:03.224478 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:03.316039 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9ee03f8c-b439-4728-8d5e-3f007fada7d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3001d3500142d2a2a7f9a3d1f3ffee'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:03.332088 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9ee03f8c-b439-4728-8d5e-3f007fada7d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3001d3500142d2a2a7f9a3d1f3ffee'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:03.334899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9ee03f8c-b439-4728-8d5e-3f007fada7d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3001d3500142d2a2a7f9a3d1f3ffee'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:03.363736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9ee03f8c-b439-4728-8d5e-3f007fada7d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3001d3500142d2a2a7f9a3d1f3ffee'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:03.390733 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9ee03f8c-b439-4728-8d5e-3f007fada7d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3001d3500142d2a2a7f9a3d1f3ffee'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:03.406253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 974/1979] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:03 2022] DELETE /identity/v3/users/fa3001d3500142d2a2a7f9a3d1f3ffee => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:03.409547 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a071b90-efa9-4f60-aa5d-6c7c74758227 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:03.409858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a071b90-efa9-4f60-aa5d-6c7c74758227 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:03.410184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a071b90-efa9-4f60-aa5d-6c7c74758227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:03.455258 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4a071b90-efa9-4f60-aa5d-6c7c74758227 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:03.457977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4a071b90-efa9-4f60-aa5d-6c7c74758227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:03.659582 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1006/1980] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:03.666097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee03f8c-b439-4728-8d5e-3f007fada7d8 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:03.668056 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9ee03f8c-b439-4728-8d5e-3f007fada7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:03.752886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee03f8c-b439-4728-8d5e-3f007fada7d8 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:03.757001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00e7fb-0ad1-4733-ba73-3363580c81fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:03.757644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00e7fb-0ad1-4733-ba73-3363580c81fa service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:03.757947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00e7fb-0ad1-4733-ba73-3363580c81fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:03.758215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00e7fb-0ad1-4733-ba73-3363580c81fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:03.780577 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00e7fb-0ad1-4733-ba73-3363580c81fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:03.782058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00e7fb-0ad1-4733-ba73-3363580c81fa service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:03.793289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 975/1981] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:04.191654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a071b90-efa9-4f60-aa5d-6c7c74758227 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:04.193470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4a071b90-efa9-4f60-aa5d-6c7c74758227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:04.230164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a071b90-efa9-4f60-aa5d-6c7c74758227 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:04.237001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93471409-762e-4ee6-80bb-c6bf12699e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:04.237811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93471409-762e-4ee6-80bb-c6bf12699e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:04.240141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93471409-762e-4ee6-80bb-c6bf12699e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:04.241670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93471409-762e-4ee6-80bb-c6bf12699e8f admin admin] PATH_INFO: `/v3/projects/040cc16eca7a4801b9d2f4f7cb47c2b9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:04.245926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93471409-762e-4ee6-80bb-c6bf12699e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=040cc16eca7a4801b9d2f4f7cb47c2b9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:04.248830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93471409-762e-4ee6-80bb-c6bf12699e8f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:04.318491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-93471409-762e-4ee6-80bb-c6bf12699e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040cc16eca7a4801b9d2f4f7cb47c2b9', 'request_id': 'req-93471409-762e-4ee6-80bb-c6bf12699e8f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:04.324597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-93471409-762e-4ee6-80bb-c6bf12699e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040cc16eca7a4801b9d2f4f7cb47c2b9', 'request_id': 'req-93471409-762e-4ee6-80bb-c6bf12699e8f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:04.329354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:04.334906 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-93471409-762e-4ee6-80bb-c6bf12699e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040cc16eca7a4801b9d2f4f7cb47c2b9', 'request_id': 'req-93471409-762e-4ee6-80bb-c6bf12699e8f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:04.352512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-93471409-762e-4ee6-80bb-c6bf12699e8f admin admin] The token cache is being invalidate because project 040cc16eca7a4801b9d2f4f7cb47c2b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:04.352932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-93471409-762e-4ee6-80bb-c6bf12699e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:04.353586 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-93471409-762e-4ee6-80bb-c6bf12699e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:04.355398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1007/1982] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:04 2022] DELETE /identity/v3/projects/040cc16eca7a4801b9d2f4f7cb47c2b9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:04.359693 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00e7fb-0ad1-4733-ba73-3363580c81fa service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:04.370009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00e7fb-0ad1-4733-ba73-3363580c81fa service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:04.456042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0762d5f-c6a3-4b46-93f9-43b3fc011d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:04.456705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0762d5f-c6a3-4b46-93f9-43b3fc011d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:04.457126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0762d5f-c6a3-4b46-93f9-43b3fc011d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:04.457538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0762d5f-c6a3-4b46-93f9-43b3fc011d0b admin admin] PATH_INFO: `/v3/users/27a850f9b14143e6aa34235f993a1a81` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:04.459573 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0762d5f-c6a3-4b46-93f9-43b3fc011d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=27a850f9b14143e6aa34235f993a1a81)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:04.462447 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0762d5f-c6a3-4b46-93f9-43b3fc011d0b admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:04.561305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:04.593588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c0762d5f-c6a3-4b46-93f9-43b3fc011d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27a850f9b14143e6aa34235f993a1a81'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:04.608337 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c0762d5f-c6a3-4b46-93f9-43b3fc011d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27a850f9b14143e6aa34235f993a1a81'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:04.609928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c0762d5f-c6a3-4b46-93f9-43b3fc011d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27a850f9b14143e6aa34235f993a1a81'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:04.625179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c0762d5f-c6a3-4b46-93f9-43b3fc011d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27a850f9b14143e6aa34235f993a1a81'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:04.640791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c0762d5f-c6a3-4b46-93f9-43b3fc011d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27a850f9b14143e6aa34235f993a1a81'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:04.649357 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 976/1983] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:04 2022] DELETE /identity/v3/users/27a850f9b14143e6aa34235f993a1a81 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:04.899177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93471409-762e-4ee6-80bb-c6bf12699e8f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:04.901449 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-93471409-762e-4ee6-80bb-c6bf12699e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:04.916320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93471409-762e-4ee6-80bb-c6bf12699e8f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:05.079350 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1d6c3-3d32-48d4-918c-4aa894b9771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:05.079350 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1d6c3-3d32-48d4-918c-4aa894b9771e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:05.079350 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1d6c3-3d32-48d4-918c-4aa894b9771e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:05.079985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1d6c3-3d32-48d4-918c-4aa894b9771e admin admin] PATH_INFO: `/v3/users/61be6ebed03743579866119b2af644bf` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:05.081079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1d6c3-3d32-48d4-918c-4aa894b9771e admin admin] RBAC: Authorizing `identity:delete_user(user_id=61be6ebed03743579866119b2af644bf)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:05.083183 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1d6c3-3d32-48d4-918c-4aa894b9771e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:05.169558 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c3f1d6c3-3d32-48d4-918c-4aa894b9771e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61be6ebed03743579866119b2af644bf'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:05.182247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c3f1d6c3-3d32-48d4-918c-4aa894b9771e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61be6ebed03743579866119b2af644bf'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:05.213359 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c3f1d6c3-3d32-48d4-918c-4aa894b9771e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61be6ebed03743579866119b2af644bf'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:05.214496 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c3f1d6c3-3d32-48d4-918c-4aa894b9771e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61be6ebed03743579866119b2af644bf'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:05.249578 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c3f1d6c3-3d32-48d4-918c-4aa894b9771e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61be6ebed03743579866119b2af644bf'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:05.250059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0762d5f-c6a3-4b46-93f9-43b3fc011d0b admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:05.251674 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c0762d5f-c6a3-4b46-93f9-43b3fc011d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:05.263254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1008/1984] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:04 2022] DELETE /identity/v3/users/61be6ebed03743579866119b2af644bf => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:05.267727 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a53ad-1ac5-4f28-8eee-91c989ae4182 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:05.268111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a53ad-1ac5-4f28-8eee-91c989ae4182 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:05.268486 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a53ad-1ac5-4f28-8eee-91c989ae4182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:05.286714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0762d5f-c6a3-4b46-93f9-43b3fc011d0b admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:05.350585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-df7a53ad-1ac5-4f28-8eee-91c989ae4182 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:05.356393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-df7a53ad-1ac5-4f28-8eee-91c989ae4182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:05.387633 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560400d-5585-43b4-8aa1-1cb8098c2bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:05.389293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560400d-5585-43b4-8aa1-1cb8098c2bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:05.389660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560400d-5585-43b4-8aa1-1cb8098c2bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:05.390110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560400d-5585-43b4-8aa1-1cb8098c2bdd admin admin] PATH_INFO: `/v3/projects/dbea44eebd4b48faaf7bf5b4f34d379a` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:05.391715 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560400d-5585-43b4-8aa1-1cb8098c2bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbea44eebd4b48faaf7bf5b4f34d379a)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:05.394396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560400d-5585-43b4-8aa1-1cb8098c2bdd admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:05.504140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1009/1985] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:05.505178 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a53ad-1ac5-4f28-8eee-91c989ae4182 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:05.506308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7560400d-5585-43b4-8aa1-1cb8098c2bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbea44eebd4b48faaf7bf5b4f34d379a', 'request_id': 'req-7560400d-5585-43b4-8aa1-1cb8098c2bdd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:05.509598 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-df7a53ad-1ac5-4f28-8eee-91c989ae4182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:05.522562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7560400d-5585-43b4-8aa1-1cb8098c2bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbea44eebd4b48faaf7bf5b4f34d379a', 'request_id': 'req-7560400d-5585-43b4-8aa1-1cb8098c2bdd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:05.534808 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7560400d-5585-43b4-8aa1-1cb8098c2bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbea44eebd4b48faaf7bf5b4f34d379a', 'request_id': 'req-7560400d-5585-43b4-8aa1-1cb8098c2bdd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:05.546557 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:05.552471 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7560400d-5585-43b4-8aa1-1cb8098c2bdd admin admin] The token cache is being invalidate because project dbea44eebd4b48faaf7bf5b4f34d379a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:05.552954 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7560400d-5585-43b4-8aa1-1cb8098c2bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:05.562784 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7560400d-5585-43b4-8aa1-1cb8098c2bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:05.568264 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 977/1986] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:05 2022] DELETE /identity/v3/projects/dbea44eebd4b48faaf7bf5b4f34d379a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:05.573760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231c9e3-0ddc-4564-86d4-b025c5dd709e None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:05.574174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231c9e3-0ddc-4564-86d4-b025c5dd709e None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:05.574510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231c9e3-0ddc-4564-86d4-b025c5dd709e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:05.617898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-3231c9e3-0ddc-4564-86d4-b025c5dd709e None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:05.619327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a53ad-1ac5-4f28-8eee-91c989ae4182 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:05.620823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3231c9e3-0ddc-4564-86d4-b025c5dd709e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:05.720840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:05.723646 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91597837-e35c-4519-961c-d2a98acf1b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:05.724354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91597837-e35c-4519-961c-d2a98acf1b62 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:05.724696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91597837-e35c-4519-961c-d2a98acf1b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:05.725028 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91597837-e35c-4519-961c-d2a98acf1b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:05.757041 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-91597837-e35c-4519-961c-d2a98acf1b62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:05.773556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 978/1987] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:05.779045 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91597837-e35c-4519-961c-d2a98acf1b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:05.782217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69452e94-5037-4487-b3c6-e3abeac5df28 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:05.782500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69452e94-5037-4487-b3c6-e3abeac5df28 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:05.782776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69452e94-5037-4487-b3c6-e3abeac5df28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:05.786291 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91597837-e35c-4519-961c-d2a98acf1b62 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:05.798635 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1010/1988] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:05.814577 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-69452e94-5037-4487-b3c6-e3abeac5df28 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:05.815839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-69452e94-5037-4487-b3c6-e3abeac5df28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:05.825483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 979/1989] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:05.829941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91597837-e35c-4519-961c-d2a98acf1b62 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:05.840066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91597837-e35c-4519-961c-d2a98acf1b62 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:05.845891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72f148-f844-4c88-8547-bd7efba2b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:05.847440 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72f148-f844-4c88-8547-bd7efba2b055 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:05.847440 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72f148-f844-4c88-8547-bd7efba2b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:05.847736 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72f148-f844-4c88-8547-bd7efba2b055 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:05.848297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72f148-f844-4c88-8547-bd7efba2b055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:20:05.848601 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72f148-f844-4c88-8547-bd7efba2b055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:05.850478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72f148-f844-4c88-8547-bd7efba2b055 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:05.869991 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1011/1990] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:20:05.871271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69452e94-5037-4487-b3c6-e3abeac5df28 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:05.888724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69452e94-5037-4487-b3c6-e3abeac5df28 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:05.900228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271683c8-334b-4d08-8d18-66b041e8b200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:05.900980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271683c8-334b-4d08-8d18-66b041e8b200 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:05.901249 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271683c8-334b-4d08-8d18-66b041e8b200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:05.901521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271683c8-334b-4d08-8d18-66b041e8b200 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:05.903324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271683c8-334b-4d08-8d18-66b041e8b200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:05.907653 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271683c8-334b-4d08-8d18-66b041e8b200 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:05.958779 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 980/1991] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:05 2022] POST /identity/v3/projects => generated 407 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:05.962991 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72f148-f844-4c88-8547-bd7efba2b055 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:05.974602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72f148-f844-4c88-8547-bd7efba2b055 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:06.083833 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c87f8e-ed11-4b95-ad39-fed044b78bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:06.084589 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c87f8e-ed11-4b95-ad39-fed044b78bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:06.084958 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c87f8e-ed11-4b95-ad39-fed044b78bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:06.085545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c87f8e-ed11-4b95-ad39-fed044b78bcf admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:06.086754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c87f8e-ed11-4b95-ad39-fed044b78bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:06.089648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c87f8e-ed11-4b95-ad39-fed044b78bcf admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:06.126175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1012/1992] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:05 2022] POST /identity/v3/users => generated 304 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:06.130420 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271683c8-334b-4d08-8d18-66b041e8b200 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:06.149310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271683c8-334b-4d08-8d18-66b041e8b200 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:06.159709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43cbf7-940f-43c7-9cc5-6e13af86e064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:06.162506 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43cbf7-940f-43c7-9cc5-6e13af86e064 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:06.163060 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43cbf7-940f-43c7-9cc5-6e13af86e064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:06.163664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43cbf7-940f-43c7-9cc5-6e13af86e064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:06.164566 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43cbf7-940f-43c7-9cc5-6e13af86e064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:06.166815 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43cbf7-940f-43c7-9cc5-6e13af86e064 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:06.204140 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 981/1993] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:20:06.207964 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c87f8e-ed11-4b95-ad39-fed044b78bcf admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:06.224564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c87f8e-ed11-4b95-ad39-fed044b78bcf admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:06.238672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e36b6-395b-45f4-a8cb-58c742c8d0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:06.242017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e36b6-395b-45f4-a8cb-58c742c8d0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:06.242628 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e36b6-395b-45f4-a8cb-58c742c8d0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:06.243876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e36b6-395b-45f4-a8cb-58c742c8d0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:06.250820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e36b6-395b-45f4-a8cb-58c742c8d0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:06.254616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e36b6-395b-45f4-a8cb-58c742c8d0d3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:06.303080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1013/1994] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:06.304949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43cbf7-940f-43c7-9cc5-6e13af86e064 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:06.317903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43cbf7-940f-43c7-9cc5-6e13af86e064 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:06.325583 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26473ee2-04f7-4800-9027-bb44b116894a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:06.326771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26473ee2-04f7-4800-9027-bb44b116894a admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:06.327295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26473ee2-04f7-4800-9027-bb44b116894a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:06.327793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26473ee2-04f7-4800-9027-bb44b116894a admin admin] PATH_INFO: `/v3/projects/9e0c912bc61b404ba6594796f7483c9e/users/b0cc1e6b713a4ff488f45c254300b9cd/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:06.347746 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26473ee2-04f7-4800-9027-bb44b116894a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0c912bc61b404ba6594796f7483c9e, user_id=b0cc1e6b713a4ff488f45c254300b9cd, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:06.353836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26473ee2-04f7-4800-9027-bb44b116894a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:06.384418 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 982/1995] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:06 2022] PUT /identity/v3/projects/9e0c912bc61b404ba6594796f7483c9e/users/b0cc1e6b713a4ff488f45c254300b9cd/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:06.398631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb23a38-6a5d-4d63-a5c4-b94722593b43 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:06.398995 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb23a38-6a5d-4d63-a5c4-b94722593b43 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:06.399248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb23a38-6a5d-4d63-a5c4-b94722593b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:06.452561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0bb23a38-6a5d-4d63-a5c4-b94722593b43 None None] MFA Rules not processed for user `b0cc1e6b713a4ff488f45c254300b9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:06.454277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0bb23a38-6a5d-4d63-a5c4-b94722593b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:06.485898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:06.561668 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1014/1996] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:06 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:06.565590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26473ee2-04f7-4800-9027-bb44b116894a admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:06.656981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb23a38-6a5d-4d63-a5c4-b94722593b43 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:06.659056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0bb23a38-6a5d-4d63-a5c4-b94722593b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:06.712225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26473ee2-04f7-4800-9027-bb44b116894a admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:06.738515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a6862-94b6-46e9-b20e-2fc0e82009af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:06.741264 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a6862-94b6-46e9-b20e-2fc0e82009af admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:06.741537 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a6862-94b6-46e9-b20e-2fc0e82009af admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:06.741832 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a6862-94b6-46e9-b20e-2fc0e82009af admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:06.749650 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a6862-94b6-46e9-b20e-2fc0e82009af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:06.750645 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb23a38-6a5d-4d63-a5c4-b94722593b43 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:06.753502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a6862-94b6-46e9-b20e-2fc0e82009af admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:06.756280 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4f1f9-c94f-4559-8715-684ebe8909aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:06.756992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4f1f9-c94f-4559-8715-684ebe8909aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:06.757424 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4f1f9-c94f-4559-8715-684ebe8909aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:06.757733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4f1f9-c94f-4559-8715-684ebe8909aa admin admin] PATH_INFO: `/v3/projects/7dc9f6a160004af9aede66adb17fdff6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:06.759166 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4f1f9-c94f-4559-8715-684ebe8909aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc9f6a160004af9aede66adb17fdff6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:06.761479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4f1f9-c94f-4559-8715-684ebe8909aa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:06.806705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 983/1997] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:06 2022] POST /identity/v3/projects => generated 407 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:06.810919 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a6862-94b6-46e9-b20e-2fc0e82009af admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:06.848866 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5bb4f1f9-c94f-4559-8715-684ebe8909aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc9f6a160004af9aede66adb17fdff6', 'request_id': 'req-5bb4f1f9-c94f-4559-8715-684ebe8909aa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:06.860730 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5bb4f1f9-c94f-4559-8715-684ebe8909aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc9f6a160004af9aede66adb17fdff6', 'request_id': 'req-5bb4f1f9-c94f-4559-8715-684ebe8909aa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:06.871780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5bb4f1f9-c94f-4559-8715-684ebe8909aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc9f6a160004af9aede66adb17fdff6', 'request_id': 'req-5bb4f1f9-c94f-4559-8715-684ebe8909aa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:06.892683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5bb4f1f9-c94f-4559-8715-684ebe8909aa admin admin] The token cache is being invalidate because project 7dc9f6a160004af9aede66adb17fdff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:06.893138 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5bb4f1f9-c94f-4559-8715-684ebe8909aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:06.894867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5bb4f1f9-c94f-4559-8715-684ebe8909aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:06.902097 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1015/1998] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:06 2022] DELETE /identity/v3/projects/7dc9f6a160004af9aede66adb17fdff6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:06.907172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4f1f9-c94f-4559-8715-684ebe8909aa admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:06.908975 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5bb4f1f9-c94f-4559-8715-684ebe8909aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:06.922863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a6862-94b6-46e9-b20e-2fc0e82009af admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:06.935102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:07.039578 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:07.047910 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4f1f9-c94f-4559-8715-684ebe8909aa admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:07.057269 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c84464-a60d-491f-b098-1c12c923cdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:07.061281 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c84464-a60d-491f-b098-1c12c923cdc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:07.061527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c84464-a60d-491f-b098-1c12c923cdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:07.061883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c84464-a60d-491f-b098-1c12c923cdc8 admin admin] PATH_INFO: `/v3/users/ff432328e8e04ac69d570ab36872f948` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:07.065106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c84464-a60d-491f-b098-1c12c923cdc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff432328e8e04ac69d570ab36872f948)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:07.071084 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c84464-a60d-491f-b098-1c12c923cdc8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:07.112314 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d18b9-baba-4ce9-b351-01941100bf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:07.114055 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d18b9-baba-4ce9-b351-01941100bf08 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:07.119738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d18b9-baba-4ce9-b351-01941100bf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:07.120255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d18b9-baba-4ce9-b351-01941100bf08 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:07.122512 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d18b9-baba-4ce9-b351-01941100bf08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:07.133645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d18b9-baba-4ce9-b351-01941100bf08 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:07.185566 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 984/1999] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:06 2022] POST /identity/v3/users => generated 310 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:07.187503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d18b9-baba-4ce9-b351-01941100bf08 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:07.190764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-460d18b9-baba-4ce9-b351-01941100bf08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:07.196486 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f7c84464-a60d-491f-b098-1c12c923cdc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff432328e8e04ac69d570ab36872f948'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:07.207089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d18b9-baba-4ce9-b351-01941100bf08 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:07.213434 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68261749-9232-4af2-8551-f6ad0d4e317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:07.214105 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68261749-9232-4af2-8551-f6ad0d4e317b admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:07.214377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68261749-9232-4af2-8551-f6ad0d4e317b admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:07.214643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68261749-9232-4af2-8551-f6ad0d4e317b admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:07.215323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f7c84464-a60d-491f-b098-1c12c923cdc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff432328e8e04ac69d570ab36872f948'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:07.215436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68261749-9232-4af2-8551-f6ad0d4e317b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:07.218055 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68261749-9232-4af2-8551-f6ad0d4e317b admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:07.238205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 985/2000] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:20:07.239702 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68261749-9232-4af2-8551-f6ad0d4e317b admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:07.252115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f7c84464-a60d-491f-b098-1c12c923cdc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff432328e8e04ac69d570ab36872f948'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:07.253204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f7c84464-a60d-491f-b098-1c12c923cdc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff432328e8e04ac69d570ab36872f948'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:07.263512 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68261749-9232-4af2-8551-f6ad0d4e317b admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:07.270719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f7c84464-a60d-491f-b098-1c12c923cdc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff432328e8e04ac69d570ab36872f948'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:07.280417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e35354-7ce0-446e-8c51-4a6b680e374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:07.281237 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e35354-7ce0-446e-8c51-4a6b680e374d admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:07.282171 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e35354-7ce0-446e-8c51-4a6b680e374d admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:07.283191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1016/2001] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:06 2022] DELETE /identity/v3/users/ff432328e8e04ac69d570ab36872f948 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:07.294015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e35354-7ce0-446e-8c51-4a6b680e374d admin admin] PATH_INFO: `/v3/projects/51deaea50f7b4524a7ca08245e85c57b/users/dbc2757a9a4844dfb5de61db0f59220c/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:07.325396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e35354-7ce0-446e-8c51-4a6b680e374d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51deaea50f7b4524a7ca08245e85c57b, user_id=dbc2757a9a4844dfb5de61db0f59220c, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:07.328785 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e35354-7ce0-446e-8c51-4a6b680e374d admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:07.353325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 986/2002] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:07 2022] PUT /identity/v3/projects/51deaea50f7b4524a7ca08245e85c57b/users/dbc2757a9a4844dfb5de61db0f59220c/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:07.357732 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c84464-a60d-491f-b098-1c12c923cdc8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:07.359356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f7c84464-a60d-491f-b098-1c12c923cdc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:07.466470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c84464-a60d-491f-b098-1c12c923cdc8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:07.565353 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570d0b4-ee28-4e97-93c2-3c167f02f95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:07.566202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570d0b4-ee28-4e97-93c2-3c167f02f95c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:07.566602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570d0b4-ee28-4e97-93c2-3c167f02f95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:07.567650 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570d0b4-ee28-4e97-93c2-3c167f02f95c admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:07.568433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570d0b4-ee28-4e97-93c2-3c167f02f95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:07.571438 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570d0b4-ee28-4e97-93c2-3c167f02f95c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:07.598213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1017/2003] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:07.603255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e35354-7ce0-446e-8c51-4a6b680e374d admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:07.630957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e35354-7ce0-446e-8c51-4a6b680e374d admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:07.642071 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fb063-0eae-4f76-8da5-43c4e3813502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:07.642844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb063-0eae-4f76-8da5-43c4e3813502 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:07.643387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb063-0eae-4f76-8da5-43c4e3813502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:07.643790 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb063-0eae-4f76-8da5-43c4e3813502 admin admin] PATH_INFO: `/v3/projects/51deaea50f7b4524a7ca08245e85c57b/users/dbc2757a9a4844dfb5de61db0f59220c/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:07.647496 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fb063-0eae-4f76-8da5-43c4e3813502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51deaea50f7b4524a7ca08245e85c57b, user_id=dbc2757a9a4844dfb5de61db0f59220c, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:07.651659 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fb063-0eae-4f76-8da5-43c4e3813502 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:07.671360 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 987/2004] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:07 2022] PUT /identity/v3/projects/51deaea50f7b4524a7ca08245e85c57b/users/dbc2757a9a4844dfb5de61db0f59220c/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:07.706732 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf21dd6-b26e-4791-9e8b-10886d666662 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:07.709743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf21dd6-b26e-4791-9e8b-10886d666662 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:07.710963 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf21dd6-b26e-4791-9e8b-10886d666662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:07.759554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fcf21dd6-b26e-4791-9e8b-10886d666662 None None] MFA Rules not processed for user `dbc2757a9a4844dfb5de61db0f59220c`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:07.761305 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fcf21dd6-b26e-4791-9e8b-10886d666662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:07.771285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:07.869730 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1018/2005] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:07 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:07.883725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fb063-0eae-4f76-8da5-43c4e3813502 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:07.886366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-465fb063-0eae-4f76-8da5-43c4e3813502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:07.994962 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fb063-0eae-4f76-8da5-43c4e3813502 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:07.998541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ae478-a0b6-4f13-aad7-4a0c5505adc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:07.999415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ae478-a0b6-4f13-aad7-4a0c5505adc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:07.999792 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ae478-a0b6-4f13-aad7-4a0c5505adc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:08.000200 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ae478-a0b6-4f13-aad7-4a0c5505adc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:08.012969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ae478-a0b6-4f13-aad7-4a0c5505adc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:08.015582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ae478-a0b6-4f13-aad7-4a0c5505adc2 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:08.064378 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 988/2006] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:07 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:08.095297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf21dd6-b26e-4791-9e8b-10886d666662 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:08.100103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fcf21dd6-b26e-4791-9e8b-10886d666662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:08.279863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf21dd6-b26e-4791-9e8b-10886d666662 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:08.310149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f82aad-03f5-4b1c-ae0a-cc0e3106f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:08.310842 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f82aad-03f5-4b1c-ae0a-cc0e3106f882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:08.311127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f82aad-03f5-4b1c-ae0a-cc0e3106f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:08.311406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f82aad-03f5-4b1c-ae0a-cc0e3106f882 admin admin] PATH_INFO: `/v3/projects/885fd6b944684f90be0771605c360c91` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:08.316873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f82aad-03f5-4b1c-ae0a-cc0e3106f882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=885fd6b944684f90be0771605c360c91)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:08.318875 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f82aad-03f5-4b1c-ae0a-cc0e3106f882 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:08.365138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ae478-a0b6-4f13-aad7-4a0c5505adc2 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:08.377348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ae478-a0b6-4f13-aad7-4a0c5505adc2 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:08.383534 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69506ae-6052-4dfb-9004-8ed2180b5203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:08.384924 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69506ae-6052-4dfb-9004-8ed2180b5203 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:08.386167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69506ae-6052-4dfb-9004-8ed2180b5203 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:08.386683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69506ae-6052-4dfb-9004-8ed2180b5203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:08.389656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d69506ae-6052-4dfb-9004-8ed2180b5203 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:08.466526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e9f82aad-03f5-4b1c-ae0a-cc0e3106f882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '885fd6b944684f90be0771605c360c91', 'request_id': 'req-e9f82aad-03f5-4b1c-ae0a-cc0e3106f882'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:08.475243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e9f82aad-03f5-4b1c-ae0a-cc0e3106f882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '885fd6b944684f90be0771605c360c91', 'request_id': 'req-e9f82aad-03f5-4b1c-ae0a-cc0e3106f882'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:08.491235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e9f82aad-03f5-4b1c-ae0a-cc0e3106f882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '885fd6b944684f90be0771605c360c91', 'request_id': 'req-e9f82aad-03f5-4b1c-ae0a-cc0e3106f882'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:08.493021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:08.497587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69506ae-6052-4dfb-9004-8ed2180b5203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:08.500134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69506ae-6052-4dfb-9004-8ed2180b5203 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:08.505732 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e9f82aad-03f5-4b1c-ae0a-cc0e3106f882 admin admin] The token cache is being invalidate because project 885fd6b944684f90be0771605c360c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:08.505959 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e9f82aad-03f5-4b1c-ae0a-cc0e3106f882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:08.507207 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e9f82aad-03f5-4b1c-ae0a-cc0e3106f882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:08.524966 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1019/2007] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:08 2022] DELETE /identity/v3/projects/885fd6b944684f90be0771605c360c91 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:08.528609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d5793-0c36-4a37-b36f-df956cdc9cf8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:08.528609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d5793-0c36-4a37-b36f-df956cdc9cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:08.529014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d5793-0c36-4a37-b36f-df956cdc9cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:08.571770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 989/2008] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:08 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:20:08.572361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-403d5793-0c36-4a37-b36f-df956cdc9cf8 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:08.574743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-403d5793-0c36-4a37-b36f-df956cdc9cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:08.663649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:08.722100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1020/2009] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:08.729864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6887db7-6853-48b7-9a18-13da21b976f5 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:08.730149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6887db7-6853-48b7-9a18-13da21b976f5 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:08.730444 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6887db7-6853-48b7-9a18-13da21b976f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:08.776453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-e6887db7-6853-48b7-9a18-13da21b976f5 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:08.776453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e6887db7-6853-48b7-9a18-13da21b976f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:08.798024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 990/2010] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:08.798956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d5793-0c36-4a37-b36f-df956cdc9cf8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:08.814370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d5793-0c36-4a37-b36f-df956cdc9cf8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:08.822347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89f8fb-80ee-4581-af64-561485d47a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:08.823164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89f8fb-80ee-4581-af64-561485d47a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:08.823448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89f8fb-80ee-4581-af64-561485d47a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:08.823719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89f8fb-80ee-4581-af64-561485d47a45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:08.824454 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89f8fb-80ee-4581-af64-561485d47a45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:20:08.824900 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89f8fb-80ee-4581-af64-561485d47a45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:08.826925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89f8fb-80ee-4581-af64-561485d47a45 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:08.851408 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1021/2011] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:20:08.854590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6887db7-6853-48b7-9a18-13da21b976f5 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:08.866515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6887db7-6853-48b7-9a18-13da21b976f5 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:08.872121 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39030247-b137-4f71-9fc3-f23c89337776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:08.873376 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39030247-b137-4f71-9fc3-f23c89337776 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:08.873376 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39030247-b137-4f71-9fc3-f23c89337776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:08.874386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39030247-b137-4f71-9fc3-f23c89337776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:08.876201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39030247-b137-4f71-9fc3-f23c89337776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:08.877798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39030247-b137-4f71-9fc3-f23c89337776 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:08.922387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 991/2012] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:08 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:08.929826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89f8fb-80ee-4581-af64-561485d47a45 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:08.956390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89f8fb-80ee-4581-af64-561485d47a45 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:09.110882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a962fb2-0d9c-4a42-ab22-f021be257037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:09.111572 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a962fb2-0d9c-4a42-ab22-f021be257037 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:09.111825 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a962fb2-0d9c-4a42-ab22-f021be257037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:09.112157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a962fb2-0d9c-4a42-ab22-f021be257037 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:09.113851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a962fb2-0d9c-4a42-ab22-f021be257037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:09.116804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a962fb2-0d9c-4a42-ab22-f021be257037 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:09.191067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1022/2013] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:08 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:09.193534 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39030247-b137-4f71-9fc3-f23c89337776 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:09.206461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39030247-b137-4f71-9fc3-f23c89337776 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:09.211900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298e6e4-93d1-4193-ab73-2ff2f518d358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:09.212559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298e6e4-93d1-4193-ab73-2ff2f518d358 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:09.212828 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298e6e4-93d1-4193-ab73-2ff2f518d358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:09.213267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298e6e4-93d1-4193-ab73-2ff2f518d358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:09.213968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298e6e4-93d1-4193-ab73-2ff2f518d358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:09.216088 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298e6e4-93d1-4193-ab73-2ff2f518d358 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:09.230506 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 992/2014] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:20:09.233929 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a962fb2-0d9c-4a42-ab22-f021be257037 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:09.252736 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a962fb2-0d9c-4a42-ab22-f021be257037 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:09.261882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab11e0-e2da-463f-80d8-29952f8b94ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:09.262676 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab11e0-e2da-463f-80d8-29952f8b94ee admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:09.262955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab11e0-e2da-463f-80d8-29952f8b94ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:09.263261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab11e0-e2da-463f-80d8-29952f8b94ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:09.263983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab11e0-e2da-463f-80d8-29952f8b94ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:09.266882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab11e0-e2da-463f-80d8-29952f8b94ee admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:09.290928 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1023/2015] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:09.295200 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298e6e4-93d1-4193-ab73-2ff2f518d358 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:09.310269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298e6e4-93d1-4193-ab73-2ff2f518d358 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:09.317662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4704d3a-65ff-45e7-986f-598a5434dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:09.318251 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704d3a-65ff-45e7-986f-598a5434dd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:09.318540 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704d3a-65ff-45e7-986f-598a5434dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:09.318810 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704d3a-65ff-45e7-986f-598a5434dd56 admin admin] PATH_INFO: `/v3/projects/f524371d467549d9bc01f8171a57989b/users/c0b4042ab16d445c8222c6bdea91fa8d/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:09.353290 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4704d3a-65ff-45e7-986f-598a5434dd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f524371d467549d9bc01f8171a57989b, user_id=c0b4042ab16d445c8222c6bdea91fa8d, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:09.356338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4704d3a-65ff-45e7-986f-598a5434dd56 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:09.377370 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 993/2016] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:09 2022] PUT /identity/v3/projects/f524371d467549d9bc01f8171a57989b/users/c0b4042ab16d445c8222c6bdea91fa8d/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:09.388675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3acf8-b42a-438f-be35-36cdf5f3b1d8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:09.389061 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3acf8-b42a-438f-be35-36cdf5f3b1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:09.390187 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3acf8-b42a-438f-be35-36cdf5f3b1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:09.431642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8cb3acf8-b42a-438f-be35-36cdf5f3b1d8 None None] MFA Rules not processed for user `c0b4042ab16d445c8222c6bdea91fa8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:09.432868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8cb3acf8-b42a-438f-be35-36cdf5f3b1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:09.514390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1024/2017] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:09.515287 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4704d3a-65ff-45e7-986f-598a5434dd56 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:09.614129 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4704d3a-65ff-45e7-986f-598a5434dd56 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:09.621021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34977da9-adbf-481a-9b04-625c2dfaad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:09.621817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34977da9-adbf-481a-9b04-625c2dfaad08 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:09.622183 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34977da9-adbf-481a-9b04-625c2dfaad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:09.622538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34977da9-adbf-481a-9b04-625c2dfaad08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:09.623293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34977da9-adbf-481a-9b04-625c2dfaad08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:09.625712 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34977da9-adbf-481a-9b04-625c2dfaad08 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:09.666662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 994/2018] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:09 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:09.670411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3acf8-b42a-438f-be35-36cdf5f3b1d8 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:09.686654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3acf8-b42a-438f-be35-36cdf5f3b1d8 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:09.725213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:09.802409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a791f-ad05-419c-b99a-20cf99fbc313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:09.803391 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a791f-ad05-419c-b99a-20cf99fbc313 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:09.805021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a791f-ad05-419c-b99a-20cf99fbc313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:09.805767 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a791f-ad05-419c-b99a-20cf99fbc313 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:09.807277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a791f-ad05-419c-b99a-20cf99fbc313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:09.813838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a791f-ad05-419c-b99a-20cf99fbc313 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:09.876490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1025/2019] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:09 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:09.880639 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34977da9-adbf-481a-9b04-625c2dfaad08 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:09.896468 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34977da9-adbf-481a-9b04-625c2dfaad08 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:09.904776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a8dfa-c2cf-4119-8fd2-b84725102134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:09.905938 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a8dfa-c2cf-4119-8fd2-b84725102134 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:09.906422 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a8dfa-c2cf-4119-8fd2-b84725102134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:09.906728 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a8dfa-c2cf-4119-8fd2-b84725102134 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:09.907763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a8dfa-c2cf-4119-8fd2-b84725102134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:09.910151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a8dfa-c2cf-4119-8fd2-b84725102134 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:09.944284 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 995/2020] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:09.945353 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a791f-ad05-419c-b99a-20cf99fbc313 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:09.961571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a791f-ad05-419c-b99a-20cf99fbc313 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:09.969415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef78c4a-53a6-45eb-99db-f172088fb32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:09.970528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef78c4a-53a6-45eb-99db-f172088fb32a admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:09.970923 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef78c4a-53a6-45eb-99db-f172088fb32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:09.971273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef78c4a-53a6-45eb-99db-f172088fb32a admin admin] PATH_INFO: `/v3/projects/2afbb1161aad4ee4a8608e1c241d238e/users/bf761d0e951049be9a678decae307c46/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:10.009824 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef78c4a-53a6-45eb-99db-f172088fb32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2afbb1161aad4ee4a8608e1c241d238e, user_id=bf761d0e951049be9a678decae307c46, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:10.012785 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef78c4a-53a6-45eb-99db-f172088fb32a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:10.032429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1026/2021] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:09 2022] PUT /identity/v3/projects/2afbb1161aad4ee4a8608e1c241d238e/users/bf761d0e951049be9a678decae307c46/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:10.036839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a8dfa-c2cf-4119-8fd2-b84725102134 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:10.047646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a8dfa-c2cf-4119-8fd2-b84725102134 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:10.125515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057aca5-2dbb-482c-bc23-9eee0f0987fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:10.126175 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057aca5-2dbb-482c-bc23-9eee0f0987fb admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:10.126610 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057aca5-2dbb-482c-bc23-9eee0f0987fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:10.126878 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057aca5-2dbb-482c-bc23-9eee0f0987fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:10.127547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057aca5-2dbb-482c-bc23-9eee0f0987fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:10.129153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057aca5-2dbb-482c-bc23-9eee0f0987fb admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:10.148243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 996/2022] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:10.152856 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef78c4a-53a6-45eb-99db-f172088fb32a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:10.177148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef78c4a-53a6-45eb-99db-f172088fb32a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:10.185143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65404358-e201-4aa0-b3b1-34c30edc447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:10.186095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65404358-e201-4aa0-b3b1-34c30edc447e admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:10.186366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65404358-e201-4aa0-b3b1-34c30edc447e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:10.186636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65404358-e201-4aa0-b3b1-34c30edc447e admin admin] PATH_INFO: `/v3/projects/2afbb1161aad4ee4a8608e1c241d238e/users/bf761d0e951049be9a678decae307c46/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:10.188907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65404358-e201-4aa0-b3b1-34c30edc447e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2afbb1161aad4ee4a8608e1c241d238e, user_id=bf761d0e951049be9a678decae307c46, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:10.192914 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65404358-e201-4aa0-b3b1-34c30edc447e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:10.207117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1027/2023] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:10 2022] PUT /identity/v3/projects/2afbb1161aad4ee4a8608e1c241d238e/users/bf761d0e951049be9a678decae307c46/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:10.220592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67365412-a851-4e8e-903f-a444e1818447 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:10.220882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67365412-a851-4e8e-903f-a444e1818447 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:10.221302 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67365412-a851-4e8e-903f-a444e1818447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:10.232514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:10.281660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-67365412-a851-4e8e-903f-a444e1818447 None None] MFA Rules not processed for user `bf761d0e951049be9a678decae307c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:10.282992 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-67365412-a851-4e8e-903f-a444e1818447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:10.423881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 997/2024] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:10.436324 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65404358-e201-4aa0-b3b1-34c30edc447e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:10.438646 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-65404358-e201-4aa0-b3b1-34c30edc447e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:10.543925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65404358-e201-4aa0-b3b1-34c30edc447e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:10.548993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c30762-0fab-46ef-b40d-4b3b98436f0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:10.550543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c30762-0fab-46ef-b40d-4b3b98436f0d service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:10.550543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c30762-0fab-46ef-b40d-4b3b98436f0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:10.550543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c30762-0fab-46ef-b40d-4b3b98436f0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:10.561790 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c30762-0fab-46ef-b40d-4b3b98436f0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:10.564257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c30762-0fab-46ef-b40d-4b3b98436f0d service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:10.577271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1028/2025] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:10.662172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67365412-a851-4e8e-903f-a444e1818447 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:10.731404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67365412-a851-4e8e-903f-a444e1818447 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:10.737149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696e114-f3b0-4030-8442-9db963cd9ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:10.737899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e114-f3b0-4030-8442-9db963cd9ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:10.738234 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e114-f3b0-4030-8442-9db963cd9ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:10.738565 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e114-f3b0-4030-8442-9db963cd9ecc admin admin] PATH_INFO: `/v3/users/c0b4042ab16d445c8222c6bdea91fa8d` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:10.739783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696e114-f3b0-4030-8442-9db963cd9ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b4042ab16d445c8222c6bdea91fa8d)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:10.742171 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696e114-f3b0-4030-8442-9db963cd9ecc admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:10.794519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c696e114-f3b0-4030-8442-9db963cd9ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b4042ab16d445c8222c6bdea91fa8d'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:10.803157 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c696e114-f3b0-4030-8442-9db963cd9ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b4042ab16d445c8222c6bdea91fa8d'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:10.803773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c696e114-f3b0-4030-8442-9db963cd9ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b4042ab16d445c8222c6bdea91fa8d'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:10.811279 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c696e114-f3b0-4030-8442-9db963cd9ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b4042ab16d445c8222c6bdea91fa8d'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:10.823518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c696e114-f3b0-4030-8442-9db963cd9ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b4042ab16d445c8222c6bdea91fa8d'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:10.829894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 998/2026] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:10 2022] DELETE /identity/v3/users/c0b4042ab16d445c8222c6bdea91fa8d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:10.834725 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5442e-bb29-4e81-9535-1dd9eb9257e7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:10.835008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5442e-bb29-4e81-9535-1dd9eb9257e7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:10.835279 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5442e-bb29-4e81-9535-1dd9eb9257e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:10.855330 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8ef5442e-bb29-4e81-9535-1dd9eb9257e7 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:10.856534 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8ef5442e-bb29-4e81-9535-1dd9eb9257e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:10.927200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1029/2027] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:10.937874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696e114-f3b0-4030-8442-9db963cd9ecc admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:10.939627 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c696e114-f3b0-4030-8442-9db963cd9ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:10.952143 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:11.010920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696e114-f3b0-4030-8442-9db963cd9ecc admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:11.016079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca784ce3-6c02-4227-9a74-1eb891702317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:11.016737 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca784ce3-6c02-4227-9a74-1eb891702317 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:11.017012 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca784ce3-6c02-4227-9a74-1eb891702317 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:11.017301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca784ce3-6c02-4227-9a74-1eb891702317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:11.035585 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca784ce3-6c02-4227-9a74-1eb891702317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:11.037425 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca784ce3-6c02-4227-9a74-1eb891702317 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:11.038214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5442e-bb29-4e81-9535-1dd9eb9257e7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:11.040112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8ef5442e-bb29-4e81-9535-1dd9eb9257e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:11.054318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5442e-bb29-4e81-9535-1dd9eb9257e7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:11.058979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 999/2028] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:11.059297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd14489-4ee1-48a7-9e0c-b8473fb05167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:11.059954 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14489-4ee1-48a7-9e0c-b8473fb05167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:11.060230 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14489-4ee1-48a7-9e0c-b8473fb05167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:11.060506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14489-4ee1-48a7-9e0c-b8473fb05167 admin admin] PATH_INFO: `/v3/users/7e1058e220394bdbad81f81b9487d556` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:11.061944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd14489-4ee1-48a7-9e0c-b8473fb05167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1058e220394bdbad81f81b9487d556)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:11.066636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd14489-4ee1-48a7-9e0c-b8473fb05167 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:11.116783 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:11.169846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7fd14489-4ee1-48a7-9e0c-b8473fb05167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1058e220394bdbad81f81b9487d556'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:11.180777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7fd14489-4ee1-48a7-9e0c-b8473fb05167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1058e220394bdbad81f81b9487d556'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:11.201723 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7fd14489-4ee1-48a7-9e0c-b8473fb05167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1058e220394bdbad81f81b9487d556'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:11.202644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7fd14489-4ee1-48a7-9e0c-b8473fb05167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1058e220394bdbad81f81b9487d556'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:11.214876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7fd14489-4ee1-48a7-9e0c-b8473fb05167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1058e220394bdbad81f81b9487d556'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:11.226300 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1030/2029] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:11 2022] DELETE /identity/v3/users/7e1058e220394bdbad81f81b9487d556 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:11.232146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc60ad-90e8-4c6b-8c7b-5e7787f6a9a8 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:11.232415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc60ad-90e8-4c6b-8c7b-5e7787f6a9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:11.232696 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc60ad-90e8-4c6b-8c7b-5e7787f6a9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:11.263324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-8ebc60ad-90e8-4c6b-8c7b-5e7787f6a9a8 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:11.264802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8ebc60ad-90e8-4c6b-8c7b-5e7787f6a9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:11.383358 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1000/2030] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:11.391997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd14489-4ee1-48a7-9e0c-b8473fb05167 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:11.393554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7fd14489-4ee1-48a7-9e0c-b8473fb05167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:11.504708 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd14489-4ee1-48a7-9e0c-b8473fb05167 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:11.515264 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc36aa7-845c-46a5-8c6d-b4f857814b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:11.516812 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc36aa7-845c-46a5-8c6d-b4f857814b9a service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:11.517113 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc36aa7-845c-46a5-8c6d-b4f857814b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:11.517817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc36aa7-845c-46a5-8c6d-b4f857814b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:11.537582 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc36aa7-845c-46a5-8c6d-b4f857814b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:11.537787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc60ad-90e8-4c6b-8c7b-5e7787f6a9a8 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:11.539506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc36aa7-845c-46a5-8c6d-b4f857814b9a service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:11.539675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8ebc60ad-90e8-4c6b-8c7b-5e7787f6a9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:11.559686 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1031/2031] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:11.563810 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc60ad-90e8-4c6b-8c7b-5e7787f6a9a8 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:11.569515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205803c-b302-4c08-83c3-fabf2cdee609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:11.570352 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205803c-b302-4c08-83c3-fabf2cdee609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:11.570717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205803c-b302-4c08-83c3-fabf2cdee609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:11.571083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205803c-b302-4c08-83c3-fabf2cdee609 admin admin] PATH_INFO: `/v3/projects/f524371d467549d9bc01f8171a57989b` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:11.572409 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205803c-b302-4c08-83c3-fabf2cdee609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f524371d467549d9bc01f8171a57989b)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:11.574745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205803c-b302-4c08-83c3-fabf2cdee609 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:11.673028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f205803c-b302-4c08-83c3-fabf2cdee609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f524371d467549d9bc01f8171a57989b', 'request_id': 'req-f205803c-b302-4c08-83c3-fabf2cdee609'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:11.690062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f205803c-b302-4c08-83c3-fabf2cdee609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f524371d467549d9bc01f8171a57989b', 'request_id': 'req-f205803c-b302-4c08-83c3-fabf2cdee609'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:11.702019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f205803c-b302-4c08-83c3-fabf2cdee609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f524371d467549d9bc01f8171a57989b', 'request_id': 'req-f205803c-b302-4c08-83c3-fabf2cdee609'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:11.719741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f205803c-b302-4c08-83c3-fabf2cdee609 admin admin] The token cache is being invalidate because project f524371d467549d9bc01f8171a57989b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:11.720108 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f205803c-b302-4c08-83c3-fabf2cdee609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:11.720815 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f205803c-b302-4c08-83c3-fabf2cdee609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:11.722886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1001/2032] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:11 2022] DELETE /identity/v3/projects/f524371d467549d9bc01f8171a57989b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:11.729841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc36aa7-845c-46a5-8c6d-b4f857814b9a service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:11.744013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc36aa7-845c-46a5-8c6d-b4f857814b9a service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:11.835415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f112d-2568-4b7d-ba4e-9841b524137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:11.836583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f112d-2568-4b7d-ba4e-9841b524137f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:11.837017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f112d-2568-4b7d-ba4e-9841b524137f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:11.837649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f112d-2568-4b7d-ba4e-9841b524137f admin admin] PATH_INFO: `/v3/users/bf761d0e951049be9a678decae307c46` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:11.844885 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f112d-2568-4b7d-ba4e-9841b524137f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf761d0e951049be9a678decae307c46)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:11.860758 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f112d-2568-4b7d-ba4e-9841b524137f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:11.941894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:11.951808 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd1f112d-2568-4b7d-ba4e-9841b524137f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf761d0e951049be9a678decae307c46'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:11.974245 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd1f112d-2568-4b7d-ba4e-9841b524137f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf761d0e951049be9a678decae307c46'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:12.008747 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd1f112d-2568-4b7d-ba4e-9841b524137f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf761d0e951049be9a678decae307c46'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:12.010603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd1f112d-2568-4b7d-ba4e-9841b524137f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf761d0e951049be9a678decae307c46'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:12.025479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dd1f112d-2568-4b7d-ba4e-9841b524137f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf761d0e951049be9a678decae307c46'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:12.035694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1032/2033] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:11 2022] DELETE /identity/v3/users/bf761d0e951049be9a678decae307c46 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:12.165597 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205803c-b302-4c08-83c3-fabf2cdee609 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:12.167895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f205803c-b302-4c08-83c3-fabf2cdee609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:12.208525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205803c-b302-4c08-83c3-fabf2cdee609 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:12.294189 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:12.380711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4ac51-a52c-483a-b44b-5ab96f0b207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:12.381378 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4ac51-a52c-483a-b44b-5ab96f0b207a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:12.381678 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4ac51-a52c-483a-b44b-5ab96f0b207a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:12.381951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4ac51-a52c-483a-b44b-5ab96f0b207a admin admin] PATH_INFO: `/v3/projects/b3d752006ef744f9b09c6fed8d71bce6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:12.383335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4ac51-a52c-483a-b44b-5ab96f0b207a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3d752006ef744f9b09c6fed8d71bce6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:12.385341 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4ac51-a52c-483a-b44b-5ab96f0b207a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:12.458049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3fd4ac51-a52c-483a-b44b-5ab96f0b207a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d752006ef744f9b09c6fed8d71bce6', 'request_id': 'req-3fd4ac51-a52c-483a-b44b-5ab96f0b207a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:12.469709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3fd4ac51-a52c-483a-b44b-5ab96f0b207a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d752006ef744f9b09c6fed8d71bce6', 'request_id': 'req-3fd4ac51-a52c-483a-b44b-5ab96f0b207a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:12.492565 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3fd4ac51-a52c-483a-b44b-5ab96f0b207a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d752006ef744f9b09c6fed8d71bce6', 'request_id': 'req-3fd4ac51-a52c-483a-b44b-5ab96f0b207a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:12.507971 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3fd4ac51-a52c-483a-b44b-5ab96f0b207a admin admin] The token cache is being invalidate because project b3d752006ef744f9b09c6fed8d71bce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:12.509047 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3fd4ac51-a52c-483a-b44b-5ab96f0b207a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:12.509956 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3fd4ac51-a52c-483a-b44b-5ab96f0b207a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:12.511669 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1002/2034] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:12 2022] DELETE /identity/v3/projects/b3d752006ef744f9b09c6fed8d71bce6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:12.620234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f112d-2568-4b7d-ba4e-9841b524137f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:12.621925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dd1f112d-2568-4b7d-ba4e-9841b524137f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:12.647520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f112d-2568-4b7d-ba4e-9841b524137f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:12.750867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dfbb3-a09c-411c-b07f-2a1ec47ea62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:12.751533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dfbb3-a09c-411c-b07f-2a1ec47ea62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:12.751904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dfbb3-a09c-411c-b07f-2a1ec47ea62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:12.752057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dfbb3-a09c-411c-b07f-2a1ec47ea62d admin admin] PATH_INFO: `/v3/projects/2afbb1161aad4ee4a8608e1c241d238e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:12.753899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dfbb3-a09c-411c-b07f-2a1ec47ea62d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2afbb1161aad4ee4a8608e1c241d238e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:12.755410 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dfbb3-a09c-411c-b07f-2a1ec47ea62d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:12.822357 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-185dfbb3-a09c-411c-b07f-2a1ec47ea62d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2afbb1161aad4ee4a8608e1c241d238e', 'request_id': 'req-185dfbb3-a09c-411c-b07f-2a1ec47ea62d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:12.829468 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-185dfbb3-a09c-411c-b07f-2a1ec47ea62d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2afbb1161aad4ee4a8608e1c241d238e', 'request_id': 'req-185dfbb3-a09c-411c-b07f-2a1ec47ea62d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:12.845453 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-185dfbb3-a09c-411c-b07f-2a1ec47ea62d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2afbb1161aad4ee4a8608e1c241d238e', 'request_id': 'req-185dfbb3-a09c-411c-b07f-2a1ec47ea62d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:12.861265 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-185dfbb3-a09c-411c-b07f-2a1ec47ea62d admin admin] The token cache is being invalidate because project 2afbb1161aad4ee4a8608e1c241d238e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:12.861542 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-185dfbb3-a09c-411c-b07f-2a1ec47ea62d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:12.863137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-185dfbb3-a09c-411c-b07f-2a1ec47ea62d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:12.864903 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1033/2035] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:12 2022] DELETE /identity/v3/projects/2afbb1161aad4ee4a8608e1c241d238e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:12.869996 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd78a64-09a0-48ed-9797-0e0ad7667fc3 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:12.870502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd78a64-09a0-48ed-9797-0e0ad7667fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:12.870582 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd78a64-09a0-48ed-9797-0e0ad7667fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:12.891866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-6bd78a64-09a0-48ed-9797-0e0ad7667fc3 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:12.893109 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6bd78a64-09a0-48ed-9797-0e0ad7667fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:12.967297 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1003/2036] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:12.977887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab24b5-d5b7-4b8e-9ceb-e68a28754ab4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:12.978172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab24b5-d5b7-4b8e-9ceb-e68a28754ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:12.978445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab24b5-d5b7-4b8e-9ceb-e68a28754ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:13.001712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c6ab24b5-d5b7-4b8e-9ceb-e68a28754ab4 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:13.002914 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c6ab24b5-d5b7-4b8e-9ceb-e68a28754ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:13.011630 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1034/2037] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:13.016166 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd78a64-09a0-48ed-9797-0e0ad7667fc3 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:13.027954 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd78a64-09a0-48ed-9797-0e0ad7667fc3 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:13.034844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cf028-a491-4242-97c9-32be75263207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:13.035700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cf028-a491-4242-97c9-32be75263207 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:13.036127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cf028-a491-4242-97c9-32be75263207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:13.036462 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cf028-a491-4242-97c9-32be75263207 admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:13.037258 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9cf028-a491-4242-97c9-32be75263207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:20:13.037705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9cf028-a491-4242-97c9-32be75263207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:13.039630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9cf028-a491-4242-97c9-32be75263207 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:13.054896 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1004/2038] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:20:13.059348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab24b5-d5b7-4b8e-9ceb-e68a28754ab4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:13.069816 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab24b5-d5b7-4b8e-9ceb-e68a28754ab4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:13.077535 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244c21a-59d0-4656-86e4-b48616f1c6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:13.079160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244c21a-59d0-4656-86e4-b48616f1c6fc admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:13.079632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244c21a-59d0-4656-86e4-b48616f1c6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:13.080062 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244c21a-59d0-4656-86e4-b48616f1c6fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:13.080693 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244c21a-59d0-4656-86e4-b48616f1c6fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:13.082671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244c21a-59d0-4656-86e4-b48616f1c6fc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:13.115121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1035/2039] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:13 2022] POST /identity/v3/projects => generated 357 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:13.119876 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cf028-a491-4242-97c9-32be75263207 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:13.131090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cf028-a491-4242-97c9-32be75263207 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:13.182456 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:13.194596 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50519b-c344-40e8-97d8-3069528ca67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:13.195847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50519b-c344-40e8-97d8-3069528ca67b admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:13.196968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50519b-c344-40e8-97d8-3069528ca67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:13.196968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50519b-c344-40e8-97d8-3069528ca67b admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:13.197366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50519b-c344-40e8-97d8-3069528ca67b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:13.199963 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50519b-c344-40e8-97d8-3069528ca67b admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:13.226846 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1005/2040] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:13 2022] POST /identity/v3/users => generated 279 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:13.228387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244c21a-59d0-4656-86e4-b48616f1c6fc admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:13.239131 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244c21a-59d0-4656-86e4-b48616f1c6fc admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:13.244444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992896d-590b-42ac-9a91-c0bb5f2b53bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:13.245055 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992896d-590b-42ac-9a91-c0bb5f2b53bd admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:13.245328 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992896d-590b-42ac-9a91-c0bb5f2b53bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:13.245597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992896d-590b-42ac-9a91-c0bb5f2b53bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:13.246268 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992896d-590b-42ac-9a91-c0bb5f2b53bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:13.247950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992896d-590b-42ac-9a91-c0bb5f2b53bd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:13.258857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1036/2041] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:13.263365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50519b-c344-40e8-97d8-3069528ca67b admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:13.273737 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50519b-c344-40e8-97d8-3069528ca67b admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:13.279231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89407228-3dbe-4c29-8153-f64f87dea565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:13.280248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89407228-3dbe-4c29-8153-f64f87dea565 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:13.280534 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89407228-3dbe-4c29-8153-f64f87dea565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:13.280809 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89407228-3dbe-4c29-8153-f64f87dea565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:13.281799 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89407228-3dbe-4c29-8153-f64f87dea565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:13.283953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89407228-3dbe-4c29-8153-f64f87dea565 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:13.299656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1006/2042] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:13.300968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992896d-590b-42ac-9a91-c0bb5f2b53bd admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:13.311012 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992896d-590b-42ac-9a91-c0bb5f2b53bd admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:13.315936 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936efc4-19c4-4094-a709-1327aa8066f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:13.316607 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936efc4-19c4-4094-a709-1327aa8066f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:13.316880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936efc4-19c4-4094-a709-1327aa8066f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:13.317271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936efc4-19c4-4094-a709-1327aa8066f9 admin admin] PATH_INFO: `/v3/projects/cc4e8acf0f2d452ca1f52519267f71c3/users/7ddb640323a64b959cdde2b96437f3b6/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:13.320487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:13.334470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936efc4-19c4-4094-a709-1327aa8066f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4e8acf0f2d452ca1f52519267f71c3, user_id=7ddb640323a64b959cdde2b96437f3b6, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:13.337268 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936efc4-19c4-4094-a709-1327aa8066f9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:13.353349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1037/2043] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:13 2022] PUT /identity/v3/projects/cc4e8acf0f2d452ca1f52519267f71c3/users/7ddb640323a64b959cdde2b96437f3b6/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:13.366758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34cd50-8aeb-40c1-bdbf-6853dd52cb94 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:13.367057 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34cd50-8aeb-40c1-bdbf-6853dd52cb94 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:13.367348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34cd50-8aeb-40c1-bdbf-6853dd52cb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:13.439028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-de34cd50-8aeb-40c1-bdbf-6853dd52cb94 None None] MFA Rules not processed for user `7ddb640323a64b959cdde2b96437f3b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:13.440419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-de34cd50-8aeb-40c1-bdbf-6853dd52cb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:13.556279 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1007/2044] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:13.597469 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936efc4-19c4-4094-a709-1327aa8066f9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:13.599318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7936efc4-19c4-4094-a709-1327aa8066f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:13.668642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936efc4-19c4-4094-a709-1327aa8066f9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:13.673748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7b3fd-0cac-4cab-9d5b-db4dc708b444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:13.674518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7b3fd-0cac-4cab-9d5b-db4dc708b444 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:13.674851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7b3fd-0cac-4cab-9d5b-db4dc708b444 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:13.675409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7b3fd-0cac-4cab-9d5b-db4dc708b444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:13.686449 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7b3fd-0cac-4cab-9d5b-db4dc708b444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:13.688958 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7b3fd-0cac-4cab-9d5b-db4dc708b444 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:13.702626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1038/2045] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:13.726329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34cd50-8aeb-40c1-bdbf-6853dd52cb94 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:13.824226 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34cd50-8aeb-40c1-bdbf-6853dd52cb94 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:13.836054 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0e7c8-7441-4a90-85c5-1990b1b96bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:13.836728 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0e7c8-7441-4a90-85c5-1990b1b96bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:13.837006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0e7c8-7441-4a90-85c5-1990b1b96bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:13.837269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0e7c8-7441-4a90-85c5-1990b1b96bb8 admin admin] PATH_INFO: `/v3/users/7ddb640323a64b959cdde2b96437f3b6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:13.838545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0e7c8-7441-4a90-85c5-1990b1b96bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ddb640323a64b959cdde2b96437f3b6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:13.840704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0e7c8-7441-4a90-85c5-1990b1b96bb8 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:13.919332 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-74f0e7c8-7441-4a90-85c5-1990b1b96bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ddb640323a64b959cdde2b96437f3b6'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:13.931327 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-74f0e7c8-7441-4a90-85c5-1990b1b96bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ddb640323a64b959cdde2b96437f3b6'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:13.932062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-74f0e7c8-7441-4a90-85c5-1990b1b96bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ddb640323a64b959cdde2b96437f3b6'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:13.952040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:13.954721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-74f0e7c8-7441-4a90-85c5-1990b1b96bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ddb640323a64b959cdde2b96437f3b6'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:13.969137 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-74f0e7c8-7441-4a90-85c5-1990b1b96bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ddb640323a64b959cdde2b96437f3b6'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:13.975132 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1008/2046] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:13 2022] DELETE /identity/v3/users/7ddb640323a64b959cdde2b96437f3b6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:13.979849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28977b-9cb8-4ebe-9088-70039fd4b9c4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:13.980137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28977b-9cb8-4ebe-9088-70039fd4b9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:13.980409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28977b-9cb8-4ebe-9088-70039fd4b9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:14.004703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5a28977b-9cb8-4ebe-9088-70039fd4b9c4 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:14.005849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5a28977b-9cb8-4ebe-9088-70039fd4b9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:14.069091 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1039/2047] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:14.079460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0e7c8-7441-4a90-85c5-1990b1b96bb8 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:14.081550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-74f0e7c8-7441-4a90-85c5-1990b1b96bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:14.139389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0e7c8-7441-4a90-85c5-1990b1b96bb8 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:14.143843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5444e-c788-4b17-b7db-76e6e7ea10c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:14.144660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5444e-c788-4b17-b7db-76e6e7ea10c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:14.144926 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5444e-c788-4b17-b7db-76e6e7ea10c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:14.145180 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5444e-c788-4b17-b7db-76e6e7ea10c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:14.155652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5444e-c788-4b17-b7db-76e6e7ea10c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:14.157227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a5444e-c788-4b17-b7db-76e6e7ea10c9 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:14.167377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1009/2048] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:14.459127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28977b-9cb8-4ebe-9088-70039fd4b9c4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:14.460653 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5a28977b-9cb8-4ebe-9088-70039fd4b9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:14.473688 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28977b-9cb8-4ebe-9088-70039fd4b9c4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:14.478878 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918f2a6-78ea-4c20-8260-44964f92adc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:14.479641 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918f2a6-78ea-4c20-8260-44964f92adc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:14.479977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918f2a6-78ea-4c20-8260-44964f92adc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:14.480330 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918f2a6-78ea-4c20-8260-44964f92adc0 admin admin] PATH_INFO: `/v3/projects/cc4e8acf0f2d452ca1f52519267f71c3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:14.481643 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918f2a6-78ea-4c20-8260-44964f92adc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc4e8acf0f2d452ca1f52519267f71c3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:14.484050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918f2a6-78ea-4c20-8260-44964f92adc0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:14.551335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3918f2a6-78ea-4c20-8260-44964f92adc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc4e8acf0f2d452ca1f52519267f71c3', 'request_id': 'req-3918f2a6-78ea-4c20-8260-44964f92adc0'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:14.557828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3918f2a6-78ea-4c20-8260-44964f92adc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc4e8acf0f2d452ca1f52519267f71c3', 'request_id': 'req-3918f2a6-78ea-4c20-8260-44964f92adc0'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:14.569971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3918f2a6-78ea-4c20-8260-44964f92adc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc4e8acf0f2d452ca1f52519267f71c3', 'request_id': 'req-3918f2a6-78ea-4c20-8260-44964f92adc0'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:14.587579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3918f2a6-78ea-4c20-8260-44964f92adc0 admin admin] The token cache is being invalidate because project cc4e8acf0f2d452ca1f52519267f71c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:14.587873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3918f2a6-78ea-4c20-8260-44964f92adc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:14.588620 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3918f2a6-78ea-4c20-8260-44964f92adc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:14.590293 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1040/2049] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:14 2022] DELETE /identity/v3/projects/cc4e8acf0f2d452ca1f52519267f71c3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:14.595482 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520b967-5f97-4d8b-b040-76f153b0750f None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:14.596024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520b967-5f97-4d8b-b040-76f153b0750f None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:14.596296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520b967-5f97-4d8b-b040-76f153b0750f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:14.617273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-4520b967-5f97-4d8b-b040-76f153b0750f None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:14.618552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-4520b967-5f97-4d8b-b040-76f153b0750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:14.686485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1010/2050] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:14.696241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f45e12-fb22-4577-9bf8-22a47d16e4dc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:14.696883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f45e12-fb22-4577-9bf8-22a47d16e4dc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:14.696883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f45e12-fb22-4577-9bf8-22a47d16e4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:14.717262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-71f45e12-fb22-4577-9bf8-22a47d16e4dc None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:14.718499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-71f45e12-fb22-4577-9bf8-22a47d16e4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:14.730733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1041/2051] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:14.731319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520b967-5f97-4d8b-b040-76f153b0750f None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:14.732784 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-4520b967-5f97-4d8b-b040-76f153b0750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:14.735038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f45e12-fb22-4577-9bf8-22a47d16e4dc None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:14.741669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:14.746177 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520b967-5f97-4d8b-b040-76f153b0750f None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:14.746369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f45e12-fb22-4577-9bf8-22a47d16e4dc None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:14.751970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d630a62-345b-4da1-9fd4-dc629dd0b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:14.752157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de1532-4549-4a05-b7a4-6b9f6a35a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:14.752868 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d630a62-345b-4da1-9fd4-dc629dd0b346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:14.753033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de1532-4549-4a05-b7a4-6b9f6a35a829 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:14.753113 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d630a62-345b-4da1-9fd4-dc629dd0b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:14.753304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de1532-4549-4a05-b7a4-6b9f6a35a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:14.753449 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d630a62-345b-4da1-9fd4-dc629dd0b346 admin admin] PATH_INFO: `/v3/users/b0cc1e6b713a4ff488f45c254300b9cd` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:14.753567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de1532-4549-4a05-b7a4-6b9f6a35a829 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:14.754327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de1532-4549-4a05-b7a4-6b9f6a35a829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:20:14.754600 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d630a62-345b-4da1-9fd4-dc629dd0b346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0cc1e6b713a4ff488f45c254300b9cd)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:14.754867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de1532-4549-4a05-b7a4-6b9f6a35a829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:14.756580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d630a62-345b-4da1-9fd4-dc629dd0b346 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:14.756908 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de1532-4549-4a05-b7a4-6b9f6a35a829 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:14.773666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1042/2052] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:20:14.774832 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de1532-4549-4a05-b7a4-6b9f6a35a829 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:14.786340 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de1532-4549-4a05-b7a4-6b9f6a35a829 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:14.792014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a3eec-5b92-4c52-aabd-3102f35a4a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:14.792748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a3eec-5b92-4c52-aabd-3102f35a4a87 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:14.793023 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a3eec-5b92-4c52-aabd-3102f35a4a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:14.793292 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a3eec-5b92-4c52-aabd-3102f35a4a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:14.794019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a3eec-5b92-4c52-aabd-3102f35a4a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:14.795990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a3eec-5b92-4c52-aabd-3102f35a4a87 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:14.807501 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9d630a62-345b-4da1-9fd4-dc629dd0b346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0cc1e6b713a4ff488f45c254300b9cd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:14.818736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9d630a62-345b-4da1-9fd4-dc629dd0b346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0cc1e6b713a4ff488f45c254300b9cd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:14.819496 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9d630a62-345b-4da1-9fd4-dc629dd0b346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0cc1e6b713a4ff488f45c254300b9cd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:14.826787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9d630a62-345b-4da1-9fd4-dc629dd0b346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0cc1e6b713a4ff488f45c254300b9cd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:14.827064 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1043/2053] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:14 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:14.831346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a3eec-5b92-4c52-aabd-3102f35a4a87 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:14.833124 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c80a3eec-5b92-4c52-aabd-3102f35a4a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:14.841470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:14.845190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9d630a62-345b-4da1-9fd4-dc629dd0b346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0cc1e6b713a4ff488f45c254300b9cd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:14.854529 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1011/2054] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:14 2022] DELETE /identity/v3/users/b0cc1e6b713a4ff488f45c254300b9cd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:14.858760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665761f-1c3e-4580-a2e4-736cf94941ec None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:14.859066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665761f-1c3e-4580-a2e4-736cf94941ec None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:14.859373 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665761f-1c3e-4580-a2e4-736cf94941ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:14.881584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-b665761f-1c3e-4580-a2e4-736cf94941ec None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:14.882884 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b665761f-1c3e-4580-a2e4-736cf94941ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:14.906427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a3eec-5b92-4c52-aabd-3102f35a4a87 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:14.950840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1012/2055] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:14.964112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665761f-1c3e-4580-a2e4-736cf94941ec None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:14.965829 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b665761f-1c3e-4580-a2e4-736cf94941ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:14.976698 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c328bc-13bb-428c-8e60-cf83c1bd0700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:14.977345 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c328bc-13bb-428c-8e60-cf83c1bd0700 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:14.977611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c328bc-13bb-428c-8e60-cf83c1bd0700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:14.977901 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c328bc-13bb-428c-8e60-cf83c1bd0700 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:14.978520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c328bc-13bb-428c-8e60-cf83c1bd0700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:14.980637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c328bc-13bb-428c-8e60-cf83c1bd0700 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:15.014281 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1044/2056] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:14 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:15.017111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c328bc-13bb-428c-8e60-cf83c1bd0700 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:15.035895 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c328bc-13bb-428c-8e60-cf83c1bd0700 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:15.042791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1e860-b01d-40ba-bbbf-add7c317c05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:15.044633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1e860-b01d-40ba-bbbf-add7c317c05d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:15.045303 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1e860-b01d-40ba-bbbf-add7c317c05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:15.045571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1e860-b01d-40ba-bbbf-add7c317c05d admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:15.046578 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1e860-b01d-40ba-bbbf-add7c317c05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:15.049568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1e860-b01d-40ba-bbbf-add7c317c05d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:15.060545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665761f-1c3e-4580-a2e4-736cf94941ec None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:15.063694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1045/2057] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:15.067865 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc62dd1-d55c-45cf-8bab-bc3256409641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:15.068046 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1e860-b01d-40ba-bbbf-add7c317c05d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:15.068718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc62dd1-d55c-45cf-8bab-bc3256409641 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:15.069133 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc62dd1-d55c-45cf-8bab-bc3256409641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:15.069644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc62dd1-d55c-45cf-8bab-bc3256409641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:15.082352 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc62dd1-d55c-45cf-8bab-bc3256409641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:15.084444 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc62dd1-d55c-45cf-8bab-bc3256409641 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:15.085280 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1e860-b01d-40ba-bbbf-add7c317c05d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:15.091378 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893254d-606b-40b9-b0e7-dcf419ab1ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:15.092018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893254d-606b-40b9-b0e7-dcf419ab1ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:15.092283 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893254d-606b-40b9-b0e7-dcf419ab1ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:15.092540 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893254d-606b-40b9-b0e7-dcf419ab1ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:15.093329 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893254d-606b-40b9-b0e7-dcf419ab1ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:15.094980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893254d-606b-40b9-b0e7-dcf419ab1ae0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:15.097675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1013/2058] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:15.111094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1046/2059] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:20:15.112304 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc62dd1-d55c-45cf-8bab-bc3256409641 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:15.136295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc62dd1-d55c-45cf-8bab-bc3256409641 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:15.143473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2be1cf-0c1d-4d5f-bd2e-dff7281a0556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:15.145443 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2be1cf-0c1d-4d5f-bd2e-dff7281a0556 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:15.145443 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2be1cf-0c1d-4d5f-bd2e-dff7281a0556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:15.145443 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2be1cf-0c1d-4d5f-bd2e-dff7281a0556 admin admin] PATH_INFO: `/v3/projects/6fcf93f5c85244c9820d2c21ebe26c97/users/a4dd08c439b94f0588b2531c5d69c6de/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:15.163219 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2be1cf-0c1d-4d5f-bd2e-dff7281a0556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fcf93f5c85244c9820d2c21ebe26c97, user_id=a4dd08c439b94f0588b2531c5d69c6de, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:15.165944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2be1cf-0c1d-4d5f-bd2e-dff7281a0556 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:15.180757 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1014/2060] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:15 2022] PUT /identity/v3/projects/6fcf93f5c85244c9820d2c21ebe26c97/users/a4dd08c439b94f0588b2531c5d69c6de/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:15.191372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe7c50-5b1b-4a6f-8582-e64893050185 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:15.191689 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe7c50-5b1b-4a6f-8582-e64893050185 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:15.191926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe7c50-5b1b-4a6f-8582-e64893050185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:15.219820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4bfe7c50-5b1b-4a6f-8582-e64893050185 None None] MFA Rules not processed for user `a4dd08c439b94f0588b2531c5d69c6de`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:15.221528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4bfe7c50-5b1b-4a6f-8582-e64893050185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:15.257384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:15.294517 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1047/2061] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:15.299312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2be1cf-0c1d-4d5f-bd2e-dff7281a0556 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:15.367056 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2be1cf-0c1d-4d5f-bd2e-dff7281a0556 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:15.372475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74305fd-6590-4d06-9103-aa1fd57099e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:15.373254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74305fd-6590-4d06-9103-aa1fd57099e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:15.373664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74305fd-6590-4d06-9103-aa1fd57099e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:15.373946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74305fd-6590-4d06-9103-aa1fd57099e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:15.374578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74305fd-6590-4d06-9103-aa1fd57099e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:15.376555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74305fd-6590-4d06-9103-aa1fd57099e3 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:15.385371 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe7c50-5b1b-4a6f-8582-e64893050185 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:15.387170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4bfe7c50-5b1b-4a6f-8582-e64893050185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:15.403110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:15.414047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe7c50-5b1b-4a6f-8582-e64893050185 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:15.418362 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:15.418632 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1015/2062] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:15 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:15.418899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:15.419183 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:15.419566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf admin admin] PATH_INFO: `/v3/projects/9e0c912bc61b404ba6594796f7483c9e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:15.420715 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e0c912bc61b404ba6594796f7483c9e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:15.422646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74305fd-6590-4d06-9103-aa1fd57099e3 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:15.423102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:15.490112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e0c912bc61b404ba6594796f7483c9e', 'request_id': 'req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:15.497989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e0c912bc61b404ba6594796f7483c9e', 'request_id': 'req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:15.507551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e0c912bc61b404ba6594796f7483c9e', 'request_id': 'req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:15.512282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74305fd-6590-4d06-9103-aa1fd57099e3 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:15.520261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf admin admin] The token cache is being invalidate because project 9e0c912bc61b404ba6594796f7483c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:15.520549 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:15.521219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:15.522762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1048/2063] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:15 2022] DELETE /identity/v3/projects/9e0c912bc61b404ba6594796f7483c9e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:15.526811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:15.528197 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:15.579753 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117b409-70c3-483c-9b54-e98b236b8a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:15.580373 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117b409-70c3-483c-9b54-e98b236b8a41 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:15.580682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117b409-70c3-483c-9b54-e98b236b8a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:15.580907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117b409-70c3-483c-9b54-e98b236b8a41 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:15.581526 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117b409-70c3-483c-9b54-e98b236b8a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:15.583542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117b409-70c3-483c-9b54-e98b236b8a41 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:15.603031 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6aac7-0c91-4fe4-a562-6a622b678dbf admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:15.610131 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1016/2064] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:15 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:15.610331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d23e2-a7ce-4fae-bd29-9406a6ebdccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:15.610331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d23e2-a7ce-4fae-bd29-9406a6ebdccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:15.610331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d23e2-a7ce-4fae-bd29-9406a6ebdccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:15.610331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d23e2-a7ce-4fae-bd29-9406a6ebdccd admin admin] PATH_INFO: `/v3/users/dbc2757a9a4844dfb5de61db0f59220c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:15.611107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d23e2-a7ce-4fae-bd29-9406a6ebdccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc2757a9a4844dfb5de61db0f59220c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:15.611464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117b409-70c3-483c-9b54-e98b236b8a41 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:15.613336 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2117b409-70c3-483c-9b54-e98b236b8a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:15.613573 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d23e2-a7ce-4fae-bd29-9406a6ebdccd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:15.625920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117b409-70c3-483c-9b54-e98b236b8a41 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:15.631990 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7647b-4d15-4c90-9a18-b0c0e0dd822a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:15.632605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7647b-4d15-4c90-9a18-b0c0e0dd822a admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:15.633667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7647b-4d15-4c90-9a18-b0c0e0dd822a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:15.633968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7647b-4d15-4c90-9a18-b0c0e0dd822a admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:15.634629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7647b-4d15-4c90-9a18-b0c0e0dd822a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:15.636283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7647b-4d15-4c90-9a18-b0c0e0dd822a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:15.649660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1017/2065] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:15.654228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7647b-4d15-4c90-9a18-b0c0e0dd822a admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:15.664970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7647b-4d15-4c90-9a18-b0c0e0dd822a admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:15.670330 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbea63c-56a2-4e8b-addf-4b4df0b4a446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:15.670985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbea63c-56a2-4e8b-addf-4b4df0b4a446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:15.671259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbea63c-56a2-4e8b-addf-4b4df0b4a446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:15.671553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbea63c-56a2-4e8b-addf-4b4df0b4a446 admin admin] PATH_INFO: `/v3/projects/d9b02621fb5e49e0922d3484e767fef2/users/04e28b1983044eeab49e5ec736281e46/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:15.674361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-489d23e2-a7ce-4fae-bd29-9406a6ebdccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc2757a9a4844dfb5de61db0f59220c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:15.681980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-489d23e2-a7ce-4fae-bd29-9406a6ebdccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc2757a9a4844dfb5de61db0f59220c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:15.684483 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:15.688773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbea63c-56a2-4e8b-addf-4b4df0b4a446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b02621fb5e49e0922d3484e767fef2, user_id=04e28b1983044eeab49e5ec736281e46, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:15.691482 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbea63c-56a2-4e8b-addf-4b4df0b4a446 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:15.697517 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-489d23e2-a7ce-4fae-bd29-9406a6ebdccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc2757a9a4844dfb5de61db0f59220c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:15.698269 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-489d23e2-a7ce-4fae-bd29-9406a6ebdccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc2757a9a4844dfb5de61db0f59220c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:15.705603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1018/2066] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:15 2022] PUT /identity/v3/projects/d9b02621fb5e49e0922d3484e767fef2/users/04e28b1983044eeab49e5ec736281e46/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:15.709086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-489d23e2-a7ce-4fae-bd29-9406a6ebdccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc2757a9a4844dfb5de61db0f59220c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:15.709785 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbea63c-56a2-4e8b-addf-4b4df0b4a446 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:15.711525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-4cbea63c-56a2-4e8b-addf-4b4df0b4a446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:15.716012 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1049/2067] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:15 2022] DELETE /identity/v3/users/dbc2757a9a4844dfb5de61db0f59220c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:15.777989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbea63c-56a2-4e8b-addf-4b4df0b4a446 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:15.783564 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:15.841366 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f315d99-d97c-4536-ba1f-746653bf29dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:15.842007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f315d99-d97c-4536-ba1f-746653bf29dd admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:15.842276 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f315d99-d97c-4536-ba1f-746653bf29dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:15.842537 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f315d99-d97c-4536-ba1f-746653bf29dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:15.843185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f315d99-d97c-4536-ba1f-746653bf29dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:15.844961 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f315d99-d97c-4536-ba1f-746653bf29dd admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:15.858489 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1019/2068] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:20:15.860005 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d23e2-a7ce-4fae-bd29-9406a6ebdccd admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:15.876024 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d23e2-a7ce-4fae-bd29-9406a6ebdccd admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:15.881201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bae13-905d-41fc-9173-fc034b31043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:15.881949 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bae13-905d-41fc-9173-fc034b31043d admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:15.882227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bae13-905d-41fc-9173-fc034b31043d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:15.882500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bae13-905d-41fc-9173-fc034b31043d admin admin] PATH_INFO: `/v3/projects/d9b02621fb5e49e0922d3484e767fef2/users/04e28b1983044eeab49e5ec736281e46/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:15.884659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bae13-905d-41fc-9173-fc034b31043d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b02621fb5e49e0922d3484e767fef2, user_id=04e28b1983044eeab49e5ec736281e46, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:15.887448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bae13-905d-41fc-9173-fc034b31043d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:15.900004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1050/2069] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:15 2022] PUT /identity/v3/projects/d9b02621fb5e49e0922d3484e767fef2/users/04e28b1983044eeab49e5ec736281e46/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:15.911458 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c1b07-3b4f-4ed5-9c7d-400a11df09ce None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:15.911663 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c1b07-3b4f-4ed5-9c7d-400a11df09ce None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:15.911891 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c1b07-3b4f-4ed5-9c7d-400a11df09ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:15.941593 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-be1c1b07-3b4f-4ed5-9c7d-400a11df09ce None None] MFA Rules not processed for user `04e28b1983044eeab49e5ec736281e46`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:15.942634 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-be1c1b07-3b4f-4ed5-9c7d-400a11df09ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:16.014498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bae13-905d-41fc-9173-fc034b31043d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:16.017159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9d3bae13-905d-41fc-9173-fc034b31043d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:16.053847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1020/2070] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:16.062351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c1b07-3b4f-4ed5-9c7d-400a11df09ce None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:16.064356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-be1c1b07-3b4f-4ed5-9c7d-400a11df09ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:16.140798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bae13-905d-41fc-9173-fc034b31043d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:16.146176 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30ede5-625f-469f-9d62-18e45cd98dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:16.147592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ede5-625f-469f-9d62-18e45cd98dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:16.147956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ede5-625f-469f-9d62-18e45cd98dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:16.148285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ede5-625f-469f-9d62-18e45cd98dc9 admin admin] PATH_INFO: `/v3/projects/51deaea50f7b4524a7ca08245e85c57b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:16.149761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30ede5-625f-469f-9d62-18e45cd98dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51deaea50f7b4524a7ca08245e85c57b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:16.166531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30ede5-625f-469f-9d62-18e45cd98dc9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:16.187473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c1b07-3b4f-4ed5-9c7d-400a11df09ce None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:16.193519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379f2e4-1812-430f-b7e5-f5c4065488b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:16.194370 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379f2e4-1812-430f-b7e5-f5c4065488b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:16.194887 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379f2e4-1812-430f-b7e5-f5c4065488b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:16.195255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379f2e4-1812-430f-b7e5-f5c4065488b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:16.197711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b379f2e4-1812-430f-b7e5-f5c4065488b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:16.276013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-da30ede5-625f-469f-9d62-18e45cd98dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51deaea50f7b4524a7ca08245e85c57b', 'request_id': 'req-da30ede5-625f-469f-9d62-18e45cd98dc9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:16.296861 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-da30ede5-625f-469f-9d62-18e45cd98dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51deaea50f7b4524a7ca08245e85c57b', 'request_id': 'req-da30ede5-625f-469f-9d62-18e45cd98dc9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:16.314934 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-da30ede5-625f-469f-9d62-18e45cd98dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51deaea50f7b4524a7ca08245e85c57b', 'request_id': 'req-da30ede5-625f-469f-9d62-18e45cd98dc9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:16.319722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:16.364637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-da30ede5-625f-469f-9d62-18e45cd98dc9 admin admin] The token cache is being invalidate because project 51deaea50f7b4524a7ca08245e85c57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:16.365328 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-da30ede5-625f-469f-9d62-18e45cd98dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:16.366663 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379f2e4-1812-430f-b7e5-f5c4065488b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:16.369135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-da30ede5-625f-469f-9d62-18e45cd98dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:16.370227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379f2e4-1812-430f-b7e5-f5c4065488b7 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:16.379287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1051/2071] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:16 2022] DELETE /identity/v3/projects/51deaea50f7b4524a7ca08245e85c57b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:16.381712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fbef8-22dd-4ed5-89b4-766000f9621c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:16.382111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fbef8-22dd-4ed5-89b4-766000f9621c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:16.382456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fbef8-22dd-4ed5-89b4-766000f9621c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:16.408888 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1021/2072] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:16.442948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f71fbef8-22dd-4ed5-89b4-766000f9621c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:16.444332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f71fbef8-22dd-4ed5-89b4-766000f9621c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:16.571308 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:16.585438 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1052/2073] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:16.594668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efb179-5ba1-4c35-ac8a-e2055ca3b30c None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:16.594968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efb179-5ba1-4c35-ac8a-e2055ca3b30c None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:16.595242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efb179-5ba1-4c35-ac8a-e2055ca3b30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:16.638189 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-b0efb179-5ba1-4c35-ac8a-e2055ca3b30c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:16.639819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b0efb179-5ba1-4c35-ac8a-e2055ca3b30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:16.657738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1022/2074] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:16.658768 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fbef8-22dd-4ed5-89b4-766000f9621c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:16.669329 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fbef8-22dd-4ed5-89b4-766000f9621c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:16.674861 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88def3c-fafc-47a9-802a-2495ec5ec6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:16.675566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88def3c-fafc-47a9-802a-2495ec5ec6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:16.675899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88def3c-fafc-47a9-802a-2495ec5ec6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:16.676409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88def3c-fafc-47a9-802a-2495ec5ec6a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:16.676997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88def3c-fafc-47a9-802a-2495ec5ec6a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:20:16.677376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88def3c-fafc-47a9-802a-2495ec5ec6a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:16.679116 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88def3c-fafc-47a9-802a-2495ec5ec6a3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:16.695243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1053/2075] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:20:16.699700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efb179-5ba1-4c35-ac8a-e2055ca3b30c None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:16.709075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efb179-5ba1-4c35-ac8a-e2055ca3b30c None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:16.713794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229c436-afee-4c92-b4b3-952c5a45c37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:16.714402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229c436-afee-4c92-b4b3-952c5a45c37f admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:16.714673 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229c436-afee-4c92-b4b3-952c5a45c37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:16.714940 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229c436-afee-4c92-b4b3-952c5a45c37f admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:16.715706 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229c436-afee-4c92-b4b3-952c5a45c37f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:16.717659 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229c436-afee-4c92-b4b3-952c5a45c37f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:16.753150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1023/2076] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:16 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:16.771108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88def3c-fafc-47a9-802a-2495ec5ec6a3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:16.786800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88def3c-fafc-47a9-802a-2495ec5ec6a3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:16.857078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b2d55-bf12-4fdd-af3e-acfd828ad954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:16.857842 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b2d55-bf12-4fdd-af3e-acfd828ad954 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:16.858155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b2d55-bf12-4fdd-af3e-acfd828ad954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:16.858465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b2d55-bf12-4fdd-af3e-acfd828ad954 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:16.859134 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b2d55-bf12-4fdd-af3e-acfd828ad954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:16.861382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b2d55-bf12-4fdd-af3e-acfd828ad954 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:16.885469 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1054/2077] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:16 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:16.889564 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229c436-afee-4c92-b4b3-952c5a45c37f admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:16.900406 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229c436-afee-4c92-b4b3-952c5a45c37f admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:16.912593 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c88359-7dfb-40fa-98ee-7f0ab5d0ac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:16.913210 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88359-7dfb-40fa-98ee-7f0ab5d0ac44 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:16.913484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88359-7dfb-40fa-98ee-7f0ab5d0ac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:16.913802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88359-7dfb-40fa-98ee-7f0ab5d0ac44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:16.914478 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c88359-7dfb-40fa-98ee-7f0ab5d0ac44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:16.916141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c88359-7dfb-40fa-98ee-7f0ab5d0ac44 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:16.927146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1024/2078] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:16.931211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b2d55-bf12-4fdd-af3e-acfd828ad954 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:16.941993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b2d55-bf12-4fdd-af3e-acfd828ad954 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:16.947677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90295e61-0895-4ab8-aeb8-d2758811a333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:16.948328 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90295e61-0895-4ab8-aeb8-d2758811a333 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:16.948606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90295e61-0895-4ab8-aeb8-d2758811a333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:16.948877 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90295e61-0895-4ab8-aeb8-d2758811a333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:16.949529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90295e61-0895-4ab8-aeb8-d2758811a333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:16.951797 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90295e61-0895-4ab8-aeb8-d2758811a333 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:16.963980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1055/2079] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:20:16.968400 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c88359-7dfb-40fa-98ee-7f0ab5d0ac44 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:16.980164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c88359-7dfb-40fa-98ee-7f0ab5d0ac44 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:16.986125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b2d40-5814-4b53-a29b-7119c1d8082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:16.987106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b2d40-5814-4b53-a29b-7119c1d8082e admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:16.987201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b2d40-5814-4b53-a29b-7119c1d8082e admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:16.987840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b2d40-5814-4b53-a29b-7119c1d8082e admin admin] PATH_INFO: `/v3/projects/82705350ca1e474db4b16769b58174c0/users/596b7c755fe14a1ab23394320d0e5a8c/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:17.005255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b2d40-5814-4b53-a29b-7119c1d8082e admin admin] RBAC: Authorizing `identity:create_grant(project_id=82705350ca1e474db4b16769b58174c0, user_id=596b7c755fe14a1ab23394320d0e5a8c, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:17.008198 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b2d40-5814-4b53-a29b-7119c1d8082e admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:17.026549 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1025/2080] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:16 2022] PUT /identity/v3/projects/82705350ca1e474db4b16769b58174c0/users/596b7c755fe14a1ab23394320d0e5a8c/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:17.038656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80e6ac-3570-4dcc-a579-42dacebcee39 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:17.038982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80e6ac-3570-4dcc-a579-42dacebcee39 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:17.039276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80e6ac-3570-4dcc-a579-42dacebcee39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:17.076721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9f80e6ac-3570-4dcc-a579-42dacebcee39 None None] MFA Rules not processed for user `596b7c755fe14a1ab23394320d0e5a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:17.077515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9f80e6ac-3570-4dcc-a579-42dacebcee39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:17.163380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1056/2081] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:17.164496 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b2d40-5814-4b53-a29b-7119c1d8082e admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:17.225850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b2d40-5814-4b53-a29b-7119c1d8082e admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:17.230681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdad464-054e-4121-887a-d0076b246098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:17.231282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdad464-054e-4121-887a-d0076b246098 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:17.231556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdad464-054e-4121-887a-d0076b246098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:17.231822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdad464-054e-4121-887a-d0076b246098 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:17.232454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdad464-054e-4121-887a-d0076b246098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:17.234462 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdad464-054e-4121-887a-d0076b246098 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:17.269944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1026/2082] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:17 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:17.274312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80e6ac-3570-4dcc-a579-42dacebcee39 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:17.288058 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80e6ac-3570-4dcc-a579-42dacebcee39 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:17.340610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:17.353766 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81772a16-0881-45a5-af56-542e2bd0701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:17.354382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81772a16-0881-45a5-af56-542e2bd0701d admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:17.354657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81772a16-0881-45a5-af56-542e2bd0701d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:17.354925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81772a16-0881-45a5-af56-542e2bd0701d admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:17.355546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81772a16-0881-45a5-af56-542e2bd0701d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:17.357496 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81772a16-0881-45a5-af56-542e2bd0701d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:17.379407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1057/2083] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:17 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:17.383453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdad464-054e-4121-887a-d0076b246098 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:17.393801 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdad464-054e-4121-887a-d0076b246098 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:17.398935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40283ac1-bfb8-4cd3-8d18-c40730cde792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:17.399532 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40283ac1-bfb8-4cd3-8d18-c40730cde792 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:17.399808 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40283ac1-bfb8-4cd3-8d18-c40730cde792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:17.400152 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40283ac1-bfb8-4cd3-8d18-c40730cde792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:17.400803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40283ac1-bfb8-4cd3-8d18-c40730cde792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:17.402475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40283ac1-bfb8-4cd3-8d18-c40730cde792 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:17.416659 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1027/2084] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:17.421062 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81772a16-0881-45a5-af56-542e2bd0701d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:17.431812 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81772a16-0881-45a5-af56-542e2bd0701d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:17.437760 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb046f24-dae8-42cb-b941-340f93fd8be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:17.438430 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb046f24-dae8-42cb-b941-340f93fd8be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:17.438681 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb046f24-dae8-42cb-b941-340f93fd8be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:17.438943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb046f24-dae8-42cb-b941-340f93fd8be6 admin admin] PATH_INFO: `/v3/projects/eaed7299f8474c418a92362794da5804/users/17e58369347a4aafb1743c2fe434c356/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:17.454380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb046f24-dae8-42cb-b941-340f93fd8be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaed7299f8474c418a92362794da5804, user_id=17e58369347a4aafb1743c2fe434c356, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:17.457016 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb046f24-dae8-42cb-b941-340f93fd8be6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:17.470807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1058/2085] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:17 2022] PUT /identity/v3/projects/eaed7299f8474c418a92362794da5804/users/17e58369347a4aafb1743c2fe434c356/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:17.474916 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40283ac1-bfb8-4cd3-8d18-c40730cde792 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:17.492965 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40283ac1-bfb8-4cd3-8d18-c40730cde792 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:17.543308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:17.555296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9dba6-a242-460b-95e6-ae545de959f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:17.555895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9dba6-a242-460b-95e6-ae545de959f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:17.556163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9dba6-a242-460b-95e6-ae545de959f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:17.556454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9dba6-a242-460b-95e6-ae545de959f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:17.557091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9dba6-a242-460b-95e6-ae545de959f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:17.558731 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9dba6-a242-460b-95e6-ae545de959f5 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:17.568914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1028/2086] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:17.574869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb046f24-dae8-42cb-b941-340f93fd8be6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:17.587413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb046f24-dae8-42cb-b941-340f93fd8be6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:17.594393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e454a-8bec-4206-b00b-5082bc7d059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:17.595266 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e454a-8bec-4206-b00b-5082bc7d059b admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:17.595633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e454a-8bec-4206-b00b-5082bc7d059b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:17.595995 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e454a-8bec-4206-b00b-5082bc7d059b admin admin] PATH_INFO: `/v3/projects/eaed7299f8474c418a92362794da5804/users/17e58369347a4aafb1743c2fe434c356/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:17.598179 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e454a-8bec-4206-b00b-5082bc7d059b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaed7299f8474c418a92362794da5804, user_id=17e58369347a4aafb1743c2fe434c356, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:17.601060 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e454a-8bec-4206-b00b-5082bc7d059b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:17.614672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1059/2087] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:17 2022] PUT /identity/v3/projects/eaed7299f8474c418a92362794da5804/users/17e58369347a4aafb1743c2fe434c356/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:17.626174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ec684-a2ae-438c-adef-bc3aa555d786 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:17.626454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ec684-a2ae-438c-adef-bc3aa555d786 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:17.626818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ec684-a2ae-438c-adef-bc3aa555d786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:17.658632 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-2d5ec684-a2ae-438c-adef-bc3aa555d786 None None] MFA Rules not processed for user `17e58369347a4aafb1743c2fe434c356`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:17.659857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2d5ec684-a2ae-438c-adef-bc3aa555d786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:17.734223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1029/2088] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:17.746151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e454a-8bec-4206-b00b-5082bc7d059b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:17.748080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0b5e454a-8bec-4206-b00b-5082bc7d059b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:17.807929 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e454a-8bec-4206-b00b-5082bc7d059b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:17.813236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b8230-ec91-4e6b-b96b-92eb14f1f905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:17.813907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b8230-ec91-4e6b-b96b-92eb14f1f905 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:17.814181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b8230-ec91-4e6b-b96b-92eb14f1f905 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:17.814431 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b8230-ec91-4e6b-b96b-92eb14f1f905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:17.824565 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b8230-ec91-4e6b-b96b-92eb14f1f905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:17.826042 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b8230-ec91-4e6b-b96b-92eb14f1f905 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:17.836121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1060/2089] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:18.618276 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ec684-a2ae-438c-adef-bc3aa555d786 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:18.684672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ec684-a2ae-438c-adef-bc3aa555d786 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:18.690743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1adfc4-1cdc-455b-9f45-b7bd077eb7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:18.691335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1adfc4-1cdc-455b-9f45-b7bd077eb7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:18.691631 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1adfc4-1cdc-455b-9f45-b7bd077eb7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:18.691892 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1adfc4-1cdc-455b-9f45-b7bd077eb7ca admin admin] PATH_INFO: `/v3/users/596b7c755fe14a1ab23394320d0e5a8c` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:18.693059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1adfc4-1cdc-455b-9f45-b7bd077eb7ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=596b7c755fe14a1ab23394320d0e5a8c)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:18.695524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1adfc4-1cdc-455b-9f45-b7bd077eb7ca admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:18.746161 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5f1adfc4-1cdc-455b-9f45-b7bd077eb7ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596b7c755fe14a1ab23394320d0e5a8c'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:18.756802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5f1adfc4-1cdc-455b-9f45-b7bd077eb7ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596b7c755fe14a1ab23394320d0e5a8c'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:18.757556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5f1adfc4-1cdc-455b-9f45-b7bd077eb7ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596b7c755fe14a1ab23394320d0e5a8c'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:18.770068 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5f1adfc4-1cdc-455b-9f45-b7bd077eb7ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596b7c755fe14a1ab23394320d0e5a8c'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:18.789422 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:18.792869 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5f1adfc4-1cdc-455b-9f45-b7bd077eb7ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596b7c755fe14a1ab23394320d0e5a8c'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:18.801893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1030/2090] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:18 2022] DELETE /identity/v3/users/596b7c755fe14a1ab23394320d0e5a8c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:18.806252 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6c2e5-7172-4866-a865-1b29de67f345 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:18.806525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6c2e5-7172-4866-a865-1b29de67f345 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:18.806791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6c2e5-7172-4866-a865-1b29de67f345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:18.826250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e2c6c2e5-7172-4866-a865-1b29de67f345 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:18.827571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e2c6c2e5-7172-4866-a865-1b29de67f345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:18.902219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1061/2091] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:18.911966 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1adfc4-1cdc-455b-9f45-b7bd077eb7ca admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:18.913487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5f1adfc4-1cdc-455b-9f45-b7bd077eb7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:18.970860 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1adfc4-1cdc-455b-9f45-b7bd077eb7ca admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:18.974460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9651403-e2ab-47f8-aae8-c114731e5997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:18.975034 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9651403-e2ab-47f8-aae8-c114731e5997 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:18.975302 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9651403-e2ab-47f8-aae8-c114731e5997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:18.975565 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9651403-e2ab-47f8-aae8-c114731e5997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:18.986993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9651403-e2ab-47f8-aae8-c114731e5997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:18.988594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9651403-e2ab-47f8-aae8-c114731e5997 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:19.000403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1031/2092] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:19.165214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6c2e5-7172-4866-a865-1b29de67f345 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:19.167130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e2c6c2e5-7172-4866-a865-1b29de67f345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:19.180958 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6c2e5-7172-4866-a865-1b29de67f345 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:19.185818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad297e-6344-47db-8207-eef8a0a31f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:19.186571 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad297e-6344-47db-8207-eef8a0a31f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:19.186834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad297e-6344-47db-8207-eef8a0a31f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:19.187108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad297e-6344-47db-8207-eef8a0a31f59 admin admin] PATH_INFO: `/v3/users/a4dd08c439b94f0588b2531c5d69c6de` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:19.188303 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad297e-6344-47db-8207-eef8a0a31f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4dd08c439b94f0588b2531c5d69c6de)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:19.190256 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad297e-6344-47db-8207-eef8a0a31f59 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:19.236824 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:19.244162 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d6ad297e-6344-47db-8207-eef8a0a31f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4dd08c439b94f0588b2531c5d69c6de'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:19.256573 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d6ad297e-6344-47db-8207-eef8a0a31f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4dd08c439b94f0588b2531c5d69c6de'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:19.270512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d6ad297e-6344-47db-8207-eef8a0a31f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4dd08c439b94f0588b2531c5d69c6de'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:19.271531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d6ad297e-6344-47db-8207-eef8a0a31f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4dd08c439b94f0588b2531c5d69c6de'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:19.280515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d6ad297e-6344-47db-8207-eef8a0a31f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4dd08c439b94f0588b2531c5d69c6de'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:19.287451 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1062/2093] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:19 2022] DELETE /identity/v3/users/a4dd08c439b94f0588b2531c5d69c6de => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:19.292568 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a6e01-9e67-46e5-a4d7-0499d3001be5 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:19.292848 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a6e01-9e67-46e5-a4d7-0499d3001be5 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:19.293103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a6e01-9e67-46e5-a4d7-0499d3001be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:19.306833 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad297e-6344-47db-8207-eef8a0a31f59 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:19.308719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d6ad297e-6344-47db-8207-eef8a0a31f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:19.314159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-ba7a6e01-9e67-46e5-a4d7-0499d3001be5 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:19.315601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ba7a6e01-9e67-46e5-a4d7-0499d3001be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:19.381429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad297e-6344-47db-8207-eef8a0a31f59 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:19.388376 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1032/2094] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:19.392556 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:19.393219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:19.393484 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:19.393825 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1 admin admin] PATH_INFO: `/v3/projects/82705350ca1e474db4b16769b58174c0` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:19.394945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82705350ca1e474db4b16769b58174c0)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:19.396899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:19.399554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a6e01-9e67-46e5-a4d7-0499d3001be5 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:19.401057 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ba7a6e01-9e67-46e5-a4d7-0499d3001be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:19.453468 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82705350ca1e474db4b16769b58174c0', 'request_id': 'req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:19.460475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82705350ca1e474db4b16769b58174c0', 'request_id': 'req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:19.464837 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a6e01-9e67-46e5-a4d7-0499d3001be5 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:19.471077 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82705350ca1e474db4b16769b58174c0', 'request_id': 'req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:19.491225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1 admin admin] The token cache is being invalidate because project 82705350ca1e474db4b16769b58174c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:19.491507 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:19.492366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:19.494272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1063/2095] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:19 2022] DELETE /identity/v3/projects/82705350ca1e474db4b16769b58174c0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:19.498707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:19.500548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:19.536306 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c392c2-8dee-487f-b0ee-4468e755218b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:19.537223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c392c2-8dee-487f-b0ee-4468e755218b service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:19.537666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c392c2-8dee-487f-b0ee-4468e755218b service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:19.538095 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c392c2-8dee-487f-b0ee-4468e755218b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:19.539910 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-25c392c2-8dee-487f-b0ee-4468e755218b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:19.547516 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:19.565474 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:19.587200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3f145-c779-4fb9-b7dc-57d2ec17edd1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:19.592122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43377670-a2af-4af9-a25f-e0c92ac24830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:19.592764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43377670-a2af-4af9-a25f-e0c92ac24830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:19.593037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43377670-a2af-4af9-a25f-e0c92ac24830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:19.593302 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43377670-a2af-4af9-a25f-e0c92ac24830 admin admin] PATH_INFO: `/v3/users/17e58369347a4aafb1743c2fe434c356` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:19.595128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43377670-a2af-4af9-a25f-e0c92ac24830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e58369347a4aafb1743c2fe434c356)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:19.597020 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43377670-a2af-4af9-a25f-e0c92ac24830 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:19.620692 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c392c2-8dee-487f-b0ee-4468e755218b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:19.622329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c392c2-8dee-487f-b0ee-4468e755218b service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:19.633325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1033/2096] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:19.652722 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-43377670-a2af-4af9-a25f-e0c92ac24830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e58369347a4aafb1743c2fe434c356'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:19.660360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-43377670-a2af-4af9-a25f-e0c92ac24830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e58369347a4aafb1743c2fe434c356'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:19.672925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-43377670-a2af-4af9-a25f-e0c92ac24830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e58369347a4aafb1743c2fe434c356'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:19.673763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-43377670-a2af-4af9-a25f-e0c92ac24830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e58369347a4aafb1743c2fe434c356'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:19.682644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-43377670-a2af-4af9-a25f-e0c92ac24830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e58369347a4aafb1743c2fe434c356'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:19.689427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1064/2097] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:19 2022] DELETE /identity/v3/users/17e58369347a4aafb1743c2fe434c356 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:20.006446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c392c2-8dee-487f-b0ee-4468e755218b service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:20.035334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c392c2-8dee-487f-b0ee-4468e755218b service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:20.157416 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a921f99-5613-4708-8918-a165ec4bdaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:20.158286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a921f99-5613-4708-8918-a165ec4bdaf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:20.158748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a921f99-5613-4708-8918-a165ec4bdaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:20.159215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a921f99-5613-4708-8918-a165ec4bdaf8 admin admin] PATH_INFO: `/v3/projects/eaed7299f8474c418a92362794da5804` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:20.161149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a921f99-5613-4708-8918-a165ec4bdaf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaed7299f8474c418a92362794da5804)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:20.165280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a921f99-5613-4708-8918-a165ec4bdaf8 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:20.250940 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-4a921f99-5613-4708-8918-a165ec4bdaf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaed7299f8474c418a92362794da5804', 'request_id': 'req-4a921f99-5613-4708-8918-a165ec4bdaf8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:20.262365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-4a921f99-5613-4708-8918-a165ec4bdaf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaed7299f8474c418a92362794da5804', 'request_id': 'req-4a921f99-5613-4708-8918-a165ec4bdaf8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:20.271208 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-4a921f99-5613-4708-8918-a165ec4bdaf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaed7299f8474c418a92362794da5804', 'request_id': 'req-4a921f99-5613-4708-8918-a165ec4bdaf8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:20.284632 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-4a921f99-5613-4708-8918-a165ec4bdaf8 admin admin] The token cache is being invalidate because project eaed7299f8474c418a92362794da5804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:20.286561 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-4a921f99-5613-4708-8918-a165ec4bdaf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:20.286938 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-4a921f99-5613-4708-8918-a165ec4bdaf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:20.289401 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1034/2098] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:20 2022] DELETE /identity/v3/projects/eaed7299f8474c418a92362794da5804 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:20.294614 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7290d-3a34-4555-b1b2-69b44cdf4dcc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:20.295042 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7290d-3a34-4555-b1b2-69b44cdf4dcc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:20.295120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7290d-3a34-4555-b1b2-69b44cdf4dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:20.329851 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5cb7290d-3a34-4555-b1b2-69b44cdf4dcc None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:20.331062 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5cb7290d-3a34-4555-b1b2-69b44cdf4dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:20.364012 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a921f99-5613-4708-8918-a165ec4bdaf8 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:20.366290 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-4a921f99-5613-4708-8918-a165ec4bdaf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:20.404755 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1065/2099] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:20.412278 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6893426-c6a4-4cfa-8e43-2d030792406e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:20.412541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6893426-c6a4-4cfa-8e43-2d030792406e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:20.412810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6893426-c6a4-4cfa-8e43-2d030792406e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:20.433547 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f6893426-c6a4-4cfa-8e43-2d030792406e None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:20.434071 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:20.435556 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f6893426-c6a4-4cfa-8e43-2d030792406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:20.445827 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1066/2100] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:20.450579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6893426-c6a4-4cfa-8e43-2d030792406e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:20.461780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6893426-c6a4-4cfa-8e43-2d030792406e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:20.466897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fd793-7b55-4518-a8a5-799adad6ee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:20.467859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fd793-7b55-4518-a8a5-799adad6ee8c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:20.468235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fd793-7b55-4518-a8a5-799adad6ee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:20.468641 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fd793-7b55-4518-a8a5-799adad6ee8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:20.469407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fd793-7b55-4518-a8a5-799adad6ee8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:20:20.469841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fd793-7b55-4518-a8a5-799adad6ee8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:20.471557 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fd793-7b55-4518-a8a5-799adad6ee8c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:20.475269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a921f99-5613-4708-8918-a165ec4bdaf8 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:20.485868 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14723511-4305-4e14-adf8-355bfbb3fa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:20.487175 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14723511-4305-4e14-adf8-355bfbb3fa63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:20.487625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14723511-4305-4e14-adf8-355bfbb3fa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:20.488059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14723511-4305-4e14-adf8-355bfbb3fa63 admin admin] PATH_INFO: `/v3/projects/6fcf93f5c85244c9820d2c21ebe26c97` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:20.489861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14723511-4305-4e14-adf8-355bfbb3fa63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fcf93f5c85244c9820d2c21ebe26c97)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:20.492552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14723511-4305-4e14-adf8-355bfbb3fa63 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:20.502665 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1067/2101] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:20:20.504052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fd793-7b55-4518-a8a5-799adad6ee8c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:20.519055 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fd793-7b55-4518-a8a5-799adad6ee8c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:20.527332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc427cf-b91f-4d0e-8400-3435aff0ef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:20.528119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc427cf-b91f-4d0e-8400-3435aff0ef6b admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:20.528605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc427cf-b91f-4d0e-8400-3435aff0ef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:20.528978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc427cf-b91f-4d0e-8400-3435aff0ef6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:20.530181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc427cf-b91f-4d0e-8400-3435aff0ef6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:20.533291 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc427cf-b91f-4d0e-8400-3435aff0ef6b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:20.562042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-14723511-4305-4e14-adf8-355bfbb3fa63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fcf93f5c85244c9820d2c21ebe26c97', 'request_id': 'req-14723511-4305-4e14-adf8-355bfbb3fa63'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:20.572560 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-14723511-4305-4e14-adf8-355bfbb3fa63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fcf93f5c85244c9820d2c21ebe26c97', 'request_id': 'req-14723511-4305-4e14-adf8-355bfbb3fa63'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:20.573182 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1068/2102] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:20 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:20.578969 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc427cf-b91f-4d0e-8400-3435aff0ef6b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:20.582503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-14723511-4305-4e14-adf8-355bfbb3fa63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fcf93f5c85244c9820d2c21ebe26c97', 'request_id': 'req-14723511-4305-4e14-adf8-355bfbb3fa63'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:20.595003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-14723511-4305-4e14-adf8-355bfbb3fa63 admin admin] The token cache is being invalidate because project 6fcf93f5c85244c9820d2c21ebe26c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:20.595434 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-14723511-4305-4e14-adf8-355bfbb3fa63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:20.596359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-14723511-4305-4e14-adf8-355bfbb3fa63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:20.598254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1035/2103] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:20 2022] DELETE /identity/v3/projects/6fcf93f5c85244c9820d2c21ebe26c97 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:20.601937 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14723511-4305-4e14-adf8-355bfbb3fa63 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:20.603416 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-14723511-4305-4e14-adf8-355bfbb3fa63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:20.612915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:20.652782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc427cf-b91f-4d0e-8400-3435aff0ef6b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:20.657761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196c377-55b4-4b99-ac26-da3900657aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:20.658796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196c377-55b4-4b99-ac26-da3900657aaa admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:20.658796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196c377-55b4-4b99-ac26-da3900657aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:20.658984 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196c377-55b4-4b99-ac26-da3900657aaa admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:20.659530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196c377-55b4-4b99-ac26-da3900657aaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:20.661447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196c377-55b4-4b99-ac26-da3900657aaa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:20.687067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1069/2104] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:20 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:20.691329 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196c377-55b4-4b99-ac26-da3900657aaa admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:20.693170 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9196c377-55b4-4b99-ac26-da3900657aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:20.695719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14723511-4305-4e14-adf8-355bfbb3fa63 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:20.702378 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54ca5f-1a3b-442c-82a3-e4c477f3d400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:20.703269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54ca5f-1a3b-442c-82a3-e4c477f3d400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:20.703714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54ca5f-1a3b-442c-82a3-e4c477f3d400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:20.704153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54ca5f-1a3b-442c-82a3-e4c477f3d400 admin admin] PATH_INFO: `/v3/users/04e28b1983044eeab49e5ec736281e46` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:20.705788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54ca5f-1a3b-442c-82a3-e4c477f3d400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e28b1983044eeab49e5ec736281e46)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:20.708175 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54ca5f-1a3b-442c-82a3-e4c477f3d400 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:20.709269 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196c377-55b4-4b99-ac26-da3900657aaa admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:20.715375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a07c60-fd7e-408b-a567-4d6bd9c43547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:20.716124 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a07c60-fd7e-408b-a567-4d6bd9c43547 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:20.716395 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a07c60-fd7e-408b-a567-4d6bd9c43547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:20.716662 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a07c60-fd7e-408b-a567-4d6bd9c43547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:20.717314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a07c60-fd7e-408b-a567-4d6bd9c43547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:20.718987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a07c60-fd7e-408b-a567-4d6bd9c43547 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:20.732628 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1070/2105] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:20:20.739300 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a07c60-fd7e-408b-a567-4d6bd9c43547 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:20.757736 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a07c60-fd7e-408b-a567-4d6bd9c43547 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:20.765777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439371fa-5f5b-4ccf-ac81-0bd6f44bcf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:20.766791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439371fa-5f5b-4ccf-ac81-0bd6f44bcf94 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:20.767274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439371fa-5f5b-4ccf-ac81-0bd6f44bcf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:20.767908 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439371fa-5f5b-4ccf-ac81-0bd6f44bcf94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:20.769084 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439371fa-5f5b-4ccf-ac81-0bd6f44bcf94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:20.769857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7e54ca5f-1a3b-442c-82a3-e4c477f3d400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e28b1983044eeab49e5ec736281e46'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:20.772077 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439371fa-5f5b-4ccf-ac81-0bd6f44bcf94 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:20.779192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7e54ca5f-1a3b-442c-82a3-e4c477f3d400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e28b1983044eeab49e5ec736281e46'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:20.780205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7e54ca5f-1a3b-442c-82a3-e4c477f3d400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e28b1983044eeab49e5ec736281e46'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:20.790513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7e54ca5f-1a3b-442c-82a3-e4c477f3d400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e28b1983044eeab49e5ec736281e46'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:20.793215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:20.793708 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1071/2106] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:20.799704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439371fa-5f5b-4ccf-ac81-0bd6f44bcf94 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:20.801845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-439371fa-5f5b-4ccf-ac81-0bd6f44bcf94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:20.808242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7e54ca5f-1a3b-442c-82a3-e4c477f3d400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e28b1983044eeab49e5ec736281e46'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:20.815146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1036/2107] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:20 2022] DELETE /identity/v3/users/04e28b1983044eeab49e5ec736281e46 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:20.816361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439371fa-5f5b-4ccf-ac81-0bd6f44bcf94 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:20.887038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af18cb1-8ea6-4a3e-a936-8546c036378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:20.887762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af18cb1-8ea6-4a3e-a936-8546c036378b admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:20.888035 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af18cb1-8ea6-4a3e-a936-8546c036378b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:20.888385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af18cb1-8ea6-4a3e-a936-8546c036378b admin admin] PATH_INFO: `/v3/projects/68581b8b121c4ecebcf7b1595cc8640d/users/53f714c2065b467699ec9c2b26d71c9a/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:20.905479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af18cb1-8ea6-4a3e-a936-8546c036378b admin admin] RBAC: Authorizing `identity:create_grant(project_id=68581b8b121c4ecebcf7b1595cc8640d, user_id=53f714c2065b467699ec9c2b26d71c9a, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:20.908409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af18cb1-8ea6-4a3e-a936-8546c036378b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:20.926823 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1072/2108] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:20 2022] PUT /identity/v3/projects/68581b8b121c4ecebcf7b1595cc8640d/users/53f714c2065b467699ec9c2b26d71c9a/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:20.932252 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cb926-fb17-4052-a611-8a8277ec2f32 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:20.932592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cb926-fb17-4052-a611-8a8277ec2f32 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:20.933022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cb926-fb17-4052-a611-8a8277ec2f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:20.954355 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-201cb926-fb17-4052-a611-8a8277ec2f32 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:20.955811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-201cb926-fb17-4052-a611-8a8277ec2f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:21.057840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1037/2109] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:21.077838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af18cb1-8ea6-4a3e-a936-8546c036378b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:21.081279 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1af18cb1-8ea6-4a3e-a936-8546c036378b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:21.144394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cb926-fb17-4052-a611-8a8277ec2f32 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:21.145959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-201cb926-fb17-4052-a611-8a8277ec2f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:21.162257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af18cb1-8ea6-4a3e-a936-8546c036378b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:21.166950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1010d31-d084-4bd4-af04-cc1b65fab93c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:21.167971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1010d31-d084-4bd4-af04-cc1b65fab93c service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:21.168801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1010d31-d084-4bd4-af04-cc1b65fab93c service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:21.169219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1010d31-d084-4bd4-af04-cc1b65fab93c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:21.171078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201cb926-fb17-4052-a611-8a8277ec2f32 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:21.188617 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1010d31-d084-4bd4-af04-cc1b65fab93c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:21.190163 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1010d31-d084-4bd4-af04-cc1b65fab93c service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:21.193678 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c82fa-b39f-4bdf-a6a7-1802e2381c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:21.195079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c82fa-b39f-4bdf-a6a7-1802e2381c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:21.195398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c82fa-b39f-4bdf-a6a7-1802e2381c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:21.195647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c82fa-b39f-4bdf-a6a7-1802e2381c34 admin admin] PATH_INFO: `/v3/projects/d9b02621fb5e49e0922d3484e767fef2` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:21.198796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c82fa-b39f-4bdf-a6a7-1802e2381c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b02621fb5e49e0922d3484e767fef2)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:21.200137 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c82fa-b39f-4bdf-a6a7-1802e2381c34 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:21.232763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1073/2110] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:21.287252 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5b0c82fa-b39f-4bdf-a6a7-1802e2381c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b02621fb5e49e0922d3484e767fef2', 'request_id': 'req-5b0c82fa-b39f-4bdf-a6a7-1802e2381c34'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:21.297446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5b0c82fa-b39f-4bdf-a6a7-1802e2381c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b02621fb5e49e0922d3484e767fef2', 'request_id': 'req-5b0c82fa-b39f-4bdf-a6a7-1802e2381c34'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:21.305299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5b0c82fa-b39f-4bdf-a6a7-1802e2381c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b02621fb5e49e0922d3484e767fef2', 'request_id': 'req-5b0c82fa-b39f-4bdf-a6a7-1802e2381c34'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:21.318151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5b0c82fa-b39f-4bdf-a6a7-1802e2381c34 admin admin] The token cache is being invalidate because project d9b02621fb5e49e0922d3484e767fef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:21.318700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5b0c82fa-b39f-4bdf-a6a7-1802e2381c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:21.319514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5b0c82fa-b39f-4bdf-a6a7-1802e2381c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:21.322310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1038/2111] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:21 2022] DELETE /identity/v3/projects/d9b02621fb5e49e0922d3484e767fef2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:21.329278 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0650135-fa8e-45ab-a16d-33da7574b5e5 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:21.329873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0650135-fa8e-45ab-a16d-33da7574b5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:21.330633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0650135-fa8e-45ab-a16d-33da7574b5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:21.403406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e0650135-fa8e-45ab-a16d-33da7574b5e5 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:21.407132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e0650135-fa8e-45ab-a16d-33da7574b5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:21.432568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:21.520174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1074/2112] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:21.530206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07f5b7-ae21-4fa5-b293-ccfd4ca0ba15 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:21.530359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07f5b7-ae21-4fa5-b293-ccfd4ca0ba15 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:21.531277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07f5b7-ae21-4fa5-b293-ccfd4ca0ba15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:21.559585 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-8d07f5b7-ae21-4fa5-b293-ccfd4ca0ba15 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:21.561361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8d07f5b7-ae21-4fa5-b293-ccfd4ca0ba15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:21.569889 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1039/2113] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:21.574403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0650135-fa8e-45ab-a16d-33da7574b5e5 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:21.586498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0650135-fa8e-45ab-a16d-33da7574b5e5 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:21.593901 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42d411-1865-48d2-90ac-8cb98e2a5e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:21.594543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42d411-1865-48d2-90ac-8cb98e2a5e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:21.594810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42d411-1865-48d2-90ac-8cb98e2a5e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:21.595524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42d411-1865-48d2-90ac-8cb98e2a5e91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:21.596186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42d411-1865-48d2-90ac-8cb98e2a5e91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:20:21.596484 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42d411-1865-48d2-90ac-8cb98e2a5e91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:21.598458 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42d411-1865-48d2-90ac-8cb98e2a5e91 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:21.618388 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1075/2114] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:20:21.619426 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07f5b7-ae21-4fa5-b293-ccfd4ca0ba15 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:21.631242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07f5b7-ae21-4fa5-b293-ccfd4ca0ba15 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:21.645782 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423c2dd-0e90-4bd7-aebe-d82b91b0b57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:21.646412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423c2dd-0e90-4bd7-aebe-d82b91b0b57c admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:21.646720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423c2dd-0e90-4bd7-aebe-d82b91b0b57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:21.647132 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423c2dd-0e90-4bd7-aebe-d82b91b0b57c admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:21.647944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423c2dd-0e90-4bd7-aebe-d82b91b0b57c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:21.655320 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423c2dd-0e90-4bd7-aebe-d82b91b0b57c admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:21.688609 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1040/2115] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:21 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:21.692898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42d411-1865-48d2-90ac-8cb98e2a5e91 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:21.713159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42d411-1865-48d2-90ac-8cb98e2a5e91 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:21.820087 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087457bd-a601-442e-a452-ce9aa8be67a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:21.820847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087457bd-a601-442e-a452-ce9aa8be67a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:21.821193 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087457bd-a601-442e-a452-ce9aa8be67a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:21.821533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087457bd-a601-442e-a452-ce9aa8be67a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:21.822431 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087457bd-a601-442e-a452-ce9aa8be67a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:21.825483 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087457bd-a601-442e-a452-ce9aa8be67a6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:21.859812 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1076/2116] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:21 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:21.861351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423c2dd-0e90-4bd7-aebe-d82b91b0b57c admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:21.878534 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423c2dd-0e90-4bd7-aebe-d82b91b0b57c admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:21.891626 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8020c2c-1120-4a63-a400-dde212942b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:21.892280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8020c2c-1120-4a63-a400-dde212942b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:21.893772 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8020c2c-1120-4a63-a400-dde212942b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:21.894395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8020c2c-1120-4a63-a400-dde212942b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:21.897896 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8020c2c-1120-4a63-a400-dde212942b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:21.901812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8020c2c-1120-4a63-a400-dde212942b24 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:21.933921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1041/2117] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:21.938089 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087457bd-a601-442e-a452-ce9aa8be67a6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:21.955852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087457bd-a601-442e-a452-ce9aa8be67a6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:21.966143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eae34f-e10c-4d46-8abf-6b8f3cec9123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:21.966775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eae34f-e10c-4d46-8abf-6b8f3cec9123 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:21.967050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eae34f-e10c-4d46-8abf-6b8f3cec9123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:21.967314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eae34f-e10c-4d46-8abf-6b8f3cec9123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:21.967968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eae34f-e10c-4d46-8abf-6b8f3cec9123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:21.969608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eae34f-e10c-4d46-8abf-6b8f3cec9123 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:21.997432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1077/2118] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:22.003020 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8020c2c-1120-4a63-a400-dde212942b24 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:22.023780 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8020c2c-1120-4a63-a400-dde212942b24 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:22.041121 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d7357-c73a-4b75-a550-cac488edf47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:22.041121 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d7357-c73a-4b75-a550-cac488edf47e admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:22.041121 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d7357-c73a-4b75-a550-cac488edf47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:22.041121 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d7357-c73a-4b75-a550-cac488edf47e admin admin] PATH_INFO: `/v3/projects/f09cb08b06b24f5084b9b8667ee12876/users/badd43a25b614721a05cd1a3697ee0cf/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:22.062164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d7357-c73a-4b75-a550-cac488edf47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09cb08b06b24f5084b9b8667ee12876, user_id=badd43a25b614721a05cd1a3697ee0cf, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:22.065764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d7357-c73a-4b75-a550-cac488edf47e admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:22.088896 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1042/2119] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:22 2022] PUT /identity/v3/projects/f09cb08b06b24f5084b9b8667ee12876/users/badd43a25b614721a05cd1a3697ee0cf/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:22.090532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed757470-2ec3-4c8f-9436-7b9b35d5f753 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:22.090822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed757470-2ec3-4c8f-9436-7b9b35d5f753 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:22.091096 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed757470-2ec3-4c8f-9436-7b9b35d5f753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:22.125423 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ed757470-2ec3-4c8f-9436-7b9b35d5f753 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:22.126997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ed757470-2ec3-4c8f-9436-7b9b35d5f753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:22.237398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1078/2120] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:22.246148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d7357-c73a-4b75-a550-cac488edf47e admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:22.248487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d32d7357-c73a-4b75-a550-cac488edf47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:22.256054 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:22.321309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d7357-c73a-4b75-a550-cac488edf47e admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:22.325194 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ba469-997b-4e8a-9df2-472520762608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:22.325838 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ba469-997b-4e8a-9df2-472520762608 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:22.326109 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ba469-997b-4e8a-9df2-472520762608 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:22.326370 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ba469-997b-4e8a-9df2-472520762608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:22.336313 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ba469-997b-4e8a-9df2-472520762608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:22.337581 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ba469-997b-4e8a-9df2-472520762608 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:22.348029 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1043/2121] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:22.737535 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b83b9f-7ffc-4036-85a1-5d0457f33db9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:22.738501 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b83b9f-7ffc-4036-85a1-5d0457f33db9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:22.738997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b83b9f-7ffc-4036-85a1-5d0457f33db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:22.781599 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-28b83b9f-7ffc-4036-85a1-5d0457f33db9 None None] MFA Rules not processed for user `53f714c2065b467699ec9c2b26d71c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:22.785445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-28b83b9f-7ffc-4036-85a1-5d0457f33db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:22.804746 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:22.877847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1079/2122] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:22.890437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ba469-997b-4e8a-9df2-472520762608 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:22.892165 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e30ba469-997b-4e8a-9df2-472520762608 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:22.971882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ba469-997b-4e8a-9df2-472520762608 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:22.975942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9588f19-8b5b-409f-a7cf-96f50058bf5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:22.976637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9588f19-8b5b-409f-a7cf-96f50058bf5a service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:22.977000 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9588f19-8b5b-409f-a7cf-96f50058bf5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:22.977316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9588f19-8b5b-409f-a7cf-96f50058bf5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:22.991466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9588f19-8b5b-409f-a7cf-96f50058bf5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:22.993046 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9588f19-8b5b-409f-a7cf-96f50058bf5a service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:23.003205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1044/2123] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:23.654669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0095d7-a22e-4c6f-ba77-d5744735f4be None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:23.654983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0095d7-a22e-4c6f-ba77-d5744735f4be None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:23.655217 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0095d7-a22e-4c6f-ba77-d5744735f4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:23.703478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4e0095d7-a22e-4c6f-ba77-d5744735f4be None None] MFA Rules not processed for user `badd43a25b614721a05cd1a3697ee0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:23.704983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4e0095d7-a22e-4c6f-ba77-d5744735f4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:23.756360 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9588f19-8b5b-409f-a7cf-96f50058bf5a service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:23.771800 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9588f19-8b5b-409f-a7cf-96f50058bf5a service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:23.784708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134a3b7-9a19-4152-a981-a58eb9c85d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:23.785908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134a3b7-9a19-4152-a981-a58eb9c85d4d service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:23.786308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134a3b7-9a19-4152-a981-a58eb9c85d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:23.786909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134a3b7-9a19-4152-a981-a58eb9c85d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:23.790773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3134a3b7-9a19-4152-a981-a58eb9c85d4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:23.858590 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1080/2124] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:23.872864 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0095d7-a22e-4c6f-ba77-d5744735f4be None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:23.876000 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4e0095d7-a22e-4c6f-ba77-d5744735f4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:23.906438 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0095d7-a22e-4c6f-ba77-d5744735f4be None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:23.910333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c16db5-6ce7-4b7a-b0f2-a742ebb0cc8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:23.911051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c16db5-6ce7-4b7a-b0f2-a742ebb0cc8d service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:23.911397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c16db5-6ce7-4b7a-b0f2-a742ebb0cc8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:23.911733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c16db5-6ce7-4b7a-b0f2-a742ebb0cc8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:23.930427 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c16db5-6ce7-4b7a-b0f2-a742ebb0cc8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:23.936220 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c16db5-6ce7-4b7a-b0f2-a742ebb0cc8d service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:23.948673 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134a3b7-9a19-4152-a981-a58eb9c85d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:23.952026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134a3b7-9a19-4152-a981-a58eb9c85d4d service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:23.955865 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1081/2125] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:20:23.967266 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1045/2126] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:20:24.600336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68985c-ea4d-451f-bfa5-1efcd9881195 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:24.600626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68985c-ea4d-451f-bfa5-1efcd9881195 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:24.600899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68985c-ea4d-451f-bfa5-1efcd9881195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:24.648012 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cc68985c-ea4d-451f-bfa5-1efcd9881195 None None] MFA Rules not processed for user `53f714c2065b467699ec9c2b26d71c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:24.652904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cc68985c-ea4d-451f-bfa5-1efcd9881195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:24.663125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1082/2127] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:24.918906 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b179b4-edcd-4469-9daa-77f033174674 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:24.919322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b179b4-edcd-4469-9daa-77f033174674 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:24.919942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b179b4-edcd-4469-9daa-77f033174674 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:24.921481 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1046/2128] 10.222.0.15 () {54 vars in 921 bytes} [Tue Aug 9 11:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:20:24.967409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8a8a-9691-4726-8140-4cb9e5c0bc6a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:24.967954 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8a8a-9691-4726-8140-4cb9e5c0bc6a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:24.967954 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8a8a-9691-4726-8140-4cb9e5c0bc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:24.989978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e32d8a8a-9691-4726-8140-4cb9e5c0bc6a None None] MFA Rules not processed for user `a587c410fd8741f3b3858d21b9e4884d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:24.991633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e32d8a8a-9691-4726-8140-4cb9e5c0bc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:25.032965 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b179b4-edcd-4469-9daa-77f033174674 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:25.036501 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-17b179b4-edcd-4469-9daa-77f033174674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:25.059600 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b179b4-edcd-4469-9daa-77f033174674 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:25.074288 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c4287-e5ce-4e57-88af-f8d6d4ce882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:25.075756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c4287-e5ce-4e57-88af-f8d6d4ce882f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:25.076410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c4287-e5ce-4e57-88af-f8d6d4ce882f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:25.077119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c4287-e5ce-4e57-88af-f8d6d4ce882f admin admin] PATH_INFO: `/v3/users/773b0b016684462ba2867148996095b2` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:25.079018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c4287-e5ce-4e57-88af-f8d6d4ce882f admin admin] RBAC: Authorizing `identity:delete_user(user_id=773b0b016684462ba2867148996095b2)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:25.083431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c4287-e5ce-4e57-88af-f8d6d4ce882f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:25.106973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1083/2129] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Aug 9 11:20:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:25.132372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d8a8a-9691-4726-8140-4cb9e5c0bc6a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:25.134337 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e32d8a8a-9691-4726-8140-4cb9e5c0bc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:25.150139 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d8a8a-9691-4726-8140-4cb9e5c0bc6a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:25.156449 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1be9c2-050b-4ee7-a156-18547487926b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:25.157322 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1be9c2-050b-4ee7-a156-18547487926b service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:25.157764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1be9c2-050b-4ee7-a156-18547487926b service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:25.158240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1be9c2-050b-4ee7-a156-18547487926b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:25.161243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:25.169892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1be9c2-050b-4ee7-a156-18547487926b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:25.171500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1be9c2-050b-4ee7-a156-18547487926b service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:25.174490 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c08c4287-e5ce-4e57-88af-f8d6d4ce882f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773b0b016684462ba2867148996095b2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:25.186677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1084/2130] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:20:25.188377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c08c4287-e5ce-4e57-88af-f8d6d4ce882f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773b0b016684462ba2867148996095b2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:25.189399 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c08c4287-e5ce-4e57-88af-f8d6d4ce882f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773b0b016684462ba2867148996095b2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:25.200429 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c08c4287-e5ce-4e57-88af-f8d6d4ce882f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773b0b016684462ba2867148996095b2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:25.226369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c08c4287-e5ce-4e57-88af-f8d6d4ce882f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773b0b016684462ba2867148996095b2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:25.234448 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1047/2131] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:25 2022] DELETE /identity/v3/users/773b0b016684462ba2867148996095b2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:25.491045 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1be9c2-050b-4ee7-a156-18547487926b service placement] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:25.521610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1be9c2-050b-4ee7-a156-18547487926b service placement] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:25.541991 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:25.555572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c898c4-908b-4237-ad4a-ae817003cb33 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:25.556215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c898c4-908b-4237-ad4a-ae817003cb33 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:25.556634 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c898c4-908b-4237-ad4a-ae817003cb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:25.579058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-19c898c4-908b-4237-ad4a-ae817003cb33 None None] MFA Rules not processed for user `badd43a25b614721a05cd1a3697ee0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:25.580690 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-19c898c4-908b-4237-ad4a-ae817003cb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:25.612839 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b803fea-6338-4ed2-b0ed-da917dea1d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:25.613555 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b803fea-6338-4ed2-b0ed-da917dea1d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:25.614115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b803fea-6338-4ed2-b0ed-da917dea1d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:25.614266 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b803fea-6338-4ed2-b0ed-da917dea1d4c admin admin] PATH_INFO: `/v3/projects/6a937a1da0f84bb0a77ea02a4ce7a66d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:25.615866 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b803fea-6338-4ed2-b0ed-da917dea1d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a937a1da0f84bb0a77ea02a4ce7a66d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:25.617940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b803fea-6338-4ed2-b0ed-da917dea1d4c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:25.658998 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1048/2132] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:25.677893 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0b803fea-6338-4ed2-b0ed-da917dea1d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a937a1da0f84bb0a77ea02a4ce7a66d', 'request_id': 'req-0b803fea-6338-4ed2-b0ed-da917dea1d4c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:25.685446 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0b803fea-6338-4ed2-b0ed-da917dea1d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a937a1da0f84bb0a77ea02a4ce7a66d', 'request_id': 'req-0b803fea-6338-4ed2-b0ed-da917dea1d4c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:25.695091 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0b803fea-6338-4ed2-b0ed-da917dea1d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a937a1da0f84bb0a77ea02a4ce7a66d', 'request_id': 'req-0b803fea-6338-4ed2-b0ed-da917dea1d4c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:25.706840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0b803fea-6338-4ed2-b0ed-da917dea1d4c admin admin] The token cache is being invalidate because project 6a937a1da0f84bb0a77ea02a4ce7a66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:25.707121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0b803fea-6338-4ed2-b0ed-da917dea1d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:25.707778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-0b803fea-6338-4ed2-b0ed-da917dea1d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:25.716270 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1085/2133] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:25 2022] DELETE /identity/v3/projects/6a937a1da0f84bb0a77ea02a4ce7a66d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:25.719374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4965b7-30a2-4e4e-b0e2-0600dc46f5b8 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:25.719826 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4965b7-30a2-4e4e-b0e2-0600dc46f5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:25.720321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4965b7-30a2-4e4e-b0e2-0600dc46f5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:25.741552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-0c4965b7-30a2-4e4e-b0e2-0600dc46f5b8 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:25.742917 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0c4965b7-30a2-4e4e-b0e2-0600dc46f5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:25.831007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1049/2134] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:25.833355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb857e-8844-463b-bfb5-049fd7bab31f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:25.834474 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb857e-8844-463b-bfb5-049fd7bab31f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:25.834958 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb857e-8844-463b-bfb5-049fd7bab31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:25.871285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-55bb857e-8844-463b-bfb5-049fd7bab31f None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:25.872616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-55bb857e-8844-463b-bfb5-049fd7bab31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:25.881033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1086/2135] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:25.885501 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4965b7-30a2-4e4e-b0e2-0600dc46f5b8 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:25.896221 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4965b7-30a2-4e4e-b0e2-0600dc46f5b8 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:25.907635 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5374c-5c69-4a0c-a3bb-b6296898a0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:25.908234 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5374c-5c69-4a0c-a3bb-b6296898a0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:25.908503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5374c-5c69-4a0c-a3bb-b6296898a0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:25.908766 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5374c-5c69-4a0c-a3bb-b6296898a0c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:25.909418 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5374c-5c69-4a0c-a3bb-b6296898a0c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:20:25.909741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5374c-5c69-4a0c-a3bb-b6296898a0c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:25.911349 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5374c-5c69-4a0c-a3bb-b6296898a0c1 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:25.926776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1050/2136] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:20:25.930081 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb857e-8844-463b-bfb5-049fd7bab31f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:25.939817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb857e-8844-463b-bfb5-049fd7bab31f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:25.945134 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072a248-e734-46a8-ba99-8dc144be7bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:25.945522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072a248-e734-46a8-ba99-8dc144be7bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:25.945901 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072a248-e734-46a8-ba99-8dc144be7bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:25.946159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072a248-e734-46a8-ba99-8dc144be7bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:25.946833 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072a248-e734-46a8-ba99-8dc144be7bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:25.948680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072a248-e734-46a8-ba99-8dc144be7bc9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:25.985751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1087/2137] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:25 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:25.987295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5374c-5c69-4a0c-a3bb-b6296898a0c1 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:25.997636 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5374c-5c69-4a0c-a3bb-b6296898a0c1 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:26.041524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:26.057338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91b30c-00bb-48b9-b5a7-9e482aa0c028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:26.058101 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b30c-00bb-48b9-b5a7-9e482aa0c028 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:26.058377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b30c-00bb-48b9-b5a7-9e482aa0c028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:26.058645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b30c-00bb-48b9-b5a7-9e482aa0c028 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:26.059284 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91b30c-00bb-48b9-b5a7-9e482aa0c028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:26.061529 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91b30c-00bb-48b9-b5a7-9e482aa0c028 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:26.088274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1051/2138] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:25 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:26.090098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072a248-e734-46a8-ba99-8dc144be7bc9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:26.101574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072a248-e734-46a8-ba99-8dc144be7bc9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:26.106911 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c4d06-ed1b-4504-81d5-0d93f10525cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:26.107384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c4d06-ed1b-4504-81d5-0d93f10525cf admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:26.107628 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c4d06-ed1b-4504-81d5-0d93f10525cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:26.107882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c4d06-ed1b-4504-81d5-0d93f10525cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:26.108545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c4d06-ed1b-4504-81d5-0d93f10525cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:26.110344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c4d06-ed1b-4504-81d5-0d93f10525cf admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:26.124763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1088/2139] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:20:26.126375 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91b30c-00bb-48b9-b5a7-9e482aa0c028 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:26.137077 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91b30c-00bb-48b9-b5a7-9e482aa0c028 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:26.143276 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe517b9c-7bc7-49ce-9031-5b6ffd5e4331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:26.143818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe517b9c-7bc7-49ce-9031-5b6ffd5e4331 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:26.144269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe517b9c-7bc7-49ce-9031-5b6ffd5e4331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:26.144483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe517b9c-7bc7-49ce-9031-5b6ffd5e4331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:26.145094 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe517b9c-7bc7-49ce-9031-5b6ffd5e4331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:26.146675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe517b9c-7bc7-49ce-9031-5b6ffd5e4331 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:26.160188 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1052/2140] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:26.164457 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c4d06-ed1b-4504-81d5-0d93f10525cf admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:26.175699 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c4d06-ed1b-4504-81d5-0d93f10525cf admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:26.180930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210b969-6440-4356-a200-dbea3c964ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:26.181804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210b969-6440-4356-a200-dbea3c964ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:26.182101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210b969-6440-4356-a200-dbea3c964ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:26.182523 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210b969-6440-4356-a200-dbea3c964ddc admin admin] PATH_INFO: `/v3/projects/4768f39c0cbd4e8a8cdd76d657d82476/users/a4da7bdc6e134cb4980d6bf3556f538d/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:26.199296 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210b969-6440-4356-a200-dbea3c964ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4768f39c0cbd4e8a8cdd76d657d82476, user_id=a4da7bdc6e134cb4980d6bf3556f538d, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:26.202433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210b969-6440-4356-a200-dbea3c964ddc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:26.225673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1089/2141] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:26 2022] PUT /identity/v3/projects/4768f39c0cbd4e8a8cdd76d657d82476/users/a4da7bdc6e134cb4980d6bf3556f538d/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:26.236486 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43c486-5822-43f7-9509-371ad64515e8 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:26.236816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43c486-5822-43f7-9509-371ad64515e8 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:26.243971 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43c486-5822-43f7-9509-371ad64515e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:26.339410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-ab43c486-5822-43f7-9509-371ad64515e8 None None] MFA Rules not processed for user `a4da7bdc6e134cb4980d6bf3556f538d`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:26.340818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ab43c486-5822-43f7-9509-371ad64515e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:26.454007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1053/2142] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:26.465092 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210b969-6440-4356-a200-dbea3c964ddc admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:26.467784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e210b969-6440-4356-a200-dbea3c964ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:26.552466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:26.633586 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210b969-6440-4356-a200-dbea3c964ddc admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:26.640704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740929e-9f0d-47aa-8edb-b7745e2067e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:26.641362 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740929e-9f0d-47aa-8edb-b7745e2067e9 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:26.641730 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740929e-9f0d-47aa-8edb-b7745e2067e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:26.642195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740929e-9f0d-47aa-8edb-b7745e2067e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:26.651931 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740929e-9f0d-47aa-8edb-b7745e2067e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:26.653541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740929e-9f0d-47aa-8edb-b7745e2067e9 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:26.666517 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1090/2143] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:26.954312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43c486-5822-43f7-9509-371ad64515e8 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:27.020559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43c486-5822-43f7-9509-371ad64515e8 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:27.024984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc95c5b-aaf5-4bba-b957-e8e8a5a0f0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:27.025605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc95c5b-aaf5-4bba-b957-e8e8a5a0f0a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:27.025903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc95c5b-aaf5-4bba-b957-e8e8a5a0f0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:27.026170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc95c5b-aaf5-4bba-b957-e8e8a5a0f0a9 admin admin] PATH_INFO: `/v3/users/a4da7bdc6e134cb4980d6bf3556f538d` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:27.027281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc95c5b-aaf5-4bba-b957-e8e8a5a0f0a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4da7bdc6e134cb4980d6bf3556f538d)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:27.029210 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc95c5b-aaf5-4bba-b957-e8e8a5a0f0a9 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:27.077085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-dfc95c5b-aaf5-4bba-b957-e8e8a5a0f0a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4da7bdc6e134cb4980d6bf3556f538d'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:27.084517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-dfc95c5b-aaf5-4bba-b957-e8e8a5a0f0a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4da7bdc6e134cb4980d6bf3556f538d'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:27.085141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-dfc95c5b-aaf5-4bba-b957-e8e8a5a0f0a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4da7bdc6e134cb4980d6bf3556f538d'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:27.087191 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:27.093230 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-dfc95c5b-aaf5-4bba-b957-e8e8a5a0f0a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4da7bdc6e134cb4980d6bf3556f538d'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:27.106816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-dfc95c5b-aaf5-4bba-b957-e8e8a5a0f0a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4da7bdc6e134cb4980d6bf3556f538d'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:27.112931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1054/2144] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:26 2022] DELETE /identity/v3/users/a4da7bdc6e134cb4980d6bf3556f538d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:27.118198 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e47b-b101-41be-8c3b-570d109df391 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:27.118707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e47b-b101-41be-8c3b-570d109df391 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:27.118707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490e47b-b101-41be-8c3b-570d109df391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:27.139283 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e490e47b-b101-41be-8c3b-570d109df391 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:27.140732 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e490e47b-b101-41be-8c3b-570d109df391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:27.223461 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1091/2145] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:27.233817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc95c5b-aaf5-4bba-b957-e8e8a5a0f0a9 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:27.235532 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-dfc95c5b-aaf5-4bba-b957-e8e8a5a0f0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:27.330358 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc95c5b-aaf5-4bba-b957-e8e8a5a0f0a9 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:27.337410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e589cfd-9578-489b-a979-c0469fd87114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:27.338361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e589cfd-9578-489b-a979-c0469fd87114 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:27.338705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e589cfd-9578-489b-a979-c0469fd87114 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:27.339045 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e589cfd-9578-489b-a979-c0469fd87114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:27.352103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e589cfd-9578-489b-a979-c0469fd87114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:27.354123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e589cfd-9578-489b-a979-c0469fd87114 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:27.366756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1055/2146] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:28.266725 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490e47b-b101-41be-8c3b-570d109df391 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:28.268990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e490e47b-b101-41be-8c3b-570d109df391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:28.284059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490e47b-b101-41be-8c3b-570d109df391 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:28.290742 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37a220-b1ed-4143-a2fa-7d5c31cff744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:28.292045 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37a220-b1ed-4143-a2fa-7d5c31cff744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:28.292376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37a220-b1ed-4143-a2fa-7d5c31cff744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:28.292655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37a220-b1ed-4143-a2fa-7d5c31cff744 admin admin] PATH_INFO: `/v3/projects/4768f39c0cbd4e8a8cdd76d657d82476` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:28.294261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37a220-b1ed-4143-a2fa-7d5c31cff744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4768f39c0cbd4e8a8cdd76d657d82476)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:28.296783 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37a220-b1ed-4143-a2fa-7d5c31cff744 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:28.359325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d37a220-b1ed-4143-a2fa-7d5c31cff744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4768f39c0cbd4e8a8cdd76d657d82476', 'request_id': 'req-2d37a220-b1ed-4143-a2fa-7d5c31cff744'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:28.365703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d37a220-b1ed-4143-a2fa-7d5c31cff744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4768f39c0cbd4e8a8cdd76d657d82476', 'request_id': 'req-2d37a220-b1ed-4143-a2fa-7d5c31cff744'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:28.374535 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d37a220-b1ed-4143-a2fa-7d5c31cff744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4768f39c0cbd4e8a8cdd76d657d82476', 'request_id': 'req-2d37a220-b1ed-4143-a2fa-7d5c31cff744'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:28.388504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d37a220-b1ed-4143-a2fa-7d5c31cff744 admin admin] The token cache is being invalidate because project 4768f39c0cbd4e8a8cdd76d657d82476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:28.388705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d37a220-b1ed-4143-a2fa-7d5c31cff744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:28.389524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2d37a220-b1ed-4143-a2fa-7d5c31cff744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:28.392272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1092/2147] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:28 2022] DELETE /identity/v3/projects/4768f39c0cbd4e8a8cdd76d657d82476 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:28.397744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e66887-1880-4fb6-a249-4c9f728d0758 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:28.398668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e66887-1880-4fb6-a249-4c9f728d0758 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:28.399168 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e66887-1880-4fb6-a249-4c9f728d0758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:28.436671 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-a9e66887-1880-4fb6-a249-4c9f728d0758 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:28.438005 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a9e66887-1880-4fb6-a249-4c9f728d0758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:28.510936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1056/2148] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:28.518779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2699d04-cb79-411b-80c1-7460e5f7b498 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:28.519058 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2699d04-cb79-411b-80c1-7460e5f7b498 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:28.519322 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2699d04-cb79-411b-80c1-7460e5f7b498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:28.541496 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c2699d04-cb79-411b-80c1-7460e5f7b498 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:28.542775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c2699d04-cb79-411b-80c1-7460e5f7b498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:28.552593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1093/2149] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:28.559224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e66887-1880-4fb6-a249-4c9f728d0758 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:28.570337 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e66887-1880-4fb6-a249-4c9f728d0758 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:28.577883 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375107c8-f049-46c3-9907-d56a51a7256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:28.578927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375107c8-f049-46c3-9907-d56a51a7256f admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:28.578927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375107c8-f049-46c3-9907-d56a51a7256f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:28.579344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375107c8-f049-46c3-9907-d56a51a7256f admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:28.581116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375107c8-f049-46c3-9907-d56a51a7256f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:20:28.581116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375107c8-f049-46c3-9907-d56a51a7256f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:28.581952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375107c8-f049-46c3-9907-d56a51a7256f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:28.596092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1057/2150] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:20:28.600758 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2699d04-cb79-411b-80c1-7460e5f7b498 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:28.611185 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2699d04-cb79-411b-80c1-7460e5f7b498 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:28.618290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557c56e-3aca-446c-8077-17d8677a0e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:28.618920 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557c56e-3aca-446c-8077-17d8677a0e79 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:28.619266 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557c56e-3aca-446c-8077-17d8677a0e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:28.619449 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557c56e-3aca-446c-8077-17d8677a0e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:28.620133 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557c56e-3aca-446c-8077-17d8677a0e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:28.622056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557c56e-3aca-446c-8077-17d8677a0e79 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:28.671930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1094/2151] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:28 2022] POST /identity/v3/projects => generated 405 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:28.677193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375107c8-f049-46c3-9907-d56a51a7256f admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:28.687523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375107c8-f049-46c3-9907-d56a51a7256f admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:28.785714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a51c6-4bd1-4dbd-9b72-f5241297bd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:28.787165 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a51c6-4bd1-4dbd-9b72-f5241297bd02 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:28.787687 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a51c6-4bd1-4dbd-9b72-f5241297bd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:28.787951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a51c6-4bd1-4dbd-9b72-f5241297bd02 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:28.788661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a51c6-4bd1-4dbd-9b72-f5241297bd02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:28.791237 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a51c6-4bd1-4dbd-9b72-f5241297bd02 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:28.806817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:28.822855 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1058/2152] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:28 2022] POST /identity/v3/users => generated 303 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:28.826922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557c56e-3aca-446c-8077-17d8677a0e79 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:28.845426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557c56e-3aca-446c-8077-17d8677a0e79 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:28.861924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d37d6-d3ef-4065-92e5-bb92e33bbcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:28.861924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d37d6-d3ef-4065-92e5-bb92e33bbcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:28.861924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d37d6-d3ef-4065-92e5-bb92e33bbcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:28.861924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d37d6-d3ef-4065-92e5-bb92e33bbcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:28.863045 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d37d6-d3ef-4065-92e5-bb92e33bbcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:28.870988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d37d6-d3ef-4065-92e5-bb92e33bbcf3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:28.913444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1095/2153] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:28.915109 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a51c6-4bd1-4dbd-9b72-f5241297bd02 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:28.926265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a51c6-4bd1-4dbd-9b72-f5241297bd02 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:28.931506 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d2a38-9e42-495b-be96-100f8c5140e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:28.932126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d2a38-9e42-495b-be96-100f8c5140e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:28.932405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d2a38-9e42-495b-be96-100f8c5140e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:28.932826 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d2a38-9e42-495b-be96-100f8c5140e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:28.933486 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d2a38-9e42-495b-be96-100f8c5140e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:28.935186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d2a38-9e42-495b-be96-100f8c5140e1 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:28.966886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1059/2154] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:20:28.969871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d37d6-d3ef-4065-92e5-bb92e33bbcf3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:28.976997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:28.984686 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d37d6-d3ef-4065-92e5-bb92e33bbcf3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:28.993112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833333ad-7621-429a-9e08-f46eeac777c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:28.994109 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833333ad-7621-429a-9e08-f46eeac777c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:28.994705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833333ad-7621-429a-9e08-f46eeac777c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:28.995278 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833333ad-7621-429a-9e08-f46eeac777c4 admin admin] PATH_INFO: `/v3/projects/477d11dde6534a43ba4d9b01ce147598/users/d53ad65c553a4a19ad775e1c2082be58/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:29.014739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833333ad-7621-429a-9e08-f46eeac777c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=477d11dde6534a43ba4d9b01ce147598, user_id=d53ad65c553a4a19ad775e1c2082be58, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:29.017556 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833333ad-7621-429a-9e08-f46eeac777c4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:29.033984 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1096/2155] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:28 2022] PUT /identity/v3/projects/477d11dde6534a43ba4d9b01ce147598/users/d53ad65c553a4a19ad775e1c2082be58/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:29.040343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257c9b4-9f2c-4ecb-8197-1f8576261712 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:29.040902 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257c9b4-9f2c-4ecb-8197-1f8576261712 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:29.041379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257c9b4-9f2c-4ecb-8197-1f8576261712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:29.072615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-c257c9b4-9f2c-4ecb-8197-1f8576261712 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:29.074443 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c257c9b4-9f2c-4ecb-8197-1f8576261712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:29.154521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1060/2156] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:29.165166 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833333ad-7621-429a-9e08-f46eeac777c4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:29.167084 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-833333ad-7621-429a-9e08-f46eeac777c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:29.258544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833333ad-7621-429a-9e08-f46eeac777c4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:29.264482 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fb63b-8574-4cd2-95c9-ca31d5c5ae82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:29.265190 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fb63b-8574-4cd2-95c9-ca31d5c5ae82 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:29.265375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fb63b-8574-4cd2-95c9-ca31d5c5ae82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:29.265663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fb63b-8574-4cd2-95c9-ca31d5c5ae82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:29.280124 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fb63b-8574-4cd2-95c9-ca31d5c5ae82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:29.286751 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fb63b-8574-4cd2-95c9-ca31d5c5ae82 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:29.305103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1097/2157] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:30.105828 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcdcce-4a91-46e7-81d3-027e355bd16d None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:30.106790 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcdcce-4a91-46e7-81d3-027e355bd16d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:30.107235 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcdcce-4a91-46e7-81d3-027e355bd16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:30.141855 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-0ddcdcce-4a91-46e7-81d3-027e355bd16d None None] MFA Rules not processed for user `d53ad65c553a4a19ad775e1c2082be58`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:30.143183 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0ddcdcce-4a91-46e7-81d3-027e355bd16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:30.234512 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1061/2158] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:30 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:30.241111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fb63b-8574-4cd2-95c9-ca31d5c5ae82 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:30.253195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fb63b-8574-4cd2-95c9-ca31d5c5ae82 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:30.300009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f909b7f-a25e-454a-8cbb-f2aa24cc73bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:30.301137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f909b7f-a25e-454a-8cbb-f2aa24cc73bf admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:30.301137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f909b7f-a25e-454a-8cbb-f2aa24cc73bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:30.301137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f909b7f-a25e-454a-8cbb-f2aa24cc73bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:30.305419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f909b7f-a25e-454a-8cbb-f2aa24cc73bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:30.305419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f909b7f-a25e-454a-8cbb-f2aa24cc73bf admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:30.353417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcdcce-4a91-46e7-81d3-027e355bd16d None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:30.360435 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1098/2159] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:30 2022] POST /identity/v3/projects => generated 403 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:30.365529 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcdcce-4a91-46e7-81d3-027e355bd16d None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:30.493546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23233734-7d75-4902-972e-7e7996463b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:30.494227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23233734-7d75-4902-972e-7e7996463b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:30.494580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23233734-7d75-4902-972e-7e7996463b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:30.494986 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23233734-7d75-4902-972e-7e7996463b74 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:30.495721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23233734-7d75-4902-972e-7e7996463b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:30.499677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23233734-7d75-4902-972e-7e7996463b74 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:30.541117 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1062/2160] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:30 2022] POST /identity/v3/users => generated 308 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:30.542810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f909b7f-a25e-454a-8cbb-f2aa24cc73bf admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:30.558307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f909b7f-a25e-454a-8cbb-f2aa24cc73bf admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:30.563012 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3979c81-90c9-4731-b681-980c73c3e705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:30.563997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3979c81-90c9-4731-b681-980c73c3e705 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:30.563997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3979c81-90c9-4731-b681-980c73c3e705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:30.564240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3979c81-90c9-4731-b681-980c73c3e705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:30.564776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3979c81-90c9-4731-b681-980c73c3e705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:30.566412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3979c81-90c9-4731-b681-980c73c3e705 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:30.578551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1099/2161] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:30.583214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23233734-7d75-4902-972e-7e7996463b74 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:30.588795 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:30.595570 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23233734-7d75-4902-972e-7e7996463b74 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:30.601025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdaa78-4071-4c7a-87a2-78ebbb514e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:30.601924 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdaa78-4071-4c7a-87a2-78ebbb514e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:30.602182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdaa78-4071-4c7a-87a2-78ebbb514e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:30.602535 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fdaa78-4071-4c7a-87a2-78ebbb514e93 admin admin] PATH_INFO: `/v3/projects/47482fd1429e476c8b67139ae397fd81/users/e15bef076c854fe5939c7d1fbadfd4c1/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:30.623469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdaa78-4071-4c7a-87a2-78ebbb514e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47482fd1429e476c8b67139ae397fd81, user_id=e15bef076c854fe5939c7d1fbadfd4c1, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:30.627103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fdaa78-4071-4c7a-87a2-78ebbb514e93 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:30.641542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1063/2162] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:30 2022] PUT /identity/v3/projects/47482fd1429e476c8b67139ae397fd81/users/e15bef076c854fe5939c7d1fbadfd4c1/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:30.645497 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3979c81-90c9-4731-b681-980c73c3e705 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:30.657358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3979c81-90c9-4731-b681-980c73c3e705 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:30.718337 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0910480-9a91-4703-bfee-c472fe9851c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:30.719370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0910480-9a91-4703-bfee-c472fe9851c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:30.719645 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0910480-9a91-4703-bfee-c472fe9851c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:30.719905 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0910480-9a91-4703-bfee-c472fe9851c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:30.720904 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0910480-9a91-4703-bfee-c472fe9851c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:30.722541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0910480-9a91-4703-bfee-c472fe9851c5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:30.733149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1100/2163] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:30.737863 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdaa78-4071-4c7a-87a2-78ebbb514e93 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:30.749244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fdaa78-4071-4c7a-87a2-78ebbb514e93 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:30.754294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c21e5a-0d1d-495d-9ee5-63ac49bdab7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:30.755007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c21e5a-0d1d-495d-9ee5-63ac49bdab7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:30.755282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c21e5a-0d1d-495d-9ee5-63ac49bdab7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:30.755555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c21e5a-0d1d-495d-9ee5-63ac49bdab7d admin admin] PATH_INFO: `/v3/projects/47482fd1429e476c8b67139ae397fd81/users/e15bef076c854fe5939c7d1fbadfd4c1/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:30.757741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c21e5a-0d1d-495d-9ee5-63ac49bdab7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=47482fd1429e476c8b67139ae397fd81, user_id=e15bef076c854fe5939c7d1fbadfd4c1, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:30.760453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c21e5a-0d1d-495d-9ee5-63ac49bdab7d admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:30.772460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1064/2164] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:30 2022] PUT /identity/v3/projects/47482fd1429e476c8b67139ae397fd81/users/e15bef076c854fe5939c7d1fbadfd4c1/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:31.574565 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afed562-b83b-49ee-996a-93faef63fe56 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:31.575027 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afed562-b83b-49ee-996a-93faef63fe56 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:31.575287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afed562-b83b-49ee-996a-93faef63fe56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:31.622367 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9afed562-b83b-49ee-996a-93faef63fe56 None None] MFA Rules not processed for user `e15bef076c854fe5939c7d1fbadfd4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:31.626595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9afed562-b83b-49ee-996a-93faef63fe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:31.723314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:31.777759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1101/2165] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:31 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:32.618950 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6ffe7-3b37-4adf-a32c-05520350c51a None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:32.619748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6ffe7-3b37-4adf-a32c-05520350c51a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:32.619748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6ffe7-3b37-4adf-a32c-05520350c51a None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:32.620950 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1065/2166] 10.222.0.15 () {54 vars in 921 bytes} [Tue Aug 9 11:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:20:32.659633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d2a07-8ac6-4678-980a-8bb9b53a8529 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:32.660191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d2a07-8ac6-4678-980a-8bb9b53a8529 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:32.660191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d2a07-8ac6-4678-980a-8bb9b53a8529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:32.682843 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5b1d2a07-8ac6-4678-980a-8bb9b53a8529 None None] MFA Rules not processed for user `a587c410fd8741f3b3858d21b9e4884d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:32.684039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5b1d2a07-8ac6-4678-980a-8bb9b53a8529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:32.772943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1102/2167] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Aug 9 11:20:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:32.787660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6ffe7-3b37-4adf-a32c-05520350c51a None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:32.789462 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-68e6ffe7-3b37-4adf-a32c-05520350c51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:32.811240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6ffe7-3b37-4adf-a32c-05520350c51a None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:32.816624 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3319499-666b-40b7-815a-59316a84fb72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:32.817227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3319499-666b-40b7-815a-59316a84fb72 service placement] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:32.817496 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3319499-666b-40b7-815a-59316a84fb72 service placement] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:32.817799 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3319499-666b-40b7-815a-59316a84fb72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:32.832512 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3319499-666b-40b7-815a-59316a84fb72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:32.834850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3319499-666b-40b7-815a-59316a84fb72 service placement] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:32.848211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1066/2168] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:33.421975 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d2a07-8ac6-4678-980a-8bb9b53a8529 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:33.496607 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d2a07-8ac6-4678-980a-8bb9b53a8529 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:33.501478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d93e0-f022-4805-a227-581345235580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:33.502140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d93e0-f022-4805-a227-581345235580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:33.502414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d93e0-f022-4805-a227-581345235580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:33.502701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d93e0-f022-4805-a227-581345235580 admin admin] PATH_INFO: `/v3/users/d53ad65c553a4a19ad775e1c2082be58` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:33.503811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d93e0-f022-4805-a227-581345235580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d53ad65c553a4a19ad775e1c2082be58)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:33.505810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d93e0-f022-4805-a227-581345235580 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:33.552018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-868d93e0-f022-4805-a227-581345235580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd53ad65c553a4a19ad775e1c2082be58'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:33.559066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-868d93e0-f022-4805-a227-581345235580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd53ad65c553a4a19ad775e1c2082be58'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:33.566796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:33.571881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-868d93e0-f022-4805-a227-581345235580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd53ad65c553a4a19ad775e1c2082be58'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:33.572899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-868d93e0-f022-4805-a227-581345235580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd53ad65c553a4a19ad775e1c2082be58'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:33.580999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-868d93e0-f022-4805-a227-581345235580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd53ad65c553a4a19ad775e1c2082be58'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:33.587205 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1103/2169] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:33 2022] DELETE /identity/v3/users/d53ad65c553a4a19ad775e1c2082be58 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:34.032895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3319499-666b-40b7-815a-59316a84fb72 service placement] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:34.044058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3319499-666b-40b7-815a-59316a84fb72 service placement] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:34.104697 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510822b-5773-45c8-bf4a-ccb1420b2035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:34.105826 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510822b-5773-45c8-bf4a-ccb1420b2035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:34.105826 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510822b-5773-45c8-bf4a-ccb1420b2035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:34.106021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510822b-5773-45c8-bf4a-ccb1420b2035 admin admin] PATH_INFO: `/v3/projects/477d11dde6534a43ba4d9b01ce147598` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:34.107090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510822b-5773-45c8-bf4a-ccb1420b2035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=477d11dde6534a43ba4d9b01ce147598)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:34.109266 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510822b-5773-45c8-bf4a-ccb1420b2035 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:34.176608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9510822b-5773-45c8-bf4a-ccb1420b2035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477d11dde6534a43ba4d9b01ce147598', 'request_id': 'req-9510822b-5773-45c8-bf4a-ccb1420b2035'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:34.185987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9510822b-5773-45c8-bf4a-ccb1420b2035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477d11dde6534a43ba4d9b01ce147598', 'request_id': 'req-9510822b-5773-45c8-bf4a-ccb1420b2035'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:34.193878 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9510822b-5773-45c8-bf4a-ccb1420b2035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477d11dde6534a43ba4d9b01ce147598', 'request_id': 'req-9510822b-5773-45c8-bf4a-ccb1420b2035'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:34.206334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9510822b-5773-45c8-bf4a-ccb1420b2035 admin admin] The token cache is being invalidate because project 477d11dde6534a43ba4d9b01ce147598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:34.206627 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9510822b-5773-45c8-bf4a-ccb1420b2035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:34.207341 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9510822b-5773-45c8-bf4a-ccb1420b2035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:34.208870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1067/2170] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:34 2022] DELETE /identity/v3/projects/477d11dde6534a43ba4d9b01ce147598 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:34.213012 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d93e0-f022-4805-a227-581345235580 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:34.214569 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-868d93e0-f022-4805-a227-581345235580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:34.229517 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d93e0-f022-4805-a227-581345235580 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:34.306666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f671ff-7df1-4eed-8473-1f800a61b639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:34.307310 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f671ff-7df1-4eed-8473-1f800a61b639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:34.307655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f671ff-7df1-4eed-8473-1f800a61b639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:34.307832 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f671ff-7df1-4eed-8473-1f800a61b639 admin admin] PATH_INFO: `/v3/users/e15bef076c854fe5939c7d1fbadfd4c1` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:34.308993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f671ff-7df1-4eed-8473-1f800a61b639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15bef076c854fe5939c7d1fbadfd4c1)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:34.311000 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f671ff-7df1-4eed-8473-1f800a61b639 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:34.373083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-80f671ff-7df1-4eed-8473-1f800a61b639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15bef076c854fe5939c7d1fbadfd4c1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:34.383483 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-80f671ff-7df1-4eed-8473-1f800a61b639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15bef076c854fe5939c7d1fbadfd4c1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:34.405753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-80f671ff-7df1-4eed-8473-1f800a61b639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15bef076c854fe5939c7d1fbadfd4c1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:34.406612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-80f671ff-7df1-4eed-8473-1f800a61b639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15bef076c854fe5939c7d1fbadfd4c1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:34.416702 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-80f671ff-7df1-4eed-8473-1f800a61b639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15bef076c854fe5939c7d1fbadfd4c1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:34.424090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1104/2171] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:34 2022] DELETE /identity/v3/users/e15bef076c854fe5939c7d1fbadfd4c1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:34.649050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510822b-5773-45c8-bf4a-ccb1420b2035 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:34.650585 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9510822b-5773-45c8-bf4a-ccb1420b2035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:34.666180 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510822b-5773-45c8-bf4a-ccb1420b2035 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:34.721875 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:34.750180 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7ae2f-723d-46ba-abc3-17d4f48d4e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:34.750819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7ae2f-723d-46ba-abc3-17d4f48d4e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:34.751090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7ae2f-723d-46ba-abc3-17d4f48d4e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:34.751353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7ae2f-723d-46ba-abc3-17d4f48d4e02 admin admin] PATH_INFO: `/v3/projects/47482fd1429e476c8b67139ae397fd81` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:34.752612 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7ae2f-723d-46ba-abc3-17d4f48d4e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47482fd1429e476c8b67139ae397fd81)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:34.755487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7ae2f-723d-46ba-abc3-17d4f48d4e02 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:34.811308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-83a7ae2f-723d-46ba-abc3-17d4f48d4e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47482fd1429e476c8b67139ae397fd81', 'request_id': 'req-83a7ae2f-723d-46ba-abc3-17d4f48d4e02'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:34.820059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-83a7ae2f-723d-46ba-abc3-17d4f48d4e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47482fd1429e476c8b67139ae397fd81', 'request_id': 'req-83a7ae2f-723d-46ba-abc3-17d4f48d4e02'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:34.827151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-83a7ae2f-723d-46ba-abc3-17d4f48d4e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47482fd1429e476c8b67139ae397fd81', 'request_id': 'req-83a7ae2f-723d-46ba-abc3-17d4f48d4e02'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:34.840031 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-83a7ae2f-723d-46ba-abc3-17d4f48d4e02 admin admin] The token cache is being invalidate because project 47482fd1429e476c8b67139ae397fd81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:34.840320 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-83a7ae2f-723d-46ba-abc3-17d4f48d4e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:34.841062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-83a7ae2f-723d-46ba-abc3-17d4f48d4e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:34.842717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1068/2172] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:34 2022] DELETE /identity/v3/projects/47482fd1429e476c8b67139ae397fd81 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:34.848194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7331f-945a-4cf8-a316-b419788137a2 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:34.848551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7331f-945a-4cf8-a316-b419788137a2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:34.848834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7331f-945a-4cf8-a316-b419788137a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:34.871024 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-91e7331f-945a-4cf8-a316-b419788137a2 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:34.872237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-91e7331f-945a-4cf8-a316-b419788137a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:34.941848 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1105/2173] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:34.951874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545db3ef-19d5-4978-b2d2-867d9f189795 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:34.952312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545db3ef-19d5-4978-b2d2-867d9f189795 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:34.952910 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545db3ef-19d5-4978-b2d2-867d9f189795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:34.979120 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-545db3ef-19d5-4978-b2d2-867d9f189795 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:34.980312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-545db3ef-19d5-4978-b2d2-867d9f189795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:34.989062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1069/2174] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:34.994130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7331f-945a-4cf8-a316-b419788137a2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:35.000483 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:35.005008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7331f-945a-4cf8-a316-b419788137a2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:35.011831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd12630-c948-4688-85ff-5f393c0b78c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:35.012678 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd12630-c948-4688-85ff-5f393c0b78c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:35.012951 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd12630-c948-4688-85ff-5f393c0b78c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:35.013231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd12630-c948-4688-85ff-5f393c0b78c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:35.013908 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd12630-c948-4688-85ff-5f393c0b78c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:20:35.014465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd12630-c948-4688-85ff-5f393c0b78c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:35.017644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd12630-c948-4688-85ff-5f393c0b78c1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:35.030162 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1106/2175] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:20:35.035540 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545db3ef-19d5-4978-b2d2-867d9f189795 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:35.051749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545db3ef-19d5-4978-b2d2-867d9f189795 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:35.059431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de665bc-e353-4494-a3e8-bf64936f1a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:35.060416 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de665bc-e353-4494-a3e8-bf64936f1a6e admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:35.060893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de665bc-e353-4494-a3e8-bf64936f1a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:35.061370 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de665bc-e353-4494-a3e8-bf64936f1a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:35.064550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de665bc-e353-4494-a3e8-bf64936f1a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:35.066831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de665bc-e353-4494-a3e8-bf64936f1a6e admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:35.102421 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1070/2176] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:35 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:35.107319 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd12630-c948-4688-85ff-5f393c0b78c1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:35.121209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd12630-c948-4688-85ff-5f393c0b78c1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:35.187458 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13eb559-7a85-48fb-aa4a-f94ce442671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:35.188085 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13eb559-7a85-48fb-aa4a-f94ce442671e admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:35.188358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13eb559-7a85-48fb-aa4a-f94ce442671e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:35.188624 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13eb559-7a85-48fb-aa4a-f94ce442671e admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:35.189252 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13eb559-7a85-48fb-aa4a-f94ce442671e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:35.191243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13eb559-7a85-48fb-aa4a-f94ce442671e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:35.214218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1107/2177] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:35 2022] POST /identity/v3/users => generated 282 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:35.218797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de665bc-e353-4494-a3e8-bf64936f1a6e admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:35.230386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de665bc-e353-4494-a3e8-bf64936f1a6e admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:35.235483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e14c7f-8d82-4ec2-a4f0-4df4d55462ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:35.236102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e14c7f-8d82-4ec2-a4f0-4df4d55462ac admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:35.236374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e14c7f-8d82-4ec2-a4f0-4df4d55462ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:35.236636 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e14c7f-8d82-4ec2-a4f0-4df4d55462ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:35.237289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e14c7f-8d82-4ec2-a4f0-4df4d55462ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:35.238950 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e14c7f-8d82-4ec2-a4f0-4df4d55462ac admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:35.250558 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1071/2178] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:35.254856 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13eb559-7a85-48fb-aa4a-f94ce442671e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:35.265869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13eb559-7a85-48fb-aa4a-f94ce442671e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:35.271695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ad68b-46a5-4d1c-b55f-50c7c49f724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:35.272333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ad68b-46a5-4d1c-b55f-50c7c49f724e admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:35.272610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ad68b-46a5-4d1c-b55f-50c7c49f724e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:35.272873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ad68b-46a5-4d1c-b55f-50c7c49f724e admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:35.273526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ad68b-46a5-4d1c-b55f-50c7c49f724e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:35.275199 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ad68b-46a5-4d1c-b55f-50c7c49f724e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:35.288139 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1108/2179] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:35.292553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e14c7f-8d82-4ec2-a4f0-4df4d55462ac admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:35.304348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e14c7f-8d82-4ec2-a4f0-4df4d55462ac admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:35.310394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57309557-03b3-4d4d-b207-a23c0f2d795a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:35.310788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57309557-03b3-4d4d-b207-a23c0f2d795a admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:35.311071 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57309557-03b3-4d4d-b207-a23c0f2d795a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:35.311912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57309557-03b3-4d4d-b207-a23c0f2d795a admin admin] PATH_INFO: `/v3/projects/d4df21f164ae41b09cf0f9186126468f/users/dcb104865c9e46338c00e85174b78368/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:35.329777 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57309557-03b3-4d4d-b207-a23c0f2d795a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4df21f164ae41b09cf0f9186126468f, user_id=dcb104865c9e46338c00e85174b78368, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:35.332474 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57309557-03b3-4d4d-b207-a23c0f2d795a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:35.348298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1072/2180] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:35 2022] PUT /identity/v3/projects/d4df21f164ae41b09cf0f9186126468f/users/dcb104865c9e46338c00e85174b78368/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:35.359407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ac653-d81c-419b-8166-be99bada4923 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:35.359589 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ac653-d81c-419b-8166-be99bada4923 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:35.359866 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ac653-d81c-419b-8166-be99bada4923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:35.389525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-590ac653-d81c-419b-8166-be99bada4923 None None] MFA Rules not processed for user `dcb104865c9e46338c00e85174b78368`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:35.390860 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-590ac653-d81c-419b-8166-be99bada4923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:35.482492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1109/2181] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:35.483841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57309557-03b3-4d4d-b207-a23c0f2d795a admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:35.550826 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57309557-03b3-4d4d-b207-a23c0f2d795a admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:35.555618 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035eb94d-4d92-45b8-b14d-9f1b3a122b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:35.556154 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eb94d-4d92-45b8-b14d-9f1b3a122b30 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:35.556427 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eb94d-4d92-45b8-b14d-9f1b3a122b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:35.556695 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eb94d-4d92-45b8-b14d-9f1b3a122b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:35.557321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035eb94d-4d92-45b8-b14d-9f1b3a122b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:35.559272 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035eb94d-4d92-45b8-b14d-9f1b3a122b30 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:35.575130 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:35.592223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1073/2182] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:35 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:35.596103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ac653-d81c-419b-8166-be99bada4923 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:35.607309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ac653-d81c-419b-8166-be99bada4923 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:35.674350 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcfac7-e3fa-4ad1-bac9-c6c8f85f2cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:35.675015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcfac7-e3fa-4ad1-bac9-c6c8f85f2cae admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:35.675285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcfac7-e3fa-4ad1-bac9-c6c8f85f2cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:35.675543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcfac7-e3fa-4ad1-bac9-c6c8f85f2cae admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:35.676185 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcfac7-e3fa-4ad1-bac9-c6c8f85f2cae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:35.678175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcfac7-e3fa-4ad1-bac9-c6c8f85f2cae admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:35.686409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:35.707516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1110/2183] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:35 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:35.711752 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035eb94d-4d92-45b8-b14d-9f1b3a122b30 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:35.733945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035eb94d-4d92-45b8-b14d-9f1b3a122b30 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:35.738781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2f655-8e78-48f1-b73f-d05301ff85bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:35.739393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2f655-8e78-48f1-b73f-d05301ff85bd admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:35.739662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2f655-8e78-48f1-b73f-d05301ff85bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:35.739933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2f655-8e78-48f1-b73f-d05301ff85bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:35.740944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2f655-8e78-48f1-b73f-d05301ff85bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:35.742800 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2f655-8e78-48f1-b73f-d05301ff85bd admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:35.755646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1074/2184] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:35.760124 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcfac7-e3fa-4ad1-bac9-c6c8f85f2cae admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:35.770495 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcfac7-e3fa-4ad1-bac9-c6c8f85f2cae admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:35.775392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645fd99-3193-4c7b-b10b-f94af76e3bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:35.776158 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645fd99-3193-4c7b-b10b-f94af76e3bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:35.776514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645fd99-3193-4c7b-b10b-f94af76e3bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:35.776870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645fd99-3193-4c7b-b10b-f94af76e3bcb admin admin] PATH_INFO: `/v3/projects/e3fe86c1b38e42989675e13c58a8451f/users/140f54f74a6d45aab02bf9a4354872f8/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:35.792997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645fd99-3193-4c7b-b10b-f94af76e3bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3fe86c1b38e42989675e13c58a8451f, user_id=140f54f74a6d45aab02bf9a4354872f8, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:35.795900 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645fd99-3193-4c7b-b10b-f94af76e3bcb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:35.809480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1111/2185] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:35 2022] PUT /identity/v3/projects/e3fe86c1b38e42989675e13c58a8451f/users/140f54f74a6d45aab02bf9a4354872f8/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:35.813339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2f655-8e78-48f1-b73f-d05301ff85bd admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:35.824116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2f655-8e78-48f1-b73f-d05301ff85bd admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:35.882457 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c323c-d35c-4c0e-aa63-1e5c7716f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:35.883242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c323c-d35c-4c0e-aa63-1e5c7716f529 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:35.883515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c323c-d35c-4c0e-aa63-1e5c7716f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:35.883782 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c323c-d35c-4c0e-aa63-1e5c7716f529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:35.884417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c323c-d35c-4c0e-aa63-1e5c7716f529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:35.886079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c323c-d35c-4c0e-aa63-1e5c7716f529 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:35.899724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1075/2186] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:35.901183 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645fd99-3193-4c7b-b10b-f94af76e3bcb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:35.913300 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645fd99-3193-4c7b-b10b-f94af76e3bcb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:35.918389 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe98d4f-d0d1-4ca8-9c32-eba950d6cc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:35.919064 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe98d4f-d0d1-4ca8-9c32-eba950d6cc90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:35.919347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe98d4f-d0d1-4ca8-9c32-eba950d6cc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:35.919612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe98d4f-d0d1-4ca8-9c32-eba950d6cc90 admin admin] PATH_INFO: `/v3/projects/e3fe86c1b38e42989675e13c58a8451f/users/140f54f74a6d45aab02bf9a4354872f8/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:35.921631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe98d4f-d0d1-4ca8-9c32-eba950d6cc90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3fe86c1b38e42989675e13c58a8451f, user_id=140f54f74a6d45aab02bf9a4354872f8, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:35.924328 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe98d4f-d0d1-4ca8-9c32-eba950d6cc90 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:35.936039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1112/2187] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:35 2022] PUT /identity/v3/projects/e3fe86c1b38e42989675e13c58a8451f/users/140f54f74a6d45aab02bf9a4354872f8/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:35.947308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2ffbd-73c5-439e-8ab5-8810398d5712 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:35.947891 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2ffbd-73c5-439e-8ab5-8810398d5712 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:35.948205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2ffbd-73c5-439e-8ab5-8810398d5712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:35.980200 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-81d2ffbd-73c5-439e-8ab5-8810398d5712 None None] MFA Rules not processed for user `140f54f74a6d45aab02bf9a4354872f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:35.981456 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-81d2ffbd-73c5-439e-8ab5-8810398d5712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:36.052884 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1076/2188] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:36.065796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe98d4f-d0d1-4ca8-9c32-eba950d6cc90 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:36.067660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cfe98d4f-d0d1-4ca8-9c32-eba950d6cc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:36.128164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe98d4f-d0d1-4ca8-9c32-eba950d6cc90 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:36.132405 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44987c0-355e-4a25-8d27-1dff3d97e38b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:36.133019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44987c0-355e-4a25-8d27-1dff3d97e38b service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:36.133288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44987c0-355e-4a25-8d27-1dff3d97e38b service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:36.133727 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44987c0-355e-4a25-8d27-1dff3d97e38b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:36.143985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44987c0-355e-4a25-8d27-1dff3d97e38b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:36.145424 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44987c0-355e-4a25-8d27-1dff3d97e38b service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:36.157232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1113/2189] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:36.627428 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2ffbd-73c5-439e-8ab5-8810398d5712 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:36.689261 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2ffbd-73c5-439e-8ab5-8810398d5712 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:36.693709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d747cc7-03f2-4402-b94c-569c7cc5a1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:36.694335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d747cc7-03f2-4402-b94c-569c7cc5a1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:36.694608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d747cc7-03f2-4402-b94c-569c7cc5a1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:36.694878 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d747cc7-03f2-4402-b94c-569c7cc5a1cb admin admin] PATH_INFO: `/v3/users/dcb104865c9e46338c00e85174b78368` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:36.696018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d747cc7-03f2-4402-b94c-569c7cc5a1cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb104865c9e46338c00e85174b78368)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:36.698017 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d747cc7-03f2-4402-b94c-569c7cc5a1cb admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:36.703044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:36.750468 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-2d747cc7-03f2-4402-b94c-569c7cc5a1cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb104865c9e46338c00e85174b78368'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:36.759953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-2d747cc7-03f2-4402-b94c-569c7cc5a1cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb104865c9e46338c00e85174b78368'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:36.760045 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-2d747cc7-03f2-4402-b94c-569c7cc5a1cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb104865c9e46338c00e85174b78368'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:36.771672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-2d747cc7-03f2-4402-b94c-569c7cc5a1cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb104865c9e46338c00e85174b78368'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:36.788179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-2d747cc7-03f2-4402-b94c-569c7cc5a1cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb104865c9e46338c00e85174b78368'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:36.796442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1077/2190] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:36 2022] DELETE /identity/v3/users/dcb104865c9e46338c00e85174b78368 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:36.801419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef011b-ce77-4c2c-b74f-00dfd3825a47 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:36.801968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef011b-ce77-4c2c-b74f-00dfd3825a47 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:36.802135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef011b-ce77-4c2c-b74f-00dfd3825a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:36.823595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d6ef011b-ce77-4c2c-b74f-00dfd3825a47 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:36.824774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d6ef011b-ce77-4c2c-b74f-00dfd3825a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:36.894312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1114/2191] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:36.909663 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d747cc7-03f2-4402-b94c-569c7cc5a1cb admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:36.910663 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2d747cc7-03f2-4402-b94c-569c7cc5a1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:36.988133 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d747cc7-03f2-4402-b94c-569c7cc5a1cb admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:36.992556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5e12d-13dd-406b-9f02-efd7e29088c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:36.993765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5e12d-13dd-406b-9f02-efd7e29088c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:36.994906 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5e12d-13dd-406b-9f02-efd7e29088c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:36.995276 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5e12d-13dd-406b-9f02-efd7e29088c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:37.006308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5e12d-13dd-406b-9f02-efd7e29088c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:37.007885 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5e12d-13dd-406b-9f02-efd7e29088c2 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:37.019945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1078/2192] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:20:37.357839 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef011b-ce77-4c2c-b74f-00dfd3825a47 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:37.358943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d6ef011b-ce77-4c2c-b74f-00dfd3825a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:37.382163 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef011b-ce77-4c2c-b74f-00dfd3825a47 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:37.388778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1366c-d530-43e7-bf53-49d1ef548d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:37.389602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1366c-d530-43e7-bf53-49d1ef548d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:37.390022 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1366c-d530-43e7-bf53-49d1ef548d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:37.390455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1366c-d530-43e7-bf53-49d1ef548d84 admin admin] PATH_INFO: `/v3/projects/d4df21f164ae41b09cf0f9186126468f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:37.391882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1366c-d530-43e7-bf53-49d1ef548d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4df21f164ae41b09cf0f9186126468f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:37.393945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1366c-d530-43e7-bf53-49d1ef548d84 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:37.445804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-46c1366c-d530-43e7-bf53-49d1ef548d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4df21f164ae41b09cf0f9186126468f', 'request_id': 'req-46c1366c-d530-43e7-bf53-49d1ef548d84'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:37.447335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:37.453890 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-46c1366c-d530-43e7-bf53-49d1ef548d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4df21f164ae41b09cf0f9186126468f', 'request_id': 'req-46c1366c-d530-43e7-bf53-49d1ef548d84'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:37.464321 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-46c1366c-d530-43e7-bf53-49d1ef548d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4df21f164ae41b09cf0f9186126468f', 'request_id': 'req-46c1366c-d530-43e7-bf53-49d1ef548d84'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:37.482194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-46c1366c-d530-43e7-bf53-49d1ef548d84 admin admin] The token cache is being invalidate because project d4df21f164ae41b09cf0f9186126468f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:37.482885 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-46c1366c-d530-43e7-bf53-49d1ef548d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:37.484013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-46c1366c-d530-43e7-bf53-49d1ef548d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:37.486955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1115/2193] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:37 2022] DELETE /identity/v3/projects/d4df21f164ae41b09cf0f9186126468f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:37.493462 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5e12d-13dd-406b-9f02-efd7e29088c2 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:37.515294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5e12d-13dd-406b-9f02-efd7e29088c2 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:37.592296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59828c9c-f184-4569-b095-1ad42979d4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:37.592815 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59828c9c-f184-4569-b095-1ad42979d4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:37.593085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59828c9c-f184-4569-b095-1ad42979d4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:37.593434 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59828c9c-f184-4569-b095-1ad42979d4f0 admin admin] PATH_INFO: `/v3/users/140f54f74a6d45aab02bf9a4354872f8` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:37.594670 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59828c9c-f184-4569-b095-1ad42979d4f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140f54f74a6d45aab02bf9a4354872f8)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:37.597256 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59828c9c-f184-4569-b095-1ad42979d4f0 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:37.631293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:37.653139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-59828c9c-f184-4569-b095-1ad42979d4f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140f54f74a6d45aab02bf9a4354872f8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:37.663598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-59828c9c-f184-4569-b095-1ad42979d4f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140f54f74a6d45aab02bf9a4354872f8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:37.664309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-59828c9c-f184-4569-b095-1ad42979d4f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140f54f74a6d45aab02bf9a4354872f8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:37.673196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-59828c9c-f184-4569-b095-1ad42979d4f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140f54f74a6d45aab02bf9a4354872f8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:37.688786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-59828c9c-f184-4569-b095-1ad42979d4f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140f54f74a6d45aab02bf9a4354872f8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:37.697594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1079/2194] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:37 2022] DELETE /identity/v3/users/140f54f74a6d45aab02bf9a4354872f8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:38.007090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1366c-d530-43e7-bf53-49d1ef548d84 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:38.008756 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-46c1366c-d530-43e7-bf53-49d1ef548d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:38.025420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1366c-d530-43e7-bf53-49d1ef548d84 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:38.097950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262b724-42b2-4c1a-93f1-c6189feb0bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:38.098770 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262b724-42b2-4c1a-93f1-c6189feb0bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:38.099040 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262b724-42b2-4c1a-93f1-c6189feb0bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:38.099452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262b724-42b2-4c1a-93f1-c6189feb0bd5 admin admin] PATH_INFO: `/v3/projects/e3fe86c1b38e42989675e13c58a8451f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:38.100759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262b724-42b2-4c1a-93f1-c6189feb0bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3fe86c1b38e42989675e13c58a8451f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:38.102905 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262b724-42b2-4c1a-93f1-c6189feb0bd5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:38.181366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7262b724-42b2-4c1a-93f1-c6189feb0bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3fe86c1b38e42989675e13c58a8451f', 'request_id': 'req-7262b724-42b2-4c1a-93f1-c6189feb0bd5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:38.194437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7262b724-42b2-4c1a-93f1-c6189feb0bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3fe86c1b38e42989675e13c58a8451f', 'request_id': 'req-7262b724-42b2-4c1a-93f1-c6189feb0bd5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:38.207893 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7262b724-42b2-4c1a-93f1-c6189feb0bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3fe86c1b38e42989675e13c58a8451f', 'request_id': 'req-7262b724-42b2-4c1a-93f1-c6189feb0bd5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:38.231704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7262b724-42b2-4c1a-93f1-c6189feb0bd5 admin admin] The token cache is being invalidate because project e3fe86c1b38e42989675e13c58a8451f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:38.232602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7262b724-42b2-4c1a-93f1-c6189feb0bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:38.233643 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7262b724-42b2-4c1a-93f1-c6189feb0bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:38.237495 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1116/2195] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:38 2022] DELETE /identity/v3/projects/e3fe86c1b38e42989675e13c58a8451f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:38.242709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb415dd5-2226-42bf-bb1a-eed3c0d96a8f None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:38.243231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb415dd5-2226-42bf-bb1a-eed3c0d96a8f None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:38.243571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb415dd5-2226-42bf-bb1a-eed3c0d96a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:38.275464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-fb415dd5-2226-42bf-bb1a-eed3c0d96a8f None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:38.277281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fb415dd5-2226-42bf-bb1a-eed3c0d96a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:38.382822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1080/2196] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:38.391837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de451031-7e63-4123-9e8b-e54f8166a085 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:38.392086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de451031-7e63-4123-9e8b-e54f8166a085 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:38.392746 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de451031-7e63-4123-9e8b-e54f8166a085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:38.436047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-de451031-7e63-4123-9e8b-e54f8166a085 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:38.452667 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-de451031-7e63-4123-9e8b-e54f8166a085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:38.464047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1117/2197] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:38.468288 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb415dd5-2226-42bf-bb1a-eed3c0d96a8f None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:38.490764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb415dd5-2226-42bf-bb1a-eed3c0d96a8f None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:38.497477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebddf40-63fc-4213-8168-f5fa347b8d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:38.498166 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebddf40-63fc-4213-8168-f5fa347b8d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:38.498166 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebddf40-63fc-4213-8168-f5fa347b8d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:38.498521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebddf40-63fc-4213-8168-f5fa347b8d41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:38.499344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebddf40-63fc-4213-8168-f5fa347b8d41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:20:38.499694 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebddf40-63fc-4213-8168-f5fa347b8d41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:38.501331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebddf40-63fc-4213-8168-f5fa347b8d41 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:38.516988 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1081/2198] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:20:38.521641 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de451031-7e63-4123-9e8b-e54f8166a085 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:38.531437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de451031-7e63-4123-9e8b-e54f8166a085 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:38.536778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250ef37-07f7-4209-be16-020efcc897ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:38.537518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250ef37-07f7-4209-be16-020efcc897ed admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:38.537878 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250ef37-07f7-4209-be16-020efcc897ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:38.538211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250ef37-07f7-4209-be16-020efcc897ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:38.539286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250ef37-07f7-4209-be16-020efcc897ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:38.540959 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250ef37-07f7-4209-be16-020efcc897ed admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:38.575718 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1118/2199] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:38 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:38.577416 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebddf40-63fc-4213-8168-f5fa347b8d41 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:38.590538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebddf40-63fc-4213-8168-f5fa347b8d41 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:38.653384 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ec47a-853e-49ad-bd9a-676584fa225a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:38.654020 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ec47a-853e-49ad-bd9a-676584fa225a admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:38.654291 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ec47a-853e-49ad-bd9a-676584fa225a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:38.654551 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ec47a-853e-49ad-bd9a-676584fa225a admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:38.655171 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ec47a-853e-49ad-bd9a-676584fa225a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:38.657122 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ec47a-853e-49ad-bd9a-676584fa225a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:38.680973 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1082/2200] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:38 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:38.685439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250ef37-07f7-4209-be16-020efcc897ed admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:38.696651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250ef37-07f7-4209-be16-020efcc897ed admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:38.702103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723f7cd-ff8f-439e-b9f4-c382f30eed86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:38.702936 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f7cd-ff8f-439e-b9f4-c382f30eed86 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:38.703214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f7cd-ff8f-439e-b9f4-c382f30eed86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:38.703481 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f7cd-ff8f-439e-b9f4-c382f30eed86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:38.704122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723f7cd-ff8f-439e-b9f4-c382f30eed86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:38.705746 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723f7cd-ff8f-439e-b9f4-c382f30eed86 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:38.716967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1119/2201] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:38.721171 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ec47a-853e-49ad-bd9a-676584fa225a admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:38.731116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ec47a-853e-49ad-bd9a-676584fa225a admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:38.736732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aefac6-76e7-4c3f-b8a9-094369c6f79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:38.737388 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aefac6-76e7-4c3f-b8a9-094369c6f79d admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:38.737717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aefac6-76e7-4c3f-b8a9-094369c6f79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:38.737980 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aefac6-76e7-4c3f-b8a9-094369c6f79d admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:38.738660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aefac6-76e7-4c3f-b8a9-094369c6f79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:38.740843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aefac6-76e7-4c3f-b8a9-094369c6f79d admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:38.752180 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1083/2202] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:38.756497 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723f7cd-ff8f-439e-b9f4-c382f30eed86 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:38.767238 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723f7cd-ff8f-439e-b9f4-c382f30eed86 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:38.771964 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08eec3-b425-416b-b5bf-e036708230b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:38.772616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08eec3-b425-416b-b5bf-e036708230b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:38.772883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08eec3-b425-416b-b5bf-e036708230b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:38.773155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08eec3-b425-416b-b5bf-e036708230b4 admin admin] PATH_INFO: `/v3/projects/698bf0494c4a4f0e9efdaa44414f75d8/users/0c4bf876fc964379a0c6cf41580d19b9/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:38.787962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08eec3-b425-416b-b5bf-e036708230b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698bf0494c4a4f0e9efdaa44414f75d8, user_id=0c4bf876fc964379a0c6cf41580d19b9, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:38.790780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08eec3-b425-416b-b5bf-e036708230b4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:38.806610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1120/2203] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:38 2022] PUT /identity/v3/projects/698bf0494c4a4f0e9efdaa44414f75d8/users/0c4bf876fc964379a0c6cf41580d19b9/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:38.817211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae760abe-bba9-437e-861d-665e4ca1009b None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:38.817484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae760abe-bba9-437e-861d-665e4ca1009b None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:38.817783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae760abe-bba9-437e-861d-665e4ca1009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:38.838643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:38.846579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-ae760abe-bba9-437e-861d-665e4ca1009b None None] MFA Rules not processed for user `0c4bf876fc964379a0c6cf41580d19b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:38.848268 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ae760abe-bba9-437e-861d-665e4ca1009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:38.915756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1084/2204] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:38.920437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08eec3-b425-416b-b5bf-e036708230b4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:38.926470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:38.984752 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08eec3-b425-416b-b5bf-e036708230b4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:38.990360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1355-8f1a-4f18-9eb5-cb76891066d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:38.990967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1355-8f1a-4f18-9eb5-cb76891066d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:38.991238 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1355-8f1a-4f18-9eb5-cb76891066d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:38.991492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a1355-8f1a-4f18-9eb5-cb76891066d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:38.992179 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a1355-8f1a-4f18-9eb5-cb76891066d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:38.994153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a1355-8f1a-4f18-9eb5-cb76891066d7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:39.032171 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1121/2205] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:38 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:39.038072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae760abe-bba9-437e-861d-665e4ca1009b None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:39.059279 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae760abe-bba9-437e-861d-665e4ca1009b None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:39.150015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4bae2-5e6e-4f00-9ab0-7dca5bb6ced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:39.150641 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4bae2-5e6e-4f00-9ab0-7dca5bb6ced6 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:39.150911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4bae2-5e6e-4f00-9ab0-7dca5bb6ced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:39.151170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4bae2-5e6e-4f00-9ab0-7dca5bb6ced6 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:39.151803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4bae2-5e6e-4f00-9ab0-7dca5bb6ced6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:39.153954 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4bae2-5e6e-4f00-9ab0-7dca5bb6ced6 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:39.181107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1085/2206] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:39 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:39.185112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1355-8f1a-4f18-9eb5-cb76891066d7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:39.196446 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a1355-8f1a-4f18-9eb5-cb76891066d7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:39.201830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d24489-d5a3-4af3-a6f0-16591a454a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:39.202450 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d24489-d5a3-4af3-a6f0-16591a454a4a admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:39.202786 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d24489-d5a3-4af3-a6f0-16591a454a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:39.203078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d24489-d5a3-4af3-a6f0-16591a454a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:39.203877 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d24489-d5a3-4af3-a6f0-16591a454a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:39.205469 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d24489-d5a3-4af3-a6f0-16591a454a4a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:39.217035 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1122/2207] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:20:39.221388 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4bae2-5e6e-4f00-9ab0-7dca5bb6ced6 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:39.231762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4bae2-5e6e-4f00-9ab0-7dca5bb6ced6 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:39.236544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4e4be-a5f1-4a91-a3a3-78a57a8354c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:39.237194 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4e4be-a5f1-4a91-a3a3-78a57a8354c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:39.237461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4e4be-a5f1-4a91-a3a3-78a57a8354c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:39.237776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4e4be-a5f1-4a91-a3a3-78a57a8354c0 admin admin] PATH_INFO: `/v3/projects/c534c0c9967b43e2ac830cde0bb3a8cb/users/cbbb13088a484abe8e2e2c24ded5474e/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:39.253086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4e4be-a5f1-4a91-a3a3-78a57a8354c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c534c0c9967b43e2ac830cde0bb3a8cb, user_id=cbbb13088a484abe8e2e2c24ded5474e, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:39.255771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4e4be-a5f1-4a91-a3a3-78a57a8354c0 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:39.270160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1086/2208] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:39 2022] PUT /identity/v3/projects/c534c0c9967b43e2ac830cde0bb3a8cb/users/cbbb13088a484abe8e2e2c24ded5474e/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:39.274445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d24489-d5a3-4af3-a6f0-16591a454a4a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:39.285324 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d24489-d5a3-4af3-a6f0-16591a454a4a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:39.342944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95c3fb-6e03-414e-9f76-85921bc93a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:39.343572 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95c3fb-6e03-414e-9f76-85921bc93a57 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:39.343844 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95c3fb-6e03-414e-9f76-85921bc93a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:39.344109 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95c3fb-6e03-414e-9f76-85921bc93a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:39.344758 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95c3fb-6e03-414e-9f76-85921bc93a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:39.346381 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95c3fb-6e03-414e-9f76-85921bc93a57 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:39.356039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1123/2209] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:39.360575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4e4be-a5f1-4a91-a3a3-78a57a8354c0 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:39.372054 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4e4be-a5f1-4a91-a3a3-78a57a8354c0 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:39.377840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4972e-d5ac-41be-8f2b-576b696aa93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:39.378498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4972e-d5ac-41be-8f2b-576b696aa93a admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:39.378771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4972e-d5ac-41be-8f2b-576b696aa93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:39.379037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4972e-d5ac-41be-8f2b-576b696aa93a admin admin] PATH_INFO: `/v3/projects/c534c0c9967b43e2ac830cde0bb3a8cb/users/cbbb13088a484abe8e2e2c24ded5474e/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:39.381211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4972e-d5ac-41be-8f2b-576b696aa93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c534c0c9967b43e2ac830cde0bb3a8cb, user_id=cbbb13088a484abe8e2e2c24ded5474e, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:39.383893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4972e-d5ac-41be-8f2b-576b696aa93a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:39.394856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1087/2210] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:39 2022] PUT /identity/v3/projects/c534c0c9967b43e2ac830cde0bb3a8cb/users/cbbb13088a484abe8e2e2c24ded5474e/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:39.406515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23af64e-0ceb-492d-96ec-0674604a8e8c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:39.406882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23af64e-0ceb-492d-96ec-0674604a8e8c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:39.407145 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23af64e-0ceb-492d-96ec-0674604a8e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:39.437029 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c23af64e-0ceb-492d-96ec-0674604a8e8c None None] MFA Rules not processed for user `cbbb13088a484abe8e2e2c24ded5474e`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:39.438290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c23af64e-0ceb-492d-96ec-0674604a8e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:39.512882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:39.519407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1124/2211] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:39.531079 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4972e-d5ac-41be-8f2b-576b696aa93a admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:39.533554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fec4972e-d5ac-41be-8f2b-576b696aa93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:39.618097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4972e-d5ac-41be-8f2b-576b696aa93a admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:39.622421 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819208f-31cc-4157-bc9c-29e061d87024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:39.623284 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819208f-31cc-4157-bc9c-29e061d87024 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:39.623743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819208f-31cc-4157-bc9c-29e061d87024 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:39.624180 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819208f-31cc-4157-bc9c-29e061d87024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:39.635072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:39.638231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819208f-31cc-4157-bc9c-29e061d87024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:39.639878 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819208f-31cc-4157-bc9c-29e061d87024 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:39.654467 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1088/2212] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:40.182335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23af64e-0ceb-492d-96ec-0674604a8e8c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:40.264591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23af64e-0ceb-492d-96ec-0674604a8e8c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:40.270292 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe00b8c-0fbf-4436-b59c-622d9754fcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:40.270944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe00b8c-0fbf-4436-b59c-622d9754fcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:40.271221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe00b8c-0fbf-4436-b59c-622d9754fcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:40.271487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe00b8c-0fbf-4436-b59c-622d9754fcc8 admin admin] PATH_INFO: `/v3/users/0c4bf876fc964379a0c6cf41580d19b9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:40.272641 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe00b8c-0fbf-4436-b59c-622d9754fcc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4bf876fc964379a0c6cf41580d19b9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:40.274624 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe00b8c-0fbf-4436-b59c-622d9754fcc8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:40.340665 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ffe00b8c-0fbf-4436-b59c-622d9754fcc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4bf876fc964379a0c6cf41580d19b9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:40.351794 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ffe00b8c-0fbf-4436-b59c-622d9754fcc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4bf876fc964379a0c6cf41580d19b9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:40.365745 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ffe00b8c-0fbf-4436-b59c-622d9754fcc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4bf876fc964379a0c6cf41580d19b9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:40.367017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ffe00b8c-0fbf-4436-b59c-622d9754fcc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4bf876fc964379a0c6cf41580d19b9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:40.377707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ffe00b8c-0fbf-4436-b59c-622d9754fcc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4bf876fc964379a0c6cf41580d19b9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:40.387790 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1125/2213] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:40 2022] DELETE /identity/v3/users/0c4bf876fc964379a0c6cf41580d19b9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:40.389475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92693731-bfbe-47d9-b653-e35713d04d53 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:40.389779 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92693731-bfbe-47d9-b653-e35713d04d53 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:40.390049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92693731-bfbe-47d9-b653-e35713d04d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:40.414196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-92693731-bfbe-47d9-b653-e35713d04d53 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:40.415403 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-92693731-bfbe-47d9-b653-e35713d04d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:40.476400 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1089/2214] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:40.487275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe00b8c-0fbf-4436-b59c-622d9754fcc8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:40.488817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ffe00b8c-0fbf-4436-b59c-622d9754fcc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:40.566126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe00b8c-0fbf-4436-b59c-622d9754fcc8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:40.569941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f36a28-1df0-4964-a1b9-e016ca143845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:40.570556 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f36a28-1df0-4964-a1b9-e016ca143845 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:40.570833 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f36a28-1df0-4964-a1b9-e016ca143845 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:40.571207 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f36a28-1df0-4964-a1b9-e016ca143845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:40.581759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f36a28-1df0-4964-a1b9-e016ca143845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:40.583201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f36a28-1df0-4964-a1b9-e016ca143845 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:40.593323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1126/2215] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:20:40.870100 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92693731-bfbe-47d9-b653-e35713d04d53 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:40.871625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-92693731-bfbe-47d9-b653-e35713d04d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:40.885011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92693731-bfbe-47d9-b653-e35713d04d53 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:40.889825 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e9076-98d0-445b-ad49-0e9cead66adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:40.890842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e9076-98d0-445b-ad49-0e9cead66adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:40.891141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e9076-98d0-445b-ad49-0e9cead66adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:40.891412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e9076-98d0-445b-ad49-0e9cead66adb admin admin] PATH_INFO: `/v3/projects/698bf0494c4a4f0e9efdaa44414f75d8` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:40.892691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e9076-98d0-445b-ad49-0e9cead66adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=698bf0494c4a4f0e9efdaa44414f75d8)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:40.894745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e9076-98d0-445b-ad49-0e9cead66adb admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:40.949030 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-063e9076-98d0-445b-ad49-0e9cead66adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698bf0494c4a4f0e9efdaa44414f75d8', 'request_id': 'req-063e9076-98d0-445b-ad49-0e9cead66adb'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:40.958812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-063e9076-98d0-445b-ad49-0e9cead66adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698bf0494c4a4f0e9efdaa44414f75d8', 'request_id': 'req-063e9076-98d0-445b-ad49-0e9cead66adb'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:40.966397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-063e9076-98d0-445b-ad49-0e9cead66adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698bf0494c4a4f0e9efdaa44414f75d8', 'request_id': 'req-063e9076-98d0-445b-ad49-0e9cead66adb'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:40.978235 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-063e9076-98d0-445b-ad49-0e9cead66adb admin admin] The token cache is being invalidate because project 698bf0494c4a4f0e9efdaa44414f75d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:40.978522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-063e9076-98d0-445b-ad49-0e9cead66adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:40.979801 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-063e9076-98d0-445b-ad49-0e9cead66adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:40.981016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1090/2216] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:40 2022] DELETE /identity/v3/projects/698bf0494c4a4f0e9efdaa44414f75d8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:40.985477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f36a28-1df0-4964-a1b9-e016ca143845 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:40.996739 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f36a28-1df0-4964-a1b9-e016ca143845 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:41.022034 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:41.097688 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e381f893-daae-431d-a2dd-f555b8b9ee1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:41.103640 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381f893-daae-431d-a2dd-f555b8b9ee1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:41.103939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381f893-daae-431d-a2dd-f555b8b9ee1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:41.104342 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381f893-daae-431d-a2dd-f555b8b9ee1a admin admin] PATH_INFO: `/v3/users/cbbb13088a484abe8e2e2c24ded5474e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:41.110051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381f893-daae-431d-a2dd-f555b8b9ee1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbbb13088a484abe8e2e2c24ded5474e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:41.112034 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e381f893-daae-431d-a2dd-f555b8b9ee1a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:41.197819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e381f893-daae-431d-a2dd-f555b8b9ee1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbbb13088a484abe8e2e2c24ded5474e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:41.208705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e381f893-daae-431d-a2dd-f555b8b9ee1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbbb13088a484abe8e2e2c24ded5474e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:41.227532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e381f893-daae-431d-a2dd-f555b8b9ee1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbbb13088a484abe8e2e2c24ded5474e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:41.228404 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e381f893-daae-431d-a2dd-f555b8b9ee1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbbb13088a484abe8e2e2c24ded5474e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:41.238505 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e381f893-daae-431d-a2dd-f555b8b9ee1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbbb13088a484abe8e2e2c24ded5474e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:41.246447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1127/2217] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:40 2022] DELETE /identity/v3/users/cbbb13088a484abe8e2e2c24ded5474e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:41.555282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e9076-98d0-445b-ad49-0e9cead66adb admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:41.557192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-063e9076-98d0-445b-ad49-0e9cead66adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:41.573722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e9076-98d0-445b-ad49-0e9cead66adb admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:41.635742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e212c-475c-4ba7-a5a8-ebc46e7cf62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:41.636371 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e212c-475c-4ba7-a5a8-ebc46e7cf62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:41.636645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e212c-475c-4ba7-a5a8-ebc46e7cf62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:41.636910 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e212c-475c-4ba7-a5a8-ebc46e7cf62e admin admin] PATH_INFO: `/v3/projects/c534c0c9967b43e2ac830cde0bb3a8cb` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:41.638071 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e212c-475c-4ba7-a5a8-ebc46e7cf62e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c534c0c9967b43e2ac830cde0bb3a8cb)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:41.640189 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e212c-475c-4ba7-a5a8-ebc46e7cf62e admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:41.664654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:41.697721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-626e212c-475c-4ba7-a5a8-ebc46e7cf62e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c534c0c9967b43e2ac830cde0bb3a8cb', 'request_id': 'req-626e212c-475c-4ba7-a5a8-ebc46e7cf62e'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:41.708075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-626e212c-475c-4ba7-a5a8-ebc46e7cf62e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c534c0c9967b43e2ac830cde0bb3a8cb', 'request_id': 'req-626e212c-475c-4ba7-a5a8-ebc46e7cf62e'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:41.715436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-626e212c-475c-4ba7-a5a8-ebc46e7cf62e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c534c0c9967b43e2ac830cde0bb3a8cb', 'request_id': 'req-626e212c-475c-4ba7-a5a8-ebc46e7cf62e'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:41.726401 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-626e212c-475c-4ba7-a5a8-ebc46e7cf62e admin admin] The token cache is being invalidate because project c534c0c9967b43e2ac830cde0bb3a8cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:41.726682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-626e212c-475c-4ba7-a5a8-ebc46e7cf62e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:41.727323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-626e212c-475c-4ba7-a5a8-ebc46e7cf62e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:41.728813 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1091/2218] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:41 2022] DELETE /identity/v3/projects/c534c0c9967b43e2ac830cde0bb3a8cb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:41.734375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652071f6-265d-4331-910c-93cf8658b23c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:41.734658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652071f6-265d-4331-910c-93cf8658b23c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:41.734925 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652071f6-265d-4331-910c-93cf8658b23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:41.755059 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-652071f6-265d-4331-910c-93cf8658b23c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:41.756237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-652071f6-265d-4331-910c-93cf8658b23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:41.814025 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1128/2219] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:41.822158 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06804aa8-ec7b-4e00-8124-14be918f41a0 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:41.822438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06804aa8-ec7b-4e00-8124-14be918f41a0 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:41.822708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06804aa8-ec7b-4e00-8124-14be918f41a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:41.842193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-06804aa8-ec7b-4e00-8124-14be918f41a0 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:41.843494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-06804aa8-ec7b-4e00-8124-14be918f41a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:41.851717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1092/2220] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:41.856182 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652071f6-265d-4331-910c-93cf8658b23c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:41.866729 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652071f6-265d-4331-910c-93cf8658b23c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:41.872639 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2a2fe-ed52-4496-85d6-8d43ac4e68f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:41.873276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2a2fe-ed52-4496-85d6-8d43ac4e68f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:41.873559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2a2fe-ed52-4496-85d6-8d43ac4e68f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:41.873854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2a2fe-ed52-4496-85d6-8d43ac4e68f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:41.874636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2a2fe-ed52-4496-85d6-8d43ac4e68f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:20:41.874941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2a2fe-ed52-4496-85d6-8d43ac4e68f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:41.876582 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2a2fe-ed52-4496-85d6-8d43ac4e68f3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:41.889196 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1129/2221] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:20:41.893912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06804aa8-ec7b-4e00-8124-14be918f41a0 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:41.903391 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06804aa8-ec7b-4e00-8124-14be918f41a0 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:41.909912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df90bc-6bb4-4145-b0c5-213f997e837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:41.910519 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df90bc-6bb4-4145-b0c5-213f997e837d admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:41.910785 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df90bc-6bb4-4145-b0c5-213f997e837d admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:41.911048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df90bc-6bb4-4145-b0c5-213f997e837d admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:41.911720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df90bc-6bb4-4145-b0c5-213f997e837d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:41.913785 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df90bc-6bb4-4145-b0c5-213f997e837d admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:41.952583 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1093/2222] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:41 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:41.957469 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2a2fe-ed52-4496-85d6-8d43ac4e68f3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:41.971090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2a2fe-ed52-4496-85d6-8d43ac4e68f3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:42.001163 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:42.035423 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dce9c-249d-4142-b330-6f8e7303bead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:42.035931 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dce9c-249d-4142-b330-6f8e7303bead admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:42.036202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dce9c-249d-4142-b330-6f8e7303bead admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:42.036476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dce9c-249d-4142-b330-6f8e7303bead admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:42.037084 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dce9c-249d-4142-b330-6f8e7303bead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:42.039016 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dce9c-249d-4142-b330-6f8e7303bead admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:42.060455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1130/2223] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:41 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:42.064899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df90bc-6bb4-4145-b0c5-213f997e837d admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:42.075891 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df90bc-6bb4-4145-b0c5-213f997e837d admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:42.080713 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17697008-1cf3-4f55-875c-232c9a1579ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:42.081311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697008-1cf3-4f55-875c-232c9a1579ae admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:42.081586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697008-1cf3-4f55-875c-232c9a1579ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:42.081857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17697008-1cf3-4f55-875c-232c9a1579ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:42.082534 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17697008-1cf3-4f55-875c-232c9a1579ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:42.084114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17697008-1cf3-4f55-875c-232c9a1579ae admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:42.094312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1094/2224] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:42.098491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dce9c-249d-4142-b330-6f8e7303bead admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:42.108550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dce9c-249d-4142-b330-6f8e7303bead admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:42.113845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c9b23-3835-4b10-a9bd-407c595577ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:42.114478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c9b23-3835-4b10-a9bd-407c595577ed admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:42.114832 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c9b23-3835-4b10-a9bd-407c595577ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:42.115463 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c9b23-3835-4b10-a9bd-407c595577ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:42.116067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c9b23-3835-4b10-a9bd-407c595577ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:42.117701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c9b23-3835-4b10-a9bd-407c595577ed admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:42.128961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1131/2225] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:42.133183 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17697008-1cf3-4f55-875c-232c9a1579ae admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:42.143809 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17697008-1cf3-4f55-875c-232c9a1579ae admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:42.149533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a0ca1-1e57-48d3-88c6-1a911cda44ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:42.150208 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a0ca1-1e57-48d3-88c6-1a911cda44ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:42.150482 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a0ca1-1e57-48d3-88c6-1a911cda44ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:42.150744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a0ca1-1e57-48d3-88c6-1a911cda44ed admin admin] PATH_INFO: `/v3/projects/0dd4563169524c02a407d84e5a38add2/users/77b492cb93814e629d70381827bae537/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:42.166156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a0ca1-1e57-48d3-88c6-1a911cda44ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd4563169524c02a407d84e5a38add2, user_id=77b492cb93814e629d70381827bae537, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:42.168859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a0ca1-1e57-48d3-88c6-1a911cda44ed admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:42.184094 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1095/2226] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:42 2022] PUT /identity/v3/projects/0dd4563169524c02a407d84e5a38add2/users/77b492cb93814e629d70381827bae537/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:42.195179 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9206b-f651-4d61-819e-ff084d3d20be None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:42.195480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9206b-f651-4d61-819e-ff084d3d20be None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:42.195756 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9206b-f651-4d61-819e-ff084d3d20be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:42.226101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1be9206b-f651-4d61-819e-ff084d3d20be None None] MFA Rules not processed for user `77b492cb93814e629d70381827bae537`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:42.227529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1be9206b-f651-4d61-819e-ff084d3d20be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:42.359833 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a0ca1-1e57-48d3-88c6-1a911cda44ed admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:42.362809 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fb3a0ca1-1e57-48d3-88c6-1a911cda44ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:42.371514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1132/2227] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:42.448471 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a0ca1-1e57-48d3-88c6-1a911cda44ed admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:42.452842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5716738-df23-41b5-b4d3-06a05db1d3a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:42.453648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716738-df23-41b5-b4d3-06a05db1d3a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:42.453964 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716738-df23-41b5-b4d3-06a05db1d3a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:42.454231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716738-df23-41b5-b4d3-06a05db1d3a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:42.465233 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5716738-df23-41b5-b4d3-06a05db1d3a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:42.466968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5716738-df23-41b5-b4d3-06a05db1d3a5 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:42.480092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1096/2228] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:46.711566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9206b-f651-4d61-819e-ff084d3d20be None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:46.715429 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1be9206b-f651-4d61-819e-ff084d3d20be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:46.796705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9206b-f651-4d61-819e-ff084d3d20be None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:46.814492 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b120174-6689-4ac2-9a45-e659009de1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:46.815159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b120174-6689-4ac2-9a45-e659009de1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:46.815632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b120174-6689-4ac2-9a45-e659009de1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:46.816047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b120174-6689-4ac2-9a45-e659009de1a9 admin admin] PATH_INFO: `/v3/users/c1956f67f9b642db9bcc06271bd300b4` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:46.817275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b120174-6689-4ac2-9a45-e659009de1a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1956f67f9b642db9bcc06271bd300b4)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:46.819940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b120174-6689-4ac2-9a45-e659009de1a9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:46.880734 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:46.892336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6b120174-6689-4ac2-9a45-e659009de1a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1956f67f9b642db9bcc06271bd300b4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:46.904020 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6b120174-6689-4ac2-9a45-e659009de1a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1956f67f9b642db9bcc06271bd300b4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:46.920283 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6b120174-6689-4ac2-9a45-e659009de1a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1956f67f9b642db9bcc06271bd300b4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:46.921127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6b120174-6689-4ac2-9a45-e659009de1a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1956f67f9b642db9bcc06271bd300b4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:46.939686 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6b120174-6689-4ac2-9a45-e659009de1a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1956f67f9b642db9bcc06271bd300b4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:46.954515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1133/2229] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:46 2022] DELETE /identity/v3/users/c1956f67f9b642db9bcc06271bd300b4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:47.250436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5716738-df23-41b5-b4d3-06a05db1d3a5 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:47.269296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5716738-df23-41b5-b4d3-06a05db1d3a5 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:47.344179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:47.368624 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7249d4-f081-4465-9df5-c94635c0c5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:47.369250 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7249d4-f081-4465-9df5-c94635c0c5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:47.369567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7249d4-f081-4465-9df5-c94635c0c5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:47.369809 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7249d4-f081-4465-9df5-c94635c0c5de admin admin] PATH_INFO: `/v3/projects/7e8b736000564feebead556938c9212a` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:47.371023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7249d4-f081-4465-9df5-c94635c0c5de admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8b736000564feebead556938c9212a)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:47.373914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7249d4-f081-4465-9df5-c94635c0c5de admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:47.462411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9c7249d4-f081-4465-9df5-c94635c0c5de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8b736000564feebead556938c9212a', 'request_id': 'req-9c7249d4-f081-4465-9df5-c94635c0c5de'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:47.483480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9c7249d4-f081-4465-9df5-c94635c0c5de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8b736000564feebead556938c9212a', 'request_id': 'req-9c7249d4-f081-4465-9df5-c94635c0c5de'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:47.493008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9c7249d4-f081-4465-9df5-c94635c0c5de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8b736000564feebead556938c9212a', 'request_id': 'req-9c7249d4-f081-4465-9df5-c94635c0c5de'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:47.513402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9c7249d4-f081-4465-9df5-c94635c0c5de admin admin] The token cache is being invalidate because project 7e8b736000564feebead556938c9212a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:47.513839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9c7249d4-f081-4465-9df5-c94635c0c5de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:47.514643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9c7249d4-f081-4465-9df5-c94635c0c5de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:47.516330 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1097/2230] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:47 2022] DELETE /identity/v3/projects/7e8b736000564feebead556938c9212a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:47.521125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b120174-6689-4ac2-9a45-e659009de1a9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:47.522880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6b120174-6689-4ac2-9a45-e659009de1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:47.539269 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b120174-6689-4ac2-9a45-e659009de1a9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:47.627777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea1d88-90a4-4cd2-b0a6-15e40ada49d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:47.628636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea1d88-90a4-4cd2-b0a6-15e40ada49d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:47.628917 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea1d88-90a4-4cd2-b0a6-15e40ada49d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:47.629219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea1d88-90a4-4cd2-b0a6-15e40ada49d7 admin admin] PATH_INFO: `/v3/users/0014fa9041b4403ab36d0b0bd4e44352` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:47.630715 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea1d88-90a4-4cd2-b0a6-15e40ada49d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0014fa9041b4403ab36d0b0bd4e44352)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:47.632961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea1d88-90a4-4cd2-b0a6-15e40ada49d7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:47.697404 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-36ea1d88-90a4-4cd2-b0a6-15e40ada49d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0014fa9041b4403ab36d0b0bd4e44352'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:47.706094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-36ea1d88-90a4-4cd2-b0a6-15e40ada49d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0014fa9041b4403ab36d0b0bd4e44352'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:47.719344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-36ea1d88-90a4-4cd2-b0a6-15e40ada49d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0014fa9041b4403ab36d0b0bd4e44352'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:47.720471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-36ea1d88-90a4-4cd2-b0a6-15e40ada49d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0014fa9041b4403ab36d0b0bd4e44352'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:47.733382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-36ea1d88-90a4-4cd2-b0a6-15e40ada49d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0014fa9041b4403ab36d0b0bd4e44352'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:47.743676 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1134/2231] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:47 2022] DELETE /identity/v3/users/0014fa9041b4403ab36d0b0bd4e44352 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:47.990990 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7249d4-f081-4465-9df5-c94635c0c5de admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:47.992993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9c7249d4-f081-4465-9df5-c94635c0c5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:48.018513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7249d4-f081-4465-9df5-c94635c0c5de admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:48.105122 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097d430-7b08-4e38-9161-ed06901bc4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:48.105924 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097d430-7b08-4e38-9161-ed06901bc4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:48.106133 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097d430-7b08-4e38-9161-ed06901bc4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:48.106527 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097d430-7b08-4e38-9161-ed06901bc4ad admin admin] PATH_INFO: `/v3/projects/c991ca0930ae466d8f0d4658d4d25714` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:48.107801 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097d430-7b08-4e38-9161-ed06901bc4ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=c991ca0930ae466d8f0d4658d4d25714)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:48.113197 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097d430-7b08-4e38-9161-ed06901bc4ad admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:48.186607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6097d430-7b08-4e38-9161-ed06901bc4ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c991ca0930ae466d8f0d4658d4d25714', 'request_id': 'req-6097d430-7b08-4e38-9161-ed06901bc4ad'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:48.198960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6097d430-7b08-4e38-9161-ed06901bc4ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c991ca0930ae466d8f0d4658d4d25714', 'request_id': 'req-6097d430-7b08-4e38-9161-ed06901bc4ad'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:48.213288 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6097d430-7b08-4e38-9161-ed06901bc4ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c991ca0930ae466d8f0d4658d4d25714', 'request_id': 'req-6097d430-7b08-4e38-9161-ed06901bc4ad'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:48.229480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6097d430-7b08-4e38-9161-ed06901bc4ad admin admin] The token cache is being invalidate because project c991ca0930ae466d8f0d4658d4d25714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:48.229847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6097d430-7b08-4e38-9161-ed06901bc4ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:48.230503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6097d430-7b08-4e38-9161-ed06901bc4ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:48.232218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1098/2232] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:47 2022] DELETE /identity/v3/projects/c991ca0930ae466d8f0d4658d4d25714 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:48.239308 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529886fa-8d17-458e-a95a-2817b0650267 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:48.240361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529886fa-8d17-458e-a95a-2817b0650267 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:48.240882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529886fa-8d17-458e-a95a-2817b0650267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:48.265612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-529886fa-8d17-458e-a95a-2817b0650267 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:48.267184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-529886fa-8d17-458e-a95a-2817b0650267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:48.306819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:48.343251 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1135/2233] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:48.351732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844e158-69e4-4a0c-af85-3619e64b6dfe None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:48.352312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844e158-69e4-4a0c-af85-3619e64b6dfe None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:48.352312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844e158-69e4-4a0c-af85-3619e64b6dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:48.374083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-a844e158-69e4-4a0c-af85-3619e64b6dfe None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:48.376202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a844e158-69e4-4a0c-af85-3619e64b6dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:48.384836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1099/2234] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:48.389636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529886fa-8d17-458e-a95a-2817b0650267 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:48.400791 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529886fa-8d17-458e-a95a-2817b0650267 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:48.405784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cf785-a649-4d46-b8b2-e980bbf3ae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:48.406468 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cf785-a649-4d46-b8b2-e980bbf3ae37 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:48.406676 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cf785-a649-4d46-b8b2-e980bbf3ae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:48.407047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cf785-a649-4d46-b8b2-e980bbf3ae37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:48.407740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cf785-a649-4d46-b8b2-e980bbf3ae37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:20:48.408292 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cf785-a649-4d46-b8b2-e980bbf3ae37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:48.410137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cf785-a649-4d46-b8b2-e980bbf3ae37 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:48.424928 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1136/2235] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:20:48.429457 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844e158-69e4-4a0c-af85-3619e64b6dfe None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:48.433880 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:48.440935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844e158-69e4-4a0c-af85-3619e64b6dfe None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:48.451700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a7b1c-f38b-4803-ac46-23a8abaafa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:48.452465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a7b1c-f38b-4803-ac46-23a8abaafa1a admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:48.452820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a7b1c-f38b-4803-ac46-23a8abaafa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:48.453116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a7b1c-f38b-4803-ac46-23a8abaafa1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:48.453882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a7b1c-f38b-4803-ac46-23a8abaafa1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:48.456139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a7b1c-f38b-4803-ac46-23a8abaafa1a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:48.476149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f0074-a2e4-42fa-98b9-e3221c940609 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:48.476430 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f0074-a2e4-42fa-98b9-e3221c940609 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:48.476734 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f0074-a2e4-42fa-98b9-e3221c940609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:48.514480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c52f0074-a2e4-42fa-98b9-e3221c940609 None None] MFA Rules not processed for user `53f714c2065b467699ec9c2b26d71c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:48.515977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c52f0074-a2e4-42fa-98b9-e3221c940609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:48.529383 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1100/2236] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:48 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:48.535289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a7b1c-f38b-4803-ac46-23a8abaafa1a admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:48.594533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1137/2237] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:48.612492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a7b1c-f38b-4803-ac46-23a8abaafa1a admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:48.620187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762ef6d-f4c1-4094-b5f8-57ed527f50c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:48.621149 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762ef6d-f4c1-4094-b5f8-57ed527f50c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:48.621609 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762ef6d-f4c1-4094-b5f8-57ed527f50c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:48.621934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762ef6d-f4c1-4094-b5f8-57ed527f50c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:48.622570 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762ef6d-f4c1-4094-b5f8-57ed527f50c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:48.624706 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762ef6d-f4c1-4094-b5f8-57ed527f50c7 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:48.659930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1101/2238] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:48 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:48.666819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f0074-a2e4-42fa-98b9-e3221c940609 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:48.681455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f0074-a2e4-42fa-98b9-e3221c940609 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:48.685978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57ad0b-ace2-4725-9b5e-12227eadffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:48.686701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57ad0b-ace2-4725-9b5e-12227eadffdd admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:48.687104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57ad0b-ace2-4725-9b5e-12227eadffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:48.687497 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57ad0b-ace2-4725-9b5e-12227eadffdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:48.700184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57ad0b-ace2-4725-9b5e-12227eadffdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:48.702112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57ad0b-ace2-4725-9b5e-12227eadffdd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:48.718974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1138/2239] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:48.723709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762ef6d-f4c1-4094-b5f8-57ed527f50c7 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:48.734524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762ef6d-f4c1-4094-b5f8-57ed527f50c7 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:48.739768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60412210-7109-4de1-bd9d-a1e3a9c5a90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:48.740890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412210-7109-4de1-bd9d-a1e3a9c5a90d admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:48.741270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412210-7109-4de1-bd9d-a1e3a9c5a90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:48.741635 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412210-7109-4de1-bd9d-a1e3a9c5a90d admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:48.743052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60412210-7109-4de1-bd9d-a1e3a9c5a90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:48.745032 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60412210-7109-4de1-bd9d-a1e3a9c5a90d admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:48.757639 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1102/2240] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:48.763249 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57ad0b-ace2-4725-9b5e-12227eadffdd admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:48.783500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57ad0b-ace2-4725-9b5e-12227eadffdd admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:48.793300 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b08ab-6197-439a-9c12-b63621523616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:48.795164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b08ab-6197-439a-9c12-b63621523616 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:48.795953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b08ab-6197-439a-9c12-b63621523616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:48.796684 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b08ab-6197-439a-9c12-b63621523616 admin admin] PATH_INFO: `/v3/projects/7647100486014f6b9af7e74cd93cb189/users/c82a1ad266524fe8bbf54daa87b24685/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:48.825393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b08ab-6197-439a-9c12-b63621523616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7647100486014f6b9af7e74cd93cb189, user_id=c82a1ad266524fe8bbf54daa87b24685, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:48.828719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b08ab-6197-439a-9c12-b63621523616 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:48.851597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1139/2241] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:48 2022] PUT /identity/v3/projects/7647100486014f6b9af7e74cd93cb189/users/c82a1ad266524fe8bbf54daa87b24685/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:48.865191 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989983e0-98a2-41b6-9e56-bce2c0ccd5c6 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:48.865484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989983e0-98a2-41b6-9e56-bce2c0ccd5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:48.865908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989983e0-98a2-41b6-9e56-bce2c0ccd5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:48.897535 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-989983e0-98a2-41b6-9e56-bce2c0ccd5c6 None None] MFA Rules not processed for user `c82a1ad266524fe8bbf54daa87b24685`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:48.902634 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-989983e0-98a2-41b6-9e56-bce2c0ccd5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:49.018877 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1103/2242] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:49.032031 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b08ab-6197-439a-9c12-b63621523616 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:49.034066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b55b08ab-6197-439a-9c12-b63621523616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:49.132393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b08ab-6197-439a-9c12-b63621523616 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:49.138117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ef94c-cf5a-421a-b07c-48fe1845eb65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:49.140073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ef94c-cf5a-421a-b07c-48fe1845eb65 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:49.141204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ef94c-cf5a-421a-b07c-48fe1845eb65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:49.141674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ef94c-cf5a-421a-b07c-48fe1845eb65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:49.167404 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ef94c-cf5a-421a-b07c-48fe1845eb65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:49.170361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ef94c-cf5a-421a-b07c-48fe1845eb65 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:49.182821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1140/2243] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:20:49.206190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989983e0-98a2-41b6-9e56-bce2c0ccd5c6 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:49.304483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:49.329285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989983e0-98a2-41b6-9e56-bce2c0ccd5c6 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:49.336844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39dd83-d159-40e7-9886-50486abe0fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:49.337907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39dd83-d159-40e7-9886-50486abe0fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:49.338360 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39dd83-d159-40e7-9886-50486abe0fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:49.338810 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39dd83-d159-40e7-9886-50486abe0fb4 admin admin] PATH_INFO: `/v3/users/c82a1ad266524fe8bbf54daa87b24685` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:49.340890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39dd83-d159-40e7-9886-50486abe0fb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82a1ad266524fe8bbf54daa87b24685)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:49.343694 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39dd83-d159-40e7-9886-50486abe0fb4 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:49.424118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7b39dd83-d159-40e7-9886-50486abe0fb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82a1ad266524fe8bbf54daa87b24685'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:49.437252 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7b39dd83-d159-40e7-9886-50486abe0fb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82a1ad266524fe8bbf54daa87b24685'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:49.440074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7b39dd83-d159-40e7-9886-50486abe0fb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82a1ad266524fe8bbf54daa87b24685'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:49.456556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7b39dd83-d159-40e7-9886-50486abe0fb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82a1ad266524fe8bbf54daa87b24685'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:49.493498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7b39dd83-d159-40e7-9886-50486abe0fb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82a1ad266524fe8bbf54daa87b24685'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:49.507806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1104/2244] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:49 2022] DELETE /identity/v3/users/c82a1ad266524fe8bbf54daa87b24685 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:49.517556 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c152097-1089-45b5-b0ab-33cb3c8e2968 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:49.518265 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c152097-1089-45b5-b0ab-33cb3c8e2968 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:49.518746 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c152097-1089-45b5-b0ab-33cb3c8e2968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:49.547651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2c152097-1089-45b5-b0ab-33cb3c8e2968 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:49.549908 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2c152097-1089-45b5-b0ab-33cb3c8e2968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:49.594817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:49.634442 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1141/2245] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:49.645405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39dd83-d159-40e7-9886-50486abe0fb4 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:49.646984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7b39dd83-d159-40e7-9886-50486abe0fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:49.716256 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39dd83-d159-40e7-9886-50486abe0fb4 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:49.720136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61cef0-3f91-49ef-968b-252e4394c01d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:49.720876 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61cef0-3f91-49ef-968b-252e4394c01d service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:49.721147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61cef0-3f91-49ef-968b-252e4394c01d service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:49.721408 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61cef0-3f91-49ef-968b-252e4394c01d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:49.735300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61cef0-3f91-49ef-968b-252e4394c01d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:49.737058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61cef0-3f91-49ef-968b-252e4394c01d service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:49.755487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1105/2246] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:50.089004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c152097-1089-45b5-b0ab-33cb3c8e2968 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:50.090823 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2c152097-1089-45b5-b0ab-33cb3c8e2968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:50.115988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c152097-1089-45b5-b0ab-33cb3c8e2968 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:50.122167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcc55d-84d6-4f4e-af60-95350cfb4a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:50.122824 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcc55d-84d6-4f4e-af60-95350cfb4a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:50.123108 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcc55d-84d6-4f4e-af60-95350cfb4a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:50.123377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcc55d-84d6-4f4e-af60-95350cfb4a5a admin admin] PATH_INFO: `/v3/projects/7647100486014f6b9af7e74cd93cb189` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:50.124628 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcc55d-84d6-4f4e-af60-95350cfb4a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7647100486014f6b9af7e74cd93cb189)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:50.126650 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcc55d-84d6-4f4e-af60-95350cfb4a5a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:50.190563 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-95dcc55d-84d6-4f4e-af60-95350cfb4a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7647100486014f6b9af7e74cd93cb189', 'request_id': 'req-95dcc55d-84d6-4f4e-af60-95350cfb4a5a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:50.196541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-95dcc55d-84d6-4f4e-af60-95350cfb4a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7647100486014f6b9af7e74cd93cb189', 'request_id': 'req-95dcc55d-84d6-4f4e-af60-95350cfb4a5a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:50.207143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-95dcc55d-84d6-4f4e-af60-95350cfb4a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7647100486014f6b9af7e74cd93cb189', 'request_id': 'req-95dcc55d-84d6-4f4e-af60-95350cfb4a5a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:50.220202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-95dcc55d-84d6-4f4e-af60-95350cfb4a5a admin admin] The token cache is being invalidate because project 7647100486014f6b9af7e74cd93cb189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:50.220514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-95dcc55d-84d6-4f4e-af60-95350cfb4a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:50.221232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-95dcc55d-84d6-4f4e-af60-95350cfb4a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:50.222849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1142/2247] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:50 2022] DELETE /identity/v3/projects/7647100486014f6b9af7e74cd93cb189 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:50.229170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d60808-eb06-4ab7-b1d4-66ac229d16c6 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:50.229551 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d60808-eb06-4ab7-b1d4-66ac229d16c6 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:50.229987 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d60808-eb06-4ab7-b1d4-66ac229d16c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:50.255483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-01d60808-eb06-4ab7-b1d4-66ac229d16c6 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:50.256926 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-01d60808-eb06-4ab7-b1d4-66ac229d16c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:50.326919 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1106/2248] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:50.335285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37f385-614a-4f91-a0e4-7e3bf1b86390 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:50.335576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37f385-614a-4f91-a0e4-7e3bf1b86390 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:50.335846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37f385-614a-4f91-a0e4-7e3bf1b86390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:50.360029 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5d37f385-614a-4f91-a0e4-7e3bf1b86390 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:50.361252 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5d37f385-614a-4f91-a0e4-7e3bf1b86390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:50.378072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d60808-eb06-4ab7-b1d4-66ac229d16c6 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:50.379698 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1143/2249] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:50.391974 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d60808-eb06-4ab7-b1d4-66ac229d16c6 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:50.397786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0ce64-8d5f-4e65-8913-75b54e569d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:50.398460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0ce64-8d5f-4e65-8913-75b54e569d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:50.398726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0ce64-8d5f-4e65-8913-75b54e569d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:50.399004 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0ce64-8d5f-4e65-8913-75b54e569d11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:50.399664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0ce64-8d5f-4e65-8913-75b54e569d11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:20:50.399953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0ce64-8d5f-4e65-8913-75b54e569d11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:50.401745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0ce64-8d5f-4e65-8913-75b54e569d11 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:50.410442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:50.417761 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1107/2250] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:20:50.425695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37f385-614a-4f91-a0e4-7e3bf1b86390 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:50.437728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37f385-614a-4f91-a0e4-7e3bf1b86390 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:50.443536 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f0732-34a3-4f42-b0c3-16db959ed0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:50.444206 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f0732-34a3-4f42-b0c3-16db959ed0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:50.444512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f0732-34a3-4f42-b0c3-16db959ed0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:50.444788 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f0732-34a3-4f42-b0c3-16db959ed0b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:50.445828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f0732-34a3-4f42-b0c3-16db959ed0b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:50.447971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f0732-34a3-4f42-b0c3-16db959ed0b2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:50.495342 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1144/2251] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:50 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:20:50.499791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0ce64-8d5f-4e65-8913-75b54e569d11 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:50.511538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0ce64-8d5f-4e65-8913-75b54e569d11 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:50.601663 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c697-f6a2-4307-96b0-488a8ece2c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:50.602289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c697-f6a2-4307-96b0-488a8ece2c90 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:50.602558 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c697-f6a2-4307-96b0-488a8ece2c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:50.602822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c697-f6a2-4307-96b0-488a8ece2c90 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:50.603568 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4c697-f6a2-4307-96b0-488a8ece2c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:50.605974 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4c697-f6a2-4307-96b0-488a8ece2c90 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:50.639277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1108/2252] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:50 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:50.643222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f0732-34a3-4f42-b0c3-16db959ed0b2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:50.659466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f0732-34a3-4f42-b0c3-16db959ed0b2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:50.672573 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dca3f-a153-4d54-8d1c-94385a39ee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:50.674159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dca3f-a153-4d54-8d1c-94385a39ee6f admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:50.674606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dca3f-a153-4d54-8d1c-94385a39ee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:50.674886 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dca3f-a153-4d54-8d1c-94385a39ee6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:50.675554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162dca3f-a153-4d54-8d1c-94385a39ee6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:50.677930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162dca3f-a153-4d54-8d1c-94385a39ee6f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:50.693477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1145/2253] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:50.698600 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c697-f6a2-4307-96b0-488a8ece2c90 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:50.713660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c697-f6a2-4307-96b0-488a8ece2c90 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:50.718572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43575825-38d7-470c-bc3a-5039385443c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:50.719189 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43575825-38d7-470c-bc3a-5039385443c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:50.719456 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43575825-38d7-470c-bc3a-5039385443c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:50.719717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43575825-38d7-470c-bc3a-5039385443c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:50.720363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43575825-38d7-470c-bc3a-5039385443c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:50.722019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43575825-38d7-470c-bc3a-5039385443c8 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:50.737989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1109/2254] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:20:50.747034 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dca3f-a153-4d54-8d1c-94385a39ee6f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:50.759151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162dca3f-a153-4d54-8d1c-94385a39ee6f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:50.771416 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a7230-e4a0-4a1f-be93-4b9ce419c955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:50.776304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a7230-e4a0-4a1f-be93-4b9ce419c955 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:50.776304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a7230-e4a0-4a1f-be93-4b9ce419c955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:50.776934 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a7230-e4a0-4a1f-be93-4b9ce419c955 admin admin] PATH_INFO: `/v3/projects/fa816b337d0f4e26b09c5b2fcb72bd27/users/e6a73700604d4c1a9cedd1ec4601ce3f/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:50.800542 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a7230-e4a0-4a1f-be93-4b9ce419c955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa816b337d0f4e26b09c5b2fcb72bd27, user_id=e6a73700604d4c1a9cedd1ec4601ce3f, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:50.805117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a7230-e4a0-4a1f-be93-4b9ce419c955 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:50.831317 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1146/2255] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:50 2022] PUT /identity/v3/projects/fa816b337d0f4e26b09c5b2fcb72bd27/users/e6a73700604d4c1a9cedd1ec4601ce3f/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:50.843949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2338482-14a7-408a-afae-3e12f469bd5f None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:50.844283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2338482-14a7-408a-afae-3e12f469bd5f None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:50.844504 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2338482-14a7-408a-afae-3e12f469bd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:50.880969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-e2338482-14a7-408a-afae-3e12f469bd5f None None] MFA Rules not processed for user `e6a73700604d4c1a9cedd1ec4601ce3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:50.882598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e2338482-14a7-408a-afae-3e12f469bd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:50.968497 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1110/2256] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:50.973545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a7230-e4a0-4a1f-be93-4b9ce419c955 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:51.036425 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:51.042972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a7230-e4a0-4a1f-be93-4b9ce419c955 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:51.050336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a529c18-bf4d-4fa0-ab9e-779b3aa4808d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:51.051398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a529c18-bf4d-4fa0-ab9e-779b3aa4808d admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:51.051707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a529c18-bf4d-4fa0-ab9e-779b3aa4808d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:51.052011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a529c18-bf4d-4fa0-ab9e-779b3aa4808d admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:51.052581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a529c18-bf4d-4fa0-ab9e-779b3aa4808d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:51.054545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a529c18-bf4d-4fa0-ab9e-779b3aa4808d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:51.090252 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1147/2257] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:50 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:51.094546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2338482-14a7-408a-afae-3e12f469bd5f None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:51.107670 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2338482-14a7-408a-afae-3e12f469bd5f None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:51.178852 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e5931-844c-4245-8a55-e03821cb6231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:51.179476 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e5931-844c-4245-8a55-e03821cb6231 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:51.179742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e5931-844c-4245-8a55-e03821cb6231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:51.180002 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e5931-844c-4245-8a55-e03821cb6231 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:51.180631 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e5931-844c-4245-8a55-e03821cb6231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:51.182619 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e5931-844c-4245-8a55-e03821cb6231 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:51.194239 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:51.217212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1111/2258] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:51 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:51.218783 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a529c18-bf4d-4fa0-ab9e-779b3aa4808d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:51.230932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a529c18-bf4d-4fa0-ab9e-779b3aa4808d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:51.237131 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a9b64-5855-4a65-a93b-0d4e9d320b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:51.238155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a9b64-5855-4a65-a93b-0d4e9d320b39 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:51.238511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a9b64-5855-4a65-a93b-0d4e9d320b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:51.238914 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a9b64-5855-4a65-a93b-0d4e9d320b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:51.239701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a9b64-5855-4a65-a93b-0d4e9d320b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:51.243886 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a9b64-5855-4a65-a93b-0d4e9d320b39 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:51.255949 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1148/2259] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:20:51.260138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e5931-844c-4245-8a55-e03821cb6231 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:51.270912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e5931-844c-4245-8a55-e03821cb6231 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:51.276042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc40fb-b317-41ef-991f-b7630970f576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:51.276661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc40fb-b317-41ef-991f-b7630970f576 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:51.276932 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc40fb-b317-41ef-991f-b7630970f576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:51.277197 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc40fb-b317-41ef-991f-b7630970f576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:51.277876 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc40fb-b317-41ef-991f-b7630970f576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:51.279547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc40fb-b317-41ef-991f-b7630970f576 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:51.295174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1112/2260] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:51.296715 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a9b64-5855-4a65-a93b-0d4e9d320b39 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:51.307037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a9b64-5855-4a65-a93b-0d4e9d320b39 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:51.311988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f0f70-512c-4ea6-bb1f-fd4169899027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:51.312976 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f0f70-512c-4ea6-bb1f-fd4169899027 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:51.313262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f0f70-512c-4ea6-bb1f-fd4169899027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:51.313534 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f0f70-512c-4ea6-bb1f-fd4169899027 admin admin] PATH_INFO: `/v3/projects/8e8099c69bff4f9c894cb88643ac62e6/users/98af69be033e46bc97f66d0d30a7a944/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:51.334163 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f0f70-512c-4ea6-bb1f-fd4169899027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e8099c69bff4f9c894cb88643ac62e6, user_id=98af69be033e46bc97f66d0d30a7a944, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:51.337223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f0f70-512c-4ea6-bb1f-fd4169899027 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:51.355533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1149/2261] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:51 2022] PUT /identity/v3/projects/8e8099c69bff4f9c894cb88643ac62e6/users/98af69be033e46bc97f66d0d30a7a944/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:51.366170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfa9b0-93b4-4495-a0a8-d19eba8fc369 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:51.366447 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfa9b0-93b4-4495-a0a8-d19eba8fc369 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:51.366716 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfa9b0-93b4-4495-a0a8-d19eba8fc369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:51.400172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-3fcfa9b0-93b4-4495-a0a8-d19eba8fc369 None None] MFA Rules not processed for user `98af69be033e46bc97f66d0d30a7a944`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:51.401453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3fcfa9b0-93b4-4495-a0a8-d19eba8fc369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:51.474768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1113/2262] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:51.479370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f0f70-512c-4ea6-bb1f-fd4169899027 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:51.555193 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f0f70-512c-4ea6-bb1f-fd4169899027 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:51.560543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41294244-27df-4eab-b3bf-60add6b491e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:51.561236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41294244-27df-4eab-b3bf-60add6b491e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:51.561633 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41294244-27df-4eab-b3bf-60add6b491e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:51.562061 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41294244-27df-4eab-b3bf-60add6b491e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:51.562838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41294244-27df-4eab-b3bf-60add6b491e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:51.564942 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41294244-27df-4eab-b3bf-60add6b491e3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:51.599104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1150/2263] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:51 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:51.603213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfa9b0-93b4-4495-a0a8-d19eba8fc369 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:51.616796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfa9b0-93b4-4495-a0a8-d19eba8fc369 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:51.688517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292302f-ebab-460a-a9f7-de40476d6806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:51.689102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292302f-ebab-460a-a9f7-de40476d6806 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:51.689427 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292302f-ebab-460a-a9f7-de40476d6806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:51.689736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292302f-ebab-460a-a9f7-de40476d6806 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:51.690383 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292302f-ebab-460a-a9f7-de40476d6806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:51.692334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292302f-ebab-460a-a9f7-de40476d6806 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:51.723312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1114/2264] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:51 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:51.727208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41294244-27df-4eab-b3bf-60add6b491e3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:51.746669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41294244-27df-4eab-b3bf-60add6b491e3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:51.757280 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d47d5a-fdf4-44d4-b175-39c018bfc67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:51.758476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d47d5a-fdf4-44d4-b175-39c018bfc67b admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:51.758923 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d47d5a-fdf4-44d4-b175-39c018bfc67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:51.759386 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d47d5a-fdf4-44d4-b175-39c018bfc67b admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:51.760261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d47d5a-fdf4-44d4-b175-39c018bfc67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:51.762201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d47d5a-fdf4-44d4-b175-39c018bfc67b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:51.776826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1151/2265] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:51.781116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292302f-ebab-460a-a9f7-de40476d6806 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:51.792853 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292302f-ebab-460a-a9f7-de40476d6806 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:51.798855 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe4823-059b-497c-8cc2-4db288cb2330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:51.799649 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe4823-059b-497c-8cc2-4db288cb2330 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:51.799929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe4823-059b-497c-8cc2-4db288cb2330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:51.800204 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe4823-059b-497c-8cc2-4db288cb2330 admin admin] PATH_INFO: `/v3/projects/c00bbfe956664be19c1a849635933144/users/a24126d4256d45c9aa688e1c70a66a4a/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:51.825927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe4823-059b-497c-8cc2-4db288cb2330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00bbfe956664be19c1a849635933144, user_id=a24126d4256d45c9aa688e1c70a66a4a, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:51.828691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe4823-059b-497c-8cc2-4db288cb2330 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:51.849978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1115/2266] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:51 2022] PUT /identity/v3/projects/c00bbfe956664be19c1a849635933144/users/a24126d4256d45c9aa688e1c70a66a4a/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:51.853007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d47d5a-fdf4-44d4-b175-39c018bfc67b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:51.869460 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d47d5a-fdf4-44d4-b175-39c018bfc67b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:52.034784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791a4f9-dba9-4b1b-9864-50ffe3deabab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:52.035368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791a4f9-dba9-4b1b-9864-50ffe3deabab admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:52.035955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791a4f9-dba9-4b1b-9864-50ffe3deabab admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:52.036131 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791a4f9-dba9-4b1b-9864-50ffe3deabab admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:52.036683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791a4f9-dba9-4b1b-9864-50ffe3deabab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:52.038749 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791a4f9-dba9-4b1b-9864-50ffe3deabab admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:52.050054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1152/2267] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:20:52.054815 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe4823-059b-497c-8cc2-4db288cb2330 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:52.066770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe4823-059b-497c-8cc2-4db288cb2330 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:52.074285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a41265-c053-4d0f-a105-80e973920b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:52.074958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a41265-c053-4d0f-a105-80e973920b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:52.075368 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a41265-c053-4d0f-a105-80e973920b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:52.075788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a41265-c053-4d0f-a105-80e973920b61 admin admin] PATH_INFO: `/v3/projects/c00bbfe956664be19c1a849635933144/users/a24126d4256d45c9aa688e1c70a66a4a/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:52.079738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a41265-c053-4d0f-a105-80e973920b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00bbfe956664be19c1a849635933144, user_id=a24126d4256d45c9aa688e1c70a66a4a, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:52.084207 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a41265-c053-4d0f-a105-80e973920b61 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:52.096868 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1116/2268] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:52 2022] PUT /identity/v3/projects/c00bbfe956664be19c1a849635933144/users/a24126d4256d45c9aa688e1c70a66a4a/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:52.108109 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d8ef1-2b45-4823-8e5e-9200431f9488 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:52.108673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d8ef1-2b45-4823-8e5e-9200431f9488 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:52.108838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d8ef1-2b45-4823-8e5e-9200431f9488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:52.140651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bb1d8ef1-2b45-4823-8e5e-9200431f9488 None None] MFA Rules not processed for user `a24126d4256d45c9aa688e1c70a66a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:52.141919 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bb1d8ef1-2b45-4823-8e5e-9200431f9488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:52.147632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:52.230838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1153/2269] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:52.257664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a41265-c053-4d0f-a105-80e973920b61 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:52.257664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-39a41265-c053-4d0f-a105-80e973920b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:52.294658 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:52.327719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a41265-c053-4d0f-a105-80e973920b61 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:52.332219 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ea65c-2576-48c5-87b0-8316aadf32a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:52.332854 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ea65c-2576-48c5-87b0-8316aadf32a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:52.333311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ea65c-2576-48c5-87b0-8316aadf32a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:52.333574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ea65c-2576-48c5-87b0-8316aadf32a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:52.418170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ea65c-2576-48c5-87b0-8316aadf32a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:52.420711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ea65c-2576-48c5-87b0-8316aadf32a1 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:52.433078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1117/2270] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:54.049746 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d8ef1-2b45-4823-8e5e-9200431f9488 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:54.060553 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d8ef1-2b45-4823-8e5e-9200431f9488 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:54.064425 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135d945-9210-4aba-a601-cc772ebd75a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:54.065115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d945-9210-4aba-a601-cc772ebd75a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:54.065326 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d945-9210-4aba-a601-cc772ebd75a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:54.065588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d945-9210-4aba-a601-cc772ebd75a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:54.126374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135d945-9210-4aba-a601-cc772ebd75a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:54.128175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135d945-9210-4aba-a601-cc772ebd75a9 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:54.137774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1154/2271] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:54.753047 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ea65c-2576-48c5-87b0-8316aadf32a1 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:54.762953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ea65c-2576-48c5-87b0-8316aadf32a1 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:54.767216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93db7a-5523-412f-a6f6-f634a4a3a284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:54.767831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93db7a-5523-412f-a6f6-f634a4a3a284 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:54.768109 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93db7a-5523-412f-a6f6-f634a4a3a284 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:54.768371 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93db7a-5523-412f-a6f6-f634a4a3a284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:54.779387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93db7a-5523-412f-a6f6-f634a4a3a284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:54.781000 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93db7a-5523-412f-a6f6-f634a4a3a284 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:54.791596 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1118/2272] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:56.737381 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135d945-9210-4aba-a601-cc772ebd75a9 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:56.738897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0135d945-9210-4aba-a601-cc772ebd75a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:56.811183 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135d945-9210-4aba-a601-cc772ebd75a9 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:56.817124 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0de99-bab1-4dcd-9598-c2feedec79f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:56.817844 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0de99-bab1-4dcd-9598-c2feedec79f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:56.818093 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0de99-bab1-4dcd-9598-c2feedec79f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:56.818361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0de99-bab1-4dcd-9598-c2feedec79f7 admin admin] PATH_INFO: `/v3/users/77b492cb93814e629d70381827bae537` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:56.819998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0de99-bab1-4dcd-9598-c2feedec79f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b492cb93814e629d70381827bae537)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:56.821602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0de99-bab1-4dcd-9598-c2feedec79f7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:56.883575 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:56.890406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2eb0de99-bab1-4dcd-9598-c2feedec79f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b492cb93814e629d70381827bae537'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:56.901143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2eb0de99-bab1-4dcd-9598-c2feedec79f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b492cb93814e629d70381827bae537'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:56.916315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2eb0de99-bab1-4dcd-9598-c2feedec79f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b492cb93814e629d70381827bae537'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:56.917095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2eb0de99-bab1-4dcd-9598-c2feedec79f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b492cb93814e629d70381827bae537'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:56.934365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-2eb0de99-bab1-4dcd-9598-c2feedec79f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b492cb93814e629d70381827bae537'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:56.945949 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1155/2273] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:56 2022] DELETE /identity/v3/users/77b492cb93814e629d70381827bae537 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:56.949567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707dd8b-7c61-4514-842c-c53ff9229b62 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:56.949567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707dd8b-7c61-4514-842c-c53ff9229b62 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:56.949567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707dd8b-7c61-4514-842c-c53ff9229b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:56.971958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-3707dd8b-7c61-4514-842c-c53ff9229b62 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:56.973541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3707dd8b-7c61-4514-842c-c53ff9229b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:57.042607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1119/2274] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:57.055985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0de99-bab1-4dcd-9598-c2feedec79f7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:57.059323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2eb0de99-bab1-4dcd-9598-c2feedec79f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:57.125352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0de99-bab1-4dcd-9598-c2feedec79f7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:57.129107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171052bd-e32d-477f-ae0a-1430720c058b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:57.129744 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171052bd-e32d-477f-ae0a-1430720c058b service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:57.130015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171052bd-e32d-477f-ae0a-1430720c058b service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:57.130282 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171052bd-e32d-477f-ae0a-1430720c058b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:57.140128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171052bd-e32d-477f-ae0a-1430720c058b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:57.141916 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171052bd-e32d-477f-ae0a-1430720c058b service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:57.152210 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1156/2275] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:57.501829 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707dd8b-7c61-4514-842c-c53ff9229b62 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:57.502598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3707dd8b-7c61-4514-842c-c53ff9229b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:57.522964 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707dd8b-7c61-4514-842c-c53ff9229b62 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:57.527636 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c11f1-ef1e-4362-bcb9-0f5cc93eb28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:57.528438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c11f1-ef1e-4362-bcb9-0f5cc93eb28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:57.528718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c11f1-ef1e-4362-bcb9-0f5cc93eb28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:57.528993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c11f1-ef1e-4362-bcb9-0f5cc93eb28b admin admin] PATH_INFO: `/v3/projects/0dd4563169524c02a407d84e5a38add2` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:57.530262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c11f1-ef1e-4362-bcb9-0f5cc93eb28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd4563169524c02a407d84e5a38add2)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:57.532315 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c11f1-ef1e-4362-bcb9-0f5cc93eb28b admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:57.584194 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-b68c11f1-ef1e-4362-bcb9-0f5cc93eb28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd4563169524c02a407d84e5a38add2', 'request_id': 'req-b68c11f1-ef1e-4362-bcb9-0f5cc93eb28b'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:57.594585 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-b68c11f1-ef1e-4362-bcb9-0f5cc93eb28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd4563169524c02a407d84e5a38add2', 'request_id': 'req-b68c11f1-ef1e-4362-bcb9-0f5cc93eb28b'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:57.601546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-b68c11f1-ef1e-4362-bcb9-0f5cc93eb28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd4563169524c02a407d84e5a38add2', 'request_id': 'req-b68c11f1-ef1e-4362-bcb9-0f5cc93eb28b'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:57.603692 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:57.615977 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-b68c11f1-ef1e-4362-bcb9-0f5cc93eb28b admin admin] The token cache is being invalidate because project 0dd4563169524c02a407d84e5a38add2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:57.616268 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-b68c11f1-ef1e-4362-bcb9-0f5cc93eb28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:57.616924 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-b68c11f1-ef1e-4362-bcb9-0f5cc93eb28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:57.618485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1120/2276] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:57 2022] DELETE /identity/v3/projects/0dd4563169524c02a407d84e5a38add2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:57.623868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8b67f-52a8-4bfa-8f41-34e5222a9e97 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:57.624146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8b67f-52a8-4bfa-8f41-34e5222a9e97 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:57.624473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8b67f-52a8-4bfa-8f41-34e5222a9e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:57.646520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c4e8b67f-52a8-4bfa-8f41-34e5222a9e97 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:57.647787 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c4e8b67f-52a8-4bfa-8f41-34e5222a9e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:57.710974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1157/2277] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:57.719590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341ea5b-d5ba-445b-8d4b-bcaf6d2c43c7 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:57.719887 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341ea5b-d5ba-445b-8d4b-bcaf6d2c43c7 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:57.720118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341ea5b-d5ba-445b-8d4b-bcaf6d2c43c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:57.741414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-7341ea5b-d5ba-445b-8d4b-bcaf6d2c43c7 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:57.742829 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7341ea5b-d5ba-445b-8d4b-bcaf6d2c43c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:57.752255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1121/2278] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:57.759775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8b67f-52a8-4bfa-8f41-34e5222a9e97 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:57.771456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8b67f-52a8-4bfa-8f41-34e5222a9e97 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:57.776738 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f67df-f045-41e5-9e45-c3ca62533eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:57.777345 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f67df-f045-41e5-9e45-c3ca62533eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:57.777613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f67df-f045-41e5-9e45-c3ca62533eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:57.777905 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f67df-f045-41e5-9e45-c3ca62533eaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:57.778544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f67df-f045-41e5-9e45-c3ca62533eaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:20:57.779291 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f67df-f045-41e5-9e45-c3ca62533eaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:57.780393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f67df-f045-41e5-9e45-c3ca62533eaa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:57.793013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1158/2279] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:20:57.797802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341ea5b-d5ba-445b-8d4b-bcaf6d2c43c7 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:57.807164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341ea5b-d5ba-445b-8d4b-bcaf6d2c43c7 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:57.812430 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487fcc2-20dd-4937-8fa4-6b7860ee7cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:57.813057 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487fcc2-20dd-4937-8fa4-6b7860ee7cce admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:57.813296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487fcc2-20dd-4937-8fa4-6b7860ee7cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:57.813586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487fcc2-20dd-4937-8fa4-6b7860ee7cce admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:57.814288 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487fcc2-20dd-4937-8fa4-6b7860ee7cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:57.816252 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487fcc2-20dd-4937-8fa4-6b7860ee7cce admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:57.846187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1122/2280] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:57 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:57.850551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f67df-f045-41e5-9e45-c3ca62533eaa admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:57.860890 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f67df-f045-41e5-9e45-c3ca62533eaa admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:57.916206 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:57.931423 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d76f69-ecff-4751-8ab8-840ab546dec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:57.932069 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d76f69-ecff-4751-8ab8-840ab546dec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:57.932635 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d76f69-ecff-4751-8ab8-840ab546dec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:57.932917 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d76f69-ecff-4751-8ab8-840ab546dec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:57.933654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d76f69-ecff-4751-8ab8-840ab546dec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:57.936031 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d76f69-ecff-4751-8ab8-840ab546dec1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:57.960224 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1159/2281] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:57 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:57.964553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487fcc2-20dd-4937-8fa4-6b7860ee7cce admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:57.976630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487fcc2-20dd-4937-8fa4-6b7860ee7cce admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:57.981695 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745171eb-84ca-4c52-bb54-f4e11a09d7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:57.982302 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745171eb-84ca-4c52-bb54-f4e11a09d7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:57.982578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745171eb-84ca-4c52-bb54-f4e11a09d7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:57.982854 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745171eb-84ca-4c52-bb54-f4e11a09d7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:57.983487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745171eb-84ca-4c52-bb54-f4e11a09d7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:57.985374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745171eb-84ca-4c52-bb54-f4e11a09d7a0 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:57.999429 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1123/2282] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:58.004930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d76f69-ecff-4751-8ab8-840ab546dec1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:58.024997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d76f69-ecff-4751-8ab8-840ab546dec1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:58.032388 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d3f1e-b1c1-46a4-8e7c-eebb41962c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:58.033013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d3f1e-b1c1-46a4-8e7c-eebb41962c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:58.033292 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d3f1e-b1c1-46a4-8e7c-eebb41962c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:58.033559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d3f1e-b1c1-46a4-8e7c-eebb41962c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:58.034702 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d3f1e-b1c1-46a4-8e7c-eebb41962c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:58.036899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d3f1e-b1c1-46a4-8e7c-eebb41962c33 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:58.055126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1160/2283] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:58.059214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745171eb-84ca-4c52-bb54-f4e11a09d7a0 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:58.072355 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745171eb-84ca-4c52-bb54-f4e11a09d7a0 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:58.077905 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e3a15-7d8a-4e17-9768-5d57efcda07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:58.078847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e3a15-7d8a-4e17-9768-5d57efcda07c admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:58.079309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e3a15-7d8a-4e17-9768-5d57efcda07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:58.079707 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e3a15-7d8a-4e17-9768-5d57efcda07c admin admin] PATH_INFO: `/v3/projects/7c80198694cd44ebba294cadc7e72fc4/users/40e6c8f890b04e27b84d84cc84c118a8/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:58.096468 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e3a15-7d8a-4e17-9768-5d57efcda07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c80198694cd44ebba294cadc7e72fc4, user_id=40e6c8f890b04e27b84d84cc84c118a8, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:58.099171 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e3a15-7d8a-4e17-9768-5d57efcda07c admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:58.115962 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1124/2284] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:58 2022] PUT /identity/v3/projects/7c80198694cd44ebba294cadc7e72fc4/users/40e6c8f890b04e27b84d84cc84c118a8/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:58.126589 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa01bf8-0170-4dcf-9687-1f977bf20ca2 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:58.126872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa01bf8-0170-4dcf-9687-1f977bf20ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:58.127145 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa01bf8-0170-4dcf-9687-1f977bf20ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:58.158037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2aa01bf8-0170-4dcf-9687-1f977bf20ca2 None None] MFA Rules not processed for user `40e6c8f890b04e27b84d84cc84c118a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:58.159259 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2aa01bf8-0170-4dcf-9687-1f977bf20ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:58.227235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1161/2285] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:58.231828 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e3a15-7d8a-4e17-9768-5d57efcda07c admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:58.301424 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e3a15-7d8a-4e17-9768-5d57efcda07c admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:58.308057 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c401646-ac99-46f4-8009-a6659ba5cac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:58.308494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c401646-ac99-46f4-8009-a6659ba5cac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:58.308770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c401646-ac99-46f4-8009-a6659ba5cac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:58.309037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c401646-ac99-46f4-8009-a6659ba5cac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:58.309731 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c401646-ac99-46f4-8009-a6659ba5cac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:58.312182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c401646-ac99-46f4-8009-a6659ba5cac9 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:58.360642 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1125/2286] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:58 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:58.365279 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa01bf8-0170-4dcf-9687-1f977bf20ca2 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:58.376956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa01bf8-0170-4dcf-9687-1f977bf20ca2 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:58.443202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b2adb-02f8-4819-9265-6b2bfa961a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:58.443996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b2adb-02f8-4819-9265-6b2bfa961a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:58.444366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b2adb-02f8-4819-9265-6b2bfa961a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:58.444706 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b2adb-02f8-4819-9265-6b2bfa961a60 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:58.445346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b2adb-02f8-4819-9265-6b2bfa961a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:58.447516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b2adb-02f8-4819-9265-6b2bfa961a60 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:58.471154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1162/2287] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:58 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:58.475652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c401646-ac99-46f4-8009-a6659ba5cac9 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:58.488531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c401646-ac99-46f4-8009-a6659ba5cac9 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:58.495027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380bc54-fcde-45af-8cc1-68efd180f230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:58.495765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380bc54-fcde-45af-8cc1-68efd180f230 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:58.495965 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380bc54-fcde-45af-8cc1-68efd180f230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:58.496230 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380bc54-fcde-45af-8cc1-68efd180f230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:58.496877 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380bc54-fcde-45af-8cc1-68efd180f230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:58.498557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380bc54-fcde-45af-8cc1-68efd180f230 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:58.509650 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1126/2288] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:58.514098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b2adb-02f8-4819-9265-6b2bfa961a60 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:58.524918 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b2adb-02f8-4819-9265-6b2bfa961a60 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:58.529580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d52ac-07a5-4074-bd0a-e4466f4d56d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:58.530208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d52ac-07a5-4074-bd0a-e4466f4d56d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:58.530518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d52ac-07a5-4074-bd0a-e4466f4d56d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:58.530844 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d52ac-07a5-4074-bd0a-e4466f4d56d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:58.531484 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d52ac-07a5-4074-bd0a-e4466f4d56d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:58.533065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d52ac-07a5-4074-bd0a-e4466f4d56d8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:58.543167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1163/2289] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:20:58.547570 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380bc54-fcde-45af-8cc1-68efd180f230 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:58.558598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380bc54-fcde-45af-8cc1-68efd180f230 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:58.563337 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ca2c8-6a21-4048-b99f-5d9d7e063b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:58.563995 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ca2c8-6a21-4048-b99f-5d9d7e063b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:58.564250 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ca2c8-6a21-4048-b99f-5d9d7e063b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:58.564515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ca2c8-6a21-4048-b99f-5d9d7e063b69 admin admin] PATH_INFO: `/v3/projects/0ab7cfa1a9b14a1186a2fdeee04a0c64/users/0cbf225c843947b8bd2dc1be29e51ef8/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:58.579115 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ca2c8-6a21-4048-b99f-5d9d7e063b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab7cfa1a9b14a1186a2fdeee04a0c64, user_id=0cbf225c843947b8bd2dc1be29e51ef8, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:58.581861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ca2c8-6a21-4048-b99f-5d9d7e063b69 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:58.598259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1127/2290] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:58 2022] PUT /identity/v3/projects/0ab7cfa1a9b14a1186a2fdeee04a0c64/users/0cbf225c843947b8bd2dc1be29e51ef8/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:20:58.609855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cf5ac-1497-4785-8405-9dc899780fe4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:58.610122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cf5ac-1497-4785-8405-9dc899780fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:58.610403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cf5ac-1497-4785-8405-9dc899780fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:58.640409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f72cf5ac-1497-4785-8405-9dc899780fe4 None None] MFA Rules not processed for user `0cbf225c843947b8bd2dc1be29e51ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:58.641531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f72cf5ac-1497-4785-8405-9dc899780fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:58.665922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:58.714666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1164/2291] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:20:58.719568 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ca2c8-6a21-4048-b99f-5d9d7e063b69 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:58.768493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:58.792620 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ca2c8-6a21-4048-b99f-5d9d7e063b69 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:58.800456 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0dcdf-ec5d-43f2-b414-5bfbc649bb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:58.801134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0dcdf-ec5d-43f2-b414-5bfbc649bb6c admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:58.801405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0dcdf-ec5d-43f2-b414-5bfbc649bb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:58.801707 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0dcdf-ec5d-43f2-b414-5bfbc649bb6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:58.802340 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0dcdf-ec5d-43f2-b414-5bfbc649bb6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:58.804253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0dcdf-ec5d-43f2-b414-5bfbc649bb6c admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:58.835552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1128/2292] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:20:58 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:58.840068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cf5ac-1497-4785-8405-9dc899780fe4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:58.851381 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cf5ac-1497-4785-8405-9dc899780fe4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:58.851708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0dcdf-ec5d-43f2-b414-5bfbc649bb6c admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:58.853399 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-61c0dcdf-ec5d-43f2-b414-5bfbc649bb6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:58.911768 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c545927-5c81-4fd0-8ff1-3e48a57ab63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:58.912373 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c545927-5c81-4fd0-8ff1-3e48a57ab63c admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:58.912733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c545927-5c81-4fd0-8ff1-3e48a57ab63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:58.913010 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c545927-5c81-4fd0-8ff1-3e48a57ab63c admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:58.913656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c545927-5c81-4fd0-8ff1-3e48a57ab63c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:58.915610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c545927-5c81-4fd0-8ff1-3e48a57ab63c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:58.924381 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0dcdf-ec5d-43f2-b414-5bfbc649bb6c admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:58.929796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b38a01-8fe7-4249-9b2d-d62283133e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:58.930425 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b38a01-8fe7-4249-9b2d-d62283133e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:58.930739 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b38a01-8fe7-4249-9b2d-d62283133e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:58.930943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b38a01-8fe7-4249-9b2d-d62283133e8f admin admin] PATH_INFO: `/v3/users/e6a73700604d4c1a9cedd1ec4601ce3f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:58.932225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b38a01-8fe7-4249-9b2d-d62283133e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a73700604d4c1a9cedd1ec4601ce3f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:58.934186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b38a01-8fe7-4249-9b2d-d62283133e8f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:58.938288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1165/2293] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:20:58 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:20:58.942371 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c545927-5c81-4fd0-8ff1-3e48a57ab63c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:58.955506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c545927-5c81-4fd0-8ff1-3e48a57ab63c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:58.960512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dbaf6-94d6-4d94-b70a-5f1a3de24918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:58.961161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dbaf6-94d6-4d94-b70a-5f1a3de24918 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:58.961497 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dbaf6-94d6-4d94-b70a-5f1a3de24918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:58.961803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dbaf6-94d6-4d94-b70a-5f1a3de24918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:58.962475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dbaf6-94d6-4d94-b70a-5f1a3de24918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:58.964627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dbaf6-94d6-4d94-b70a-5f1a3de24918 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:58.979554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1166/2294] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:20:58.980903 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dbaf6-94d6-4d94-b70a-5f1a3de24918 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:58.990381 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-41b38a01-8fe7-4249-9b2d-d62283133e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a73700604d4c1a9cedd1ec4601ce3f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:58.994937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dbaf6-94d6-4d94-b70a-5f1a3de24918 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:59.001204 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-41b38a01-8fe7-4249-9b2d-d62283133e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a73700604d4c1a9cedd1ec4601ce3f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:59.001386 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258a55e-b2d8-4abd-ad0e-619126416736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:59.002043 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258a55e-b2d8-4abd-ad0e-619126416736 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:59.002478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258a55e-b2d8-4abd-ad0e-619126416736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:59.002746 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258a55e-b2d8-4abd-ad0e-619126416736 admin admin] PATH_INFO: `/v3/projects/76b85ecac87d48a6b86e9de15b139365/users/3ab6a36da73243128173b905cdbe8345/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:59.003036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-41b38a01-8fe7-4249-9b2d-d62283133e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a73700604d4c1a9cedd1ec4601ce3f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:59.018350 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-41b38a01-8fe7-4249-9b2d-d62283133e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a73700604d4c1a9cedd1ec4601ce3f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:59.019849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258a55e-b2d8-4abd-ad0e-619126416736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b85ecac87d48a6b86e9de15b139365, user_id=3ab6a36da73243128173b905cdbe8345, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:59.022732 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258a55e-b2d8-4abd-ad0e-619126416736 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:59.038337 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-41b38a01-8fe7-4249-9b2d-d62283133e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a73700604d4c1a9cedd1ec4601ce3f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:59.042532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1167/2295] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:58 2022] PUT /identity/v3/projects/76b85ecac87d48a6b86e9de15b139365/users/3ab6a36da73243128173b905cdbe8345/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:59.046979 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258a55e-b2d8-4abd-ad0e-619126416736 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:59.048836 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b258a55e-b2d8-4abd-ad0e-619126416736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:59.052278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1129/2296] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:58 2022] DELETE /identity/v3/users/e6a73700604d4c1a9cedd1ec4601ce3f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:59.054719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e54e2e-cdb5-4896-886d-d6463144c8b6 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:59.055002 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e54e2e-cdb5-4896-886d-d6463144c8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:59.055267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e54e2e-cdb5-4896-886d-d6463144c8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:59.082882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-03e54e2e-cdb5-4896-886d-d6463144c8b6 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:59.084297 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-03e54e2e-cdb5-4896-886d-d6463144c8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:59.132677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:59.141754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258a55e-b2d8-4abd-ad0e-619126416736 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:59.172387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1130/2297] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:59.178014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:59.181159 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e54e2e-cdb5-4896-886d-d6463144c8b6 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:59.183040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-03e54e2e-cdb5-4896-886d-d6463144c8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:59.219338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378b21b-5667-427e-a93c-5a7f24e24283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:59.219978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378b21b-5667-427e-a93c-5a7f24e24283 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:59.220249 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378b21b-5667-427e-a93c-5a7f24e24283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:59.220554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378b21b-5667-427e-a93c-5a7f24e24283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:59.221290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378b21b-5667-427e-a93c-5a7f24e24283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:59.222893 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378b21b-5667-427e-a93c-5a7f24e24283 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:59.237212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1168/2298] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:20:59.238743 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378b21b-5667-427e-a93c-5a7f24e24283 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:59.250065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378b21b-5667-427e-a93c-5a7f24e24283 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:59.254746 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d5057-28d7-435e-b554-1c325c5f0b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:59.255415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d5057-28d7-435e-b554-1c325c5f0b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:59.255725 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d5057-28d7-435e-b554-1c325c5f0b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:59.255999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d5057-28d7-435e-b554-1c325c5f0b2e admin admin] PATH_INFO: `/v3/projects/76b85ecac87d48a6b86e9de15b139365/users/3ab6a36da73243128173b905cdbe8345/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:59.258260 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d5057-28d7-435e-b554-1c325c5f0b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b85ecac87d48a6b86e9de15b139365, user_id=3ab6a36da73243128173b905cdbe8345, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:59.261596 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e54e2e-cdb5-4896-886d-d6463144c8b6 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:59.261774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d5057-28d7-435e-b554-1c325c5f0b2e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:59.264896 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d9dd2-cfb7-44ab-ad36-4337c0df97e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:59.265579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d9dd2-cfb7-44ab-ad36-4337c0df97e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:59.265936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d9dd2-cfb7-44ab-ad36-4337c0df97e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:59.266266 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d9dd2-cfb7-44ab-ad36-4337c0df97e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:59.274182 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1169/2299] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:20:59 2022] PUT /identity/v3/projects/76b85ecac87d48a6b86e9de15b139365/users/3ab6a36da73243128173b905cdbe8345/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:59.282245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d9dd2-cfb7-44ab-ad36-4337c0df97e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:59.282733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d44e85-bbb4-44dc-b854-29c636a28be7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:59.283321 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d44e85-bbb4-44dc-b854-29c636a28be7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:59.283679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d44e85-bbb4-44dc-b854-29c636a28be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:59.283881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d9dd2-cfb7-44ab-ad36-4337c0df97e9 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:59.300023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1131/2300] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:59.319737 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-85d44e85-bbb4-44dc-b854-29c636a28be7 None None] MFA Rules not processed for user `3ab6a36da73243128173b905cdbe8345`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:20:59.320993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-85d44e85-bbb4-44dc-b854-29c636a28be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:59.417856 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1170/2301] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:20:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:20:59.431059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d9dd2-cfb7-44ab-ad36-4337c0df97e9 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:59.433252 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-1d4d9dd2-cfb7-44ab-ad36-4337c0df97e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:59.505760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d9dd2-cfb7-44ab-ad36-4337c0df97e9 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:59.572365 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfcdee-f71c-42ad-ae73-dde396d8add5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:59.572601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfcdee-f71c-42ad-ae73-dde396d8add5 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:59.573007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfcdee-f71c-42ad-ae73-dde396d8add5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:59.573397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfcdee-f71c-42ad-ae73-dde396d8add5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:59.575554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-79dfcdee-f71c-42ad-ae73-dde396d8add5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:59.635821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:59.638909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfcdee-f71c-42ad-ae73-dde396d8add5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:59.640643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfcdee-f71c-42ad-ae73-dde396d8add5 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:59.650124 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d44e85-bbb4-44dc-b854-29c636a28be7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:59.651677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-85d44e85-bbb4-44dc-b854-29c636a28be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:20:59.661765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1132/2302] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:20:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:20:59.734971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d44e85-bbb4-44dc-b854-29c636a28be7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:59.740160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b164a8b-a4f0-4676-99cb-2814463d2e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:59.740797 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b164a8b-a4f0-4676-99cb-2814463d2e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:59.741074 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b164a8b-a4f0-4676-99cb-2814463d2e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:59.741339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b164a8b-a4f0-4676-99cb-2814463d2e22 admin admin] PATH_INFO: `/v3/projects/fa816b337d0f4e26b09c5b2fcb72bd27` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:59.742496 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b164a8b-a4f0-4676-99cb-2814463d2e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa816b337d0f4e26b09c5b2fcb72bd27)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:59.744402 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b164a8b-a4f0-4676-99cb-2814463d2e22 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:20:59.787037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:20:59.801735 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8b164a8b-a4f0-4676-99cb-2814463d2e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa816b337d0f4e26b09c5b2fcb72bd27', 'request_id': 'req-8b164a8b-a4f0-4676-99cb-2814463d2e22'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:59.808544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8b164a8b-a4f0-4676-99cb-2814463d2e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa816b337d0f4e26b09c5b2fcb72bd27', 'request_id': 'req-8b164a8b-a4f0-4676-99cb-2814463d2e22'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:59.815465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8b164a8b-a4f0-4676-99cb-2814463d2e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa816b337d0f4e26b09c5b2fcb72bd27', 'request_id': 'req-8b164a8b-a4f0-4676-99cb-2814463d2e22'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:59.829467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8b164a8b-a4f0-4676-99cb-2814463d2e22 admin admin] The token cache is being invalidate because project fa816b337d0f4e26b09c5b2fcb72bd27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:20:59.829787 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8b164a8b-a4f0-4676-99cb-2814463d2e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:59.830460 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8b164a8b-a4f0-4676-99cb-2814463d2e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:20:59.832071 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1171/2303] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:20:59 2022] DELETE /identity/v3/projects/fa816b337d0f4e26b09c5b2fcb72bd27 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:20:59.836393 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfcdee-f71c-42ad-ae73-dde396d8add5 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:20:59.847867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfcdee-f71c-42ad-ae73-dde396d8add5 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:20:59.926842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8a9d-cb3d-4aa1-993a-903dcde2c9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:20:59.927818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8a9d-cb3d-4aa1-993a-903dcde2c9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:20:59.928887 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8a9d-cb3d-4aa1-993a-903dcde2c9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:20:59.929372 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8a9d-cb3d-4aa1-993a-903dcde2c9c0 admin admin] PATH_INFO: `/v3/users/98af69be033e46bc97f66d0d30a7a944` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:20:59.930940 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d8a9d-cb3d-4aa1-993a-903dcde2c9c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98af69be033e46bc97f66d0d30a7a944)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:20:59.932935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d8a9d-cb3d-4aa1-993a-903dcde2c9c0 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:00.010767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a54d8a9d-cb3d-4aa1-993a-903dcde2c9c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98af69be033e46bc97f66d0d30a7a944'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:00.019516 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a54d8a9d-cb3d-4aa1-993a-903dcde2c9c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98af69be033e46bc97f66d0d30a7a944'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:00.020177 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a54d8a9d-cb3d-4aa1-993a-903dcde2c9c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98af69be033e46bc97f66d0d30a7a944'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:00.029671 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a54d8a9d-cb3d-4aa1-993a-903dcde2c9c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98af69be033e46bc97f66d0d30a7a944'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:00.050195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a54d8a9d-cb3d-4aa1-993a-903dcde2c9c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98af69be033e46bc97f66d0d30a7a944'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:00.057890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1133/2304] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:20:59 2022] DELETE /identity/v3/users/98af69be033e46bc97f66d0d30a7a944 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:21:00.487036 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b164a8b-a4f0-4676-99cb-2814463d2e22 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:00.489233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8b164a8b-a4f0-4676-99cb-2814463d2e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:00.511400 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b164a8b-a4f0-4676-99cb-2814463d2e22 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:00.583677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:00.584445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:00.584809 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:00.585290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c admin admin] PATH_INFO: `/v3/projects/8e8099c69bff4f9c894cb88643ac62e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:00.586652 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e8099c69bff4f9c894cb88643ac62e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:00.588979 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:00.648333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e8099c69bff4f9c894cb88643ac62e6', 'request_id': 'req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:00.655709 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e8099c69bff4f9c894cb88643ac62e6', 'request_id': 'req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:00.664169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e8099c69bff4f9c894cb88643ac62e6', 'request_id': 'req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:00.677525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c admin admin] The token cache is being invalidate because project 8e8099c69bff4f9c894cb88643ac62e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:21:00.677855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:00.678530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:00.680247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1172/2305] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:21:00 2022] DELETE /identity/v3/projects/8e8099c69bff4f9c894cb88643ac62e6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:21:00.684608 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8a9d-cb3d-4aa1-993a-903dcde2c9c0 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:00.686134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a54d8a9d-cb3d-4aa1-993a-903dcde2c9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:00.704241 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8a9d-cb3d-4aa1-993a-903dcde2c9c0 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:00.767380 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4666a-2112-4b28-85e0-2475479a54fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:00.768018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4666a-2112-4b28-85e0-2475479a54fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:00.768291 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4666a-2112-4b28-85e0-2475479a54fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:00.768593 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4666a-2112-4b28-85e0-2475479a54fb admin admin] PATH_INFO: `/v3/users/a24126d4256d45c9aa688e1c70a66a4a` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:00.769765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4666a-2112-4b28-85e0-2475479a54fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24126d4256d45c9aa688e1c70a66a4a)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:00.771712 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4666a-2112-4b28-85e0-2475479a54fb admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:00.794646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:00.828457 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-60b4666a-2112-4b28-85e0-2475479a54fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24126d4256d45c9aa688e1c70a66a4a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:00.835862 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-60b4666a-2112-4b28-85e0-2475479a54fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24126d4256d45c9aa688e1c70a66a4a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:00.836460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-60b4666a-2112-4b28-85e0-2475479a54fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24126d4256d45c9aa688e1c70a66a4a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:00.843585 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-60b4666a-2112-4b28-85e0-2475479a54fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24126d4256d45c9aa688e1c70a66a4a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:00.857328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-60b4666a-2112-4b28-85e0-2475479a54fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24126d4256d45c9aa688e1c70a66a4a'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:00.863739 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1134/2306] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:21:00 2022] DELETE /identity/v3/users/a24126d4256d45c9aa688e1c70a66a4a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:21:01.188393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:01.190220 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:01.207740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802b07a-ab0f-4e11-8a1d-76e94f3c911c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:01.233593 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4666a-2112-4b28-85e0-2475479a54fb admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:01.235845 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-60b4666a-2112-4b28-85e0-2475479a54fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:01.287736 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:01.296729 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a421d8-8755-4ff8-a5c1-053d60185a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:01.297956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a421d8-8755-4ff8-a5c1-053d60185a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:01.298262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a421d8-8755-4ff8-a5c1-053d60185a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:01.298750 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a421d8-8755-4ff8-a5c1-053d60185a84 admin admin] PATH_INFO: `/v3/projects/c00bbfe956664be19c1a849635933144` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:01.300671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a421d8-8755-4ff8-a5c1-053d60185a84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00bbfe956664be19c1a849635933144)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:01.303132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a421d8-8755-4ff8-a5c1-053d60185a84 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:01.313384 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4666a-2112-4b28-85e0-2475479a54fb admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:01.316989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70094e-3655-41ba-9bfa-f7d5c1749708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:01.317725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70094e-3655-41ba-9bfa-f7d5c1749708 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:01.318025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70094e-3655-41ba-9bfa-f7d5c1749708 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:01.318305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70094e-3655-41ba-9bfa-f7d5c1749708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:01.320123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8c70094e-3655-41ba-9bfa-f7d5c1749708 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:01.354430 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f2a421d8-8755-4ff8-a5c1-053d60185a84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00bbfe956664be19c1a849635933144', 'request_id': 'req-f2a421d8-8755-4ff8-a5c1-053d60185a84'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:01.360355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f2a421d8-8755-4ff8-a5c1-053d60185a84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00bbfe956664be19c1a849635933144', 'request_id': 'req-f2a421d8-8755-4ff8-a5c1-053d60185a84'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:01.369884 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f2a421d8-8755-4ff8-a5c1-053d60185a84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00bbfe956664be19c1a849635933144', 'request_id': 'req-f2a421d8-8755-4ff8-a5c1-053d60185a84'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:01.382516 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70094e-3655-41ba-9bfa-f7d5c1749708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:01.384579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70094e-3655-41ba-9bfa-f7d5c1749708 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:01.390358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f2a421d8-8755-4ff8-a5c1-053d60185a84 admin admin] The token cache is being invalidate because project c00bbfe956664be19c1a849635933144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:21:01.390891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f2a421d8-8755-4ff8-a5c1-053d60185a84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:01.391583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f2a421d8-8755-4ff8-a5c1-053d60185a84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:01.393167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1173/2307] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:21:01 2022] DELETE /identity/v3/projects/c00bbfe956664be19c1a849635933144 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:21:01.394798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1135/2308] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:21:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:21:01.993546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a421d8-8755-4ff8-a5c1-053d60185a84 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:01.995032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f2a421d8-8755-4ff8-a5c1-053d60185a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:02.053733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a421d8-8755-4ff8-a5c1-053d60185a84 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:02.057859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c402ef-f5da-4b5d-9fe1-f6f998b31931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:02.058477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c402ef-f5da-4b5d-9fe1-f6f998b31931 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:02.058753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c402ef-f5da-4b5d-9fe1-f6f998b31931 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:02.059034 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c402ef-f5da-4b5d-9fe1-f6f998b31931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:02.060810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-84c402ef-f5da-4b5d-9fe1-f6f998b31931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:02.131551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c402ef-f5da-4b5d-9fe1-f6f998b31931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:02.132983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c402ef-f5da-4b5d-9fe1-f6f998b31931 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:02.142762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1174/2309] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:21:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:21:06.079276 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70094e-3655-41ba-9bfa-f7d5c1749708 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:06.080792 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8c70094e-3655-41ba-9bfa-f7d5c1749708 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:06.095769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70094e-3655-41ba-9bfa-f7d5c1749708 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:06.145048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:06.161043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e730849-28c6-4646-bd10-924cce1b5d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:06.161694 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e730849-28c6-4646-bd10-924cce1b5d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:06.161969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e730849-28c6-4646-bd10-924cce1b5d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:06.162237 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e730849-28c6-4646-bd10-924cce1b5d48 admin admin] PATH_INFO: `/v3/users/40e6c8f890b04e27b84d84cc84c118a8` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:06.163397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e730849-28c6-4646-bd10-924cce1b5d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e6c8f890b04e27b84d84cc84c118a8)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:06.165341 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e730849-28c6-4646-bd10-924cce1b5d48 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:06.216678 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5e730849-28c6-4646-bd10-924cce1b5d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e6c8f890b04e27b84d84cc84c118a8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:06.225806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5e730849-28c6-4646-bd10-924cce1b5d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e6c8f890b04e27b84d84cc84c118a8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:06.226430 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5e730849-28c6-4646-bd10-924cce1b5d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e6c8f890b04e27b84d84cc84c118a8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:06.234273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5e730849-28c6-4646-bd10-924cce1b5d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e6c8f890b04e27b84d84cc84c118a8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:06.247386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5e730849-28c6-4646-bd10-924cce1b5d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e6c8f890b04e27b84d84cc84c118a8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:06.254817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1136/2310] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:21:06 2022] DELETE /identity/v3/users/40e6c8f890b04e27b84d84cc84c118a8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:21:06.260318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc36c8-aef3-4f43-a35f-41de73e32dbb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:06.260817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc36c8-aef3-4f43-a35f-41de73e32dbb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:06.260817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc36c8-aef3-4f43-a35f-41de73e32dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:06.281913 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-81cc36c8-aef3-4f43-a35f-41de73e32dbb None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:21:06.283140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-81cc36c8-aef3-4f43-a35f-41de73e32dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:06.314232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:06.345562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1175/2311] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:21:06.355586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e730849-28c6-4646-bd10-924cce1b5d48 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:06.357015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5e730849-28c6-4646-bd10-924cce1b5d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:06.420627 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e730849-28c6-4646-bd10-924cce1b5d48 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:06.424994 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5eaa78-415d-4728-abf5-4dc9ca32da1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:06.425585 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5eaa78-415d-4728-abf5-4dc9ca32da1e service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:06.425895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5eaa78-415d-4728-abf5-4dc9ca32da1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:06.426138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5eaa78-415d-4728-abf5-4dc9ca32da1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:06.435503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5eaa78-415d-4728-abf5-4dc9ca32da1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:06.436988 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5eaa78-415d-4728-abf5-4dc9ca32da1e service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:06.446789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1137/2312] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:21:06.726967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc36c8-aef3-4f43-a35f-41de73e32dbb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:06.728542 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-81cc36c8-aef3-4f43-a35f-41de73e32dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:06.741253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc36c8-aef3-4f43-a35f-41de73e32dbb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:06.746158 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f615ba-5a24-46af-ab08-ce3e1ffabd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:06.746960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f615ba-5a24-46af-ab08-ce3e1ffabd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:06.747091 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f615ba-5a24-46af-ab08-ce3e1ffabd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:06.747398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f615ba-5a24-46af-ab08-ce3e1ffabd61 admin admin] PATH_INFO: `/v3/projects/7c80198694cd44ebba294cadc7e72fc4` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:06.748538 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f615ba-5a24-46af-ab08-ce3e1ffabd61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c80198694cd44ebba294cadc7e72fc4)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:06.751945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f615ba-5a24-46af-ab08-ce3e1ffabd61 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:06.809255 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-60f615ba-5a24-46af-ab08-ce3e1ffabd61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c80198694cd44ebba294cadc7e72fc4', 'request_id': 'req-60f615ba-5a24-46af-ab08-ce3e1ffabd61'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:06.816038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-60f615ba-5a24-46af-ab08-ce3e1ffabd61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c80198694cd44ebba294cadc7e72fc4', 'request_id': 'req-60f615ba-5a24-46af-ab08-ce3e1ffabd61'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:06.824698 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-60f615ba-5a24-46af-ab08-ce3e1ffabd61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c80198694cd44ebba294cadc7e72fc4', 'request_id': 'req-60f615ba-5a24-46af-ab08-ce3e1ffabd61'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:06.836852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-60f615ba-5a24-46af-ab08-ce3e1ffabd61 admin admin] The token cache is being invalidate because project 7c80198694cd44ebba294cadc7e72fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:21:06.837142 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-60f615ba-5a24-46af-ab08-ce3e1ffabd61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:06.837891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-60f615ba-5a24-46af-ab08-ce3e1ffabd61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:06.839577 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1176/2313] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:21:06 2022] DELETE /identity/v3/projects/7c80198694cd44ebba294cadc7e72fc4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:21:06.843729 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5eaa78-415d-4728-abf5-4dc9ca32da1e service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:06.853455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5eaa78-415d-4728-abf5-4dc9ca32da1e service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:06.920276 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ab36e-93ed-4f61-8d98-ca370e746209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:06.920904 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ab36e-93ed-4f61-8d98-ca370e746209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:06.921195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ab36e-93ed-4f61-8d98-ca370e746209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:06.921460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ab36e-93ed-4f61-8d98-ca370e746209 admin admin] PATH_INFO: `/v3/users/0cbf225c843947b8bd2dc1be29e51ef8` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:06.922684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ab36e-93ed-4f61-8d98-ca370e746209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cbf225c843947b8bd2dc1be29e51ef8)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:06.924580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ab36e-93ed-4f61-8d98-ca370e746209 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:06.937635 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:06.981005 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-011ab36e-93ed-4f61-8d98-ca370e746209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cbf225c843947b8bd2dc1be29e51ef8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:06.990562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-011ab36e-93ed-4f61-8d98-ca370e746209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cbf225c843947b8bd2dc1be29e51ef8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:06.991066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-011ab36e-93ed-4f61-8d98-ca370e746209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cbf225c843947b8bd2dc1be29e51ef8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:06.998274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-011ab36e-93ed-4f61-8d98-ca370e746209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cbf225c843947b8bd2dc1be29e51ef8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:07.010978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-011ab36e-93ed-4f61-8d98-ca370e746209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cbf225c843947b8bd2dc1be29e51ef8'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:07.016957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1138/2314] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:21:06 2022] DELETE /identity/v3/users/0cbf225c843947b8bd2dc1be29e51ef8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:21:07.368449 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f615ba-5a24-46af-ab08-ce3e1ffabd61 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:07.369980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-60f615ba-5a24-46af-ab08-ce3e1ffabd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:07.383387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f615ba-5a24-46af-ab08-ce3e1ffabd61 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:07.440360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0feede-777e-470f-b270-6c7b6675653d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:07.440991 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0feede-777e-470f-b270-6c7b6675653d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:07.441261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0feede-777e-470f-b270-6c7b6675653d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:07.441525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0feede-777e-470f-b270-6c7b6675653d admin admin] PATH_INFO: `/v3/projects/0ab7cfa1a9b14a1186a2fdeee04a0c64` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:07.442667 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0feede-777e-470f-b270-6c7b6675653d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab7cfa1a9b14a1186a2fdeee04a0c64)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:07.444550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0feede-777e-470f-b270-6c7b6675653d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:07.494219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5e0feede-777e-470f-b270-6c7b6675653d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab7cfa1a9b14a1186a2fdeee04a0c64', 'request_id': 'req-5e0feede-777e-470f-b270-6c7b6675653d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:07.500344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5e0feede-777e-470f-b270-6c7b6675653d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab7cfa1a9b14a1186a2fdeee04a0c64', 'request_id': 'req-5e0feede-777e-470f-b270-6c7b6675653d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:07.502998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:07.510961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5e0feede-777e-470f-b270-6c7b6675653d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab7cfa1a9b14a1186a2fdeee04a0c64', 'request_id': 'req-5e0feede-777e-470f-b270-6c7b6675653d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:07.522648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5e0feede-777e-470f-b270-6c7b6675653d admin admin] The token cache is being invalidate because project 0ab7cfa1a9b14a1186a2fdeee04a0c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:21:07.522929 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5e0feede-777e-470f-b270-6c7b6675653d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:07.523552 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-5e0feede-777e-470f-b270-6c7b6675653d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:07.525053 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1177/2315] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:21:07 2022] DELETE /identity/v3/projects/0ab7cfa1a9b14a1186a2fdeee04a0c64 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:21:07.529312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ab36e-93ed-4f61-8d98-ca370e746209 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:07.530754 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-011ab36e-93ed-4f61-8d98-ca370e746209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:07.544451 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ab36e-93ed-4f61-8d98-ca370e746209 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:07.610101 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1bfcc-88bb-4158-9566-34fea0022316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:07.610740 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1bfcc-88bb-4158-9566-34fea0022316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:07.611016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1bfcc-88bb-4158-9566-34fea0022316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:07.611293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1bfcc-88bb-4158-9566-34fea0022316 admin admin] PATH_INFO: `/v3/users/3ab6a36da73243128173b905cdbe8345` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:07.612517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1bfcc-88bb-4158-9566-34fea0022316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab6a36da73243128173b905cdbe8345)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:07.614972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1bfcc-88bb-4158-9566-34fea0022316 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:07.667201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-50f1bfcc-88bb-4158-9566-34fea0022316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab6a36da73243128173b905cdbe8345'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:07.678670 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-50f1bfcc-88bb-4158-9566-34fea0022316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab6a36da73243128173b905cdbe8345'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:07.679419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-50f1bfcc-88bb-4158-9566-34fea0022316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab6a36da73243128173b905cdbe8345'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:07.686184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-50f1bfcc-88bb-4158-9566-34fea0022316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab6a36da73243128173b905cdbe8345'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:07.698672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-50f1bfcc-88bb-4158-9566-34fea0022316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab6a36da73243128173b905cdbe8345'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:07.705082 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1139/2316] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:21:07 2022] DELETE /identity/v3/users/3ab6a36da73243128173b905cdbe8345 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:21:07.999160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0feede-777e-470f-b270-6c7b6675653d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:08.000657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5e0feede-777e-470f-b270-6c7b6675653d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:08.013650 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0feede-777e-470f-b270-6c7b6675653d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:08.074526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee87ada-a19e-4d8e-99e7-a142a1d8539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:08.075167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee87ada-a19e-4d8e-99e7-a142a1d8539d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:08.075439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee87ada-a19e-4d8e-99e7-a142a1d8539d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:08.075703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee87ada-a19e-4d8e-99e7-a142a1d8539d admin admin] PATH_INFO: `/v3/projects/76b85ecac87d48a6b86e9de15b139365` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:08.076846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee87ada-a19e-4d8e-99e7-a142a1d8539d admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b85ecac87d48a6b86e9de15b139365)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:08.078811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee87ada-a19e-4d8e-99e7-a142a1d8539d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:08.133749 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dee87ada-a19e-4d8e-99e7-a142a1d8539d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b85ecac87d48a6b86e9de15b139365', 'request_id': 'req-dee87ada-a19e-4d8e-99e7-a142a1d8539d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:08.139947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dee87ada-a19e-4d8e-99e7-a142a1d8539d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b85ecac87d48a6b86e9de15b139365', 'request_id': 'req-dee87ada-a19e-4d8e-99e7-a142a1d8539d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:08.148026 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dee87ada-a19e-4d8e-99e7-a142a1d8539d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b85ecac87d48a6b86e9de15b139365', 'request_id': 'req-dee87ada-a19e-4d8e-99e7-a142a1d8539d'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:08.160932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dee87ada-a19e-4d8e-99e7-a142a1d8539d admin admin] The token cache is being invalidate because project 76b85ecac87d48a6b86e9de15b139365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:21:08.161216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dee87ada-a19e-4d8e-99e7-a142a1d8539d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:08.161906 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-dee87ada-a19e-4d8e-99e7-a142a1d8539d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:08.163762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1178/2317] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:21:07 2022] DELETE /identity/v3/projects/76b85ecac87d48a6b86e9de15b139365 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:21:12.133505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92670ca-73af-4034-a35a-7d2e22d96fb3 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:12.134103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92670ca-73af-4034-a35a-7d2e22d96fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:12.134103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92670ca-73af-4034-a35a-7d2e22d96fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:12.154770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-f92670ca-73af-4034-a35a-7d2e22d96fb3 None None] MFA Rules not processed for user `994164cde9f14b8ca5714b5e028f33c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:21:12.156019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f92670ca-73af-4034-a35a-7d2e22d96fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:12.160762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:12.217546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1140/2318] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:21:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:21:13.053220 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a31ec-57af-4cb6-befc-633cbd377255 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:13.053867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a31ec-57af-4cb6-befc-633cbd377255 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:13.053867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a31ec-57af-4cb6-befc-633cbd377255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:13.077481 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7a5a31ec-57af-4cb6-befc-633cbd377255 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:21:13.078865 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7a5a31ec-57af-4cb6-befc-633cbd377255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:13.155243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1179/2319] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Aug 9 11:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:21:13.173873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92670ca-73af-4034-a35a-7d2e22d96fb3 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:13.176259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f92670ca-73af-4034-a35a-7d2e22d96fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:13.272264 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92670ca-73af-4034-a35a-7d2e22d96fb3 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:13.281178 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea9c2c-e782-454e-a6e5-9b82345a6d27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:13.281854 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea9c2c-e782-454e-a6e5-9b82345a6d27 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:13.282198 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea9c2c-e782-454e-a6e5-9b82345a6d27 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:13.282561 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea9c2c-e782-454e-a6e5-9b82345a6d27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:13.296975 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea9c2c-e782-454e-a6e5-9b82345a6d27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:13.298621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea9c2c-e782-454e-a6e5-9b82345a6d27 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:13.317947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1141/2320] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:21:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:21:14.729926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18a7eb-eb32-4a0f-b226-2d6fca61c24d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:14.730489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18a7eb-eb32-4a0f-b226-2d6fca61c24d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:14.730489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18a7eb-eb32-4a0f-b226-2d6fca61c24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:14.751781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6b18a7eb-eb32-4a0f-b226-2d6fca61c24d None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:21:14.752996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6b18a7eb-eb32-4a0f-b226-2d6fca61c24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:14.767547 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:14.821778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1180/2321] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Aug 9 11:21:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:21:14.863943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea9c2c-e782-454e-a6e5-9b82345a6d27 service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:14.865850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9fea9c2c-e782-454e-a6e5-9b82345a6d27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:14.939435 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea9c2c-e782-454e-a6e5-9b82345a6d27 service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:14.945247 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07dd514-d8a7-46cb-80e4-15a5958ffc34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:14.945916 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dd514-d8a7-46cb-80e4-15a5958ffc34 service swift] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:14.946190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dd514-d8a7-46cb-80e4-15a5958ffc34 service swift] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:14.946454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07dd514-d8a7-46cb-80e4-15a5958ffc34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:14.955334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07dd514-d8a7-46cb-80e4-15a5958ffc34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:14.956978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07dd514-d8a7-46cb-80e4-15a5958ffc34 service swift] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:14.965952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1142/2322] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:21:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:21:17.577368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03266675-e249-42e4-bb2d-b5e767b6778a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:17.578217 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03266675-e249-42e4-bb2d-b5e767b6778a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:17.578323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03266675-e249-42e4-bb2d-b5e767b6778a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:17.610289 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-03266675-e249-42e4-bb2d-b5e767b6778a None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:21:17.612856 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-03266675-e249-42e4-bb2d-b5e767b6778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:17.626824 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1181/2323] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Aug 9 11:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:21:17.646643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07dd514-d8a7-46cb-80e4-15a5958ffc34 service swift] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:17.649290 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a07dd514-d8a7-46cb-80e4-15a5958ffc34 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:17.727280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07dd514-d8a7-46cb-80e4-15a5958ffc34 service swift] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:17.745171 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b789fd8-2cac-406b-af64-ee19e2c08244 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:17.746567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b789fd8-2cac-406b-af64-ee19e2c08244 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:17.747083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b789fd8-2cac-406b-af64-ee19e2c08244 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:17.747576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b789fd8-2cac-406b-af64-ee19e2c08244 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:17.776447 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b789fd8-2cac-406b-af64-ee19e2c08244 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:17.778111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b789fd8-2cac-406b-af64-ee19e2c08244 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:17.788910 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1143/2324] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:21:21.914638 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281b506-edaf-4eb1-be9f-a94df26574ee None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:21.915686 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281b506-edaf-4eb1-be9f-a94df26574ee None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:21.915960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281b506-edaf-4eb1-be9f-a94df26574ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:21.939412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3281b506-edaf-4eb1-be9f-a94df26574ee None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:21:21.940564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3281b506-edaf-4eb1-be9f-a94df26574ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:21.949314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1182/2325] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Aug 9 11:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:21:21.970798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b789fd8-2cac-406b-af64-ee19e2c08244 service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:21.984618 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b789fd8-2cac-406b-af64-ee19e2c08244 service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:21.991288 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410be261-0a0d-4a1f-bf8b-8aadc3d1d2f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:21.992028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410be261-0a0d-4a1f-bf8b-8aadc3d1d2f3 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:21.992383 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410be261-0a0d-4a1f-bf8b-8aadc3d1d2f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:21.992720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410be261-0a0d-4a1f-bf8b-8aadc3d1d2f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:22.002841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410be261-0a0d-4a1f-bf8b-8aadc3d1d2f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:22.004588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410be261-0a0d-4a1f-bf8b-8aadc3d1d2f3 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:22.017892 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1144/2326] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:21:27.135019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fba248-6a2d-4e08-9dbf-f8313bc1a721 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:27.135649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fba248-6a2d-4e08-9dbf-f8313bc1a721 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:27.135649 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fba248-6a2d-4e08-9dbf-f8313bc1a721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:27.157289 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-28fba248-6a2d-4e08-9dbf-f8313bc1a721 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:21:27.158555 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-28fba248-6a2d-4e08-9dbf-f8313bc1a721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:27.167176 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1183/2327] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Aug 9 11:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:21:27.185267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410be261-0a0d-4a1f-bf8b-8aadc3d1d2f3 service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:27.190789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:27.198827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410be261-0a0d-4a1f-bf8b-8aadc3d1d2f3 service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:27.204765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5544e-4751-4557-8509-75db3d717228 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:27.205736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5544e-4751-4557-8509-75db3d717228 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:27.206110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5544e-4751-4557-8509-75db3d717228 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:27.206601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5544e-4751-4557-8509-75db3d717228 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:27.216332 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5544e-4751-4557-8509-75db3d717228 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:27.218133 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5544e-4751-4557-8509-75db3d717228 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:27.230974 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1145/2328] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:21:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:21:30.512754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a4b98-1f51-4814-bbdd-469863a1803f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:30.513333 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a4b98-1f51-4814-bbdd-469863a1803f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:30.513505 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a4b98-1f51-4814-bbdd-469863a1803f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:30.534987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cb6a4b98-1f51-4814-bbdd-469863a1803f None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:21:30.536184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cb6a4b98-1f51-4814-bbdd-469863a1803f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:30.543425 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1184/2329] 10.222.0.15 () {58 vars in 967 bytes} [Tue Aug 9 11:21:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:21:30.562189 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5544e-4751-4557-8509-75db3d717228 service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:30.574350 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5544e-4751-4557-8509-75db3d717228 service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:30.579770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2ef03-8227-4a8d-97ec-4cf66b49b37f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:30.580370 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2ef03-8227-4a8d-97ec-4cf66b49b37f service swift] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:30.580641 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2ef03-8227-4a8d-97ec-4cf66b49b37f service swift] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:30.580943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2ef03-8227-4a8d-97ec-4cf66b49b37f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:30.590726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2ef03-8227-4a8d-97ec-4cf66b49b37f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:30.592390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2ef03-8227-4a8d-97ec-4cf66b49b37f service swift] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:30.604579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1146/2330] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:21:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:21:32.401862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f95a33-c81a-413b-81b1-11fb1ec896a6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:32.402463 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f95a33-c81a-413b-81b1-11fb1ec896a6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:32.402463 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f95a33-c81a-413b-81b1-11fb1ec896a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:32.422964 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d4f95a33-c81a-413b-81b1-11fb1ec896a6 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:21:32.424588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d4f95a33-c81a-413b-81b1-11fb1ec896a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:32.435587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1185/2331] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Aug 9 11:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:21:32.451836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2ef03-8227-4a8d-97ec-4cf66b49b37f service swift] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:32.465155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2ef03-8227-4a8d-97ec-4cf66b49b37f service swift] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:32.482808 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8e246-f466-4324-9e9f-c8d94d221cf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:32.484216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8e246-f466-4324-9e9f-c8d94d221cf6 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:32.484584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8e246-f466-4324-9e9f-c8d94d221cf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:32.485006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8e246-f466-4324-9e9f-c8d94d221cf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:32.497122 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8e246-f466-4324-9e9f-c8d94d221cf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:32.498891 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8e246-f466-4324-9e9f-c8d94d221cf6 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:32.510443 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1147/2332] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:21:32.679179 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f95a33-c81a-413b-81b1-11fb1ec896a6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:32.680888 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d4f95a33-c81a-413b-81b1-11fb1ec896a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:32.694292 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f95a33-c81a-413b-81b1-11fb1ec896a6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:32.700807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1efe4f-4260-4bc2-9b0a-9e7f253e4e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:32.701444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1efe4f-4260-4bc2-9b0a-9e7f253e4e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:32.701740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1efe4f-4260-4bc2-9b0a-9e7f253e4e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:32.702010 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1efe4f-4260-4bc2-9b0a-9e7f253e4e58 admin admin] PATH_INFO: `/v3/users/53f714c2065b467699ec9c2b26d71c9a` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:32.703299 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1efe4f-4260-4bc2-9b0a-9e7f253e4e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f714c2065b467699ec9c2b26d71c9a)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:32.705304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1efe4f-4260-4bc2-9b0a-9e7f253e4e58 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:32.753310 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ae1efe4f-4260-4bc2-9b0a-9e7f253e4e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f714c2065b467699ec9c2b26d71c9a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:32.760205 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ae1efe4f-4260-4bc2-9b0a-9e7f253e4e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f714c2065b467699ec9c2b26d71c9a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:32.772171 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ae1efe4f-4260-4bc2-9b0a-9e7f253e4e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f714c2065b467699ec9c2b26d71c9a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:32.772854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ae1efe4f-4260-4bc2-9b0a-9e7f253e4e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f714c2065b467699ec9c2b26d71c9a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:32.782493 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ae1efe4f-4260-4bc2-9b0a-9e7f253e4e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f714c2065b467699ec9c2b26d71c9a'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:32.789391 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1186/2333] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:21:32 2022] DELETE /identity/v3/users/53f714c2065b467699ec9c2b26d71c9a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:21:32.978645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8e246-f466-4324-9e9f-c8d94d221cf6 service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:32.991138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8e246-f466-4324-9e9f-c8d94d221cf6 service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:33.054812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca863f-d141-4f34-88e4-8a8727da99b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:33.055444 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca863f-d141-4f34-88e4-8a8727da99b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:33.055720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca863f-d141-4f34-88e4-8a8727da99b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:33.055985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca863f-d141-4f34-88e4-8a8727da99b0 admin admin] PATH_INFO: `/v3/projects/68581b8b121c4ecebcf7b1595cc8640d` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:33.057130 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca863f-d141-4f34-88e4-8a8727da99b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68581b8b121c4ecebcf7b1595cc8640d)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:33.059076 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca863f-d141-4f34-88e4-8a8727da99b0 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:33.105982 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-86ca863f-d141-4f34-88e4-8a8727da99b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68581b8b121c4ecebcf7b1595cc8640d', 'request_id': 'req-86ca863f-d141-4f34-88e4-8a8727da99b0'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:33.113800 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-86ca863f-d141-4f34-88e4-8a8727da99b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68581b8b121c4ecebcf7b1595cc8640d', 'request_id': 'req-86ca863f-d141-4f34-88e4-8a8727da99b0'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:33.120342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-86ca863f-d141-4f34-88e4-8a8727da99b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68581b8b121c4ecebcf7b1595cc8640d', 'request_id': 'req-86ca863f-d141-4f34-88e4-8a8727da99b0'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:33.131539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-86ca863f-d141-4f34-88e4-8a8727da99b0 admin admin] The token cache is being invalidate because project 68581b8b121c4ecebcf7b1595cc8640d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:21:33.131819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-86ca863f-d141-4f34-88e4-8a8727da99b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:33.132538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-86ca863f-d141-4f34-88e4-8a8727da99b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:21:33.134174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1148/2334] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:21:32 2022] DELETE /identity/v3/projects/68581b8b121c4ecebcf7b1595cc8640d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:21:33.139553 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796a5e7-13f6-4987-951d-3d65c8fa57e1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:33.139837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796a5e7-13f6-4987-951d-3d65c8fa57e1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:33.140109 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796a5e7-13f6-4987-951d-3d65c8fa57e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:33.161119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b796a5e7-13f6-4987-951d-3d65c8fa57e1 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:21:33.162377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b796a5e7-13f6-4987-951d-3d65c8fa57e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:33.223712 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1187/2335] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:21:33.232484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f999870-2ab6-4e9c-9c93-5a33ebcdd485 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:33.232771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f999870-2ab6-4e9c-9c93-5a33ebcdd485 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:33.233036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f999870-2ab6-4e9c-9c93-5a33ebcdd485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:33.255484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-7f999870-2ab6-4e9c-9c93-5a33ebcdd485 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:21:33.256712 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7f999870-2ab6-4e9c-9c93-5a33ebcdd485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:33.265744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1149/2336] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:21:33.270449 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796a5e7-13f6-4987-951d-3d65c8fa57e1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:33.277040 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:33.281510 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796a5e7-13f6-4987-951d-3d65c8fa57e1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:33.288363 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886358e-6c25-42f6-ab21-7bd951ff936b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:33.289047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886358e-6c25-42f6-ab21-7bd951ff936b admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:33.289318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886358e-6c25-42f6-ab21-7bd951ff936b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:33.289584 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886358e-6c25-42f6-ab21-7bd951ff936b admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:33.290275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886358e-6c25-42f6-ab21-7bd951ff936b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:21:33.290915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886358e-6c25-42f6-ab21-7bd951ff936b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:33.293000 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886358e-6c25-42f6-ab21-7bd951ff936b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:33.305781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1188/2337] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:21:33.310354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f999870-2ab6-4e9c-9c93-5a33ebcdd485 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:33.320062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f999870-2ab6-4e9c-9c93-5a33ebcdd485 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:33.326193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0bf7e-d439-45ab-9d02-66735b9a43a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:33.326780 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0bf7e-d439-45ab-9d02-66735b9a43a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:33.327056 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0bf7e-d439-45ab-9d02-66735b9a43a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:33.327319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0bf7e-d439-45ab-9d02-66735b9a43a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:33.327960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0bf7e-d439-45ab-9d02-66735b9a43a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:33.330085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0bf7e-d439-45ab-9d02-66735b9a43a1 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:33.360636 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1150/2338] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:21:33 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:21:33.365392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886358e-6c25-42f6-ab21-7bd951ff936b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:33.375647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886358e-6c25-42f6-ab21-7bd951ff936b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:33.432810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de08791-233d-4e4a-8e8a-badaa7196863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:33.433465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de08791-233d-4e4a-8e8a-badaa7196863 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:33.433708 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de08791-233d-4e4a-8e8a-badaa7196863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:33.433982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de08791-233d-4e4a-8e8a-badaa7196863 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:33.434607 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de08791-233d-4e4a-8e8a-badaa7196863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:33.436537 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de08791-233d-4e4a-8e8a-badaa7196863 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:33.459460 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1189/2339] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:21:33 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:21:33.463658 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0bf7e-d439-45ab-9d02-66735b9a43a1 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:33.474716 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0bf7e-d439-45ab-9d02-66735b9a43a1 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:33.481290 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efc233-b839-4c21-b88a-5f4f99093445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:33.481972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efc233-b839-4c21-b88a-5f4f99093445 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:33.482326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efc233-b839-4c21-b88a-5f4f99093445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:33.482596 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efc233-b839-4c21-b88a-5f4f99093445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:33.483351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efc233-b839-4c21-b88a-5f4f99093445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:33.485040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efc233-b839-4c21-b88a-5f4f99093445 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:33.496380 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1151/2340] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:21:33.500889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de08791-233d-4e4a-8e8a-badaa7196863 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:33.511496 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de08791-233d-4e4a-8e8a-badaa7196863 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:33.517150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d559c-a447-44d4-975e-5932143ab02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:33.517986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d559c-a447-44d4-975e-5932143ab02d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:33.518277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d559c-a447-44d4-975e-5932143ab02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:33.518524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d559c-a447-44d4-975e-5932143ab02d admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:33.519167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d559c-a447-44d4-975e-5932143ab02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:33.520768 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d559c-a447-44d4-975e-5932143ab02d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:33.532785 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1190/2341] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:21:33.537516 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efc233-b839-4c21-b88a-5f4f99093445 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:33.548075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efc233-b839-4c21-b88a-5f4f99093445 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:33.553929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294542b-578e-475a-a904-348159138528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:33.554596 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294542b-578e-475a-a904-348159138528 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:33.554871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294542b-578e-475a-a904-348159138528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:33.555165 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294542b-578e-475a-a904-348159138528 admin admin] PATH_INFO: `/v3/projects/1280913a963042b4bfc402843355aa21/users/a915171d79d846dd9646b947875e5f63/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:33.566656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:33.570977 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294542b-578e-475a-a904-348159138528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1280913a963042b4bfc402843355aa21, user_id=a915171d79d846dd9646b947875e5f63, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:33.574321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294542b-578e-475a-a904-348159138528 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:33.588008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1152/2342] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:21:33 2022] PUT /identity/v3/projects/1280913a963042b4bfc402843355aa21/users/a915171d79d846dd9646b947875e5f63/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:21:33.598584 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3b2db-5f11-48b4-9d22-fe57ac566420 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:33.598915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3b2db-5f11-48b4-9d22-fe57ac566420 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:33.599215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3b2db-5f11-48b4-9d22-fe57ac566420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:33.627484 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-95b3b2db-5f11-48b4-9d22-fe57ac566420 None None] MFA Rules not processed for user `a915171d79d846dd9646b947875e5f63`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:21:33.628680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-95b3b2db-5f11-48b4-9d22-fe57ac566420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:33.695260 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1191/2343] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:21:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:21:33.707524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294542b-578e-475a-a904-348159138528 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:33.709468 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8294542b-578e-475a-a904-348159138528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:33.806278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294542b-578e-475a-a904-348159138528 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:33.811216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb9ac1-cb9e-4cc2-837a-74df7c34f289 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5356835ef79c458bbfa7d6adafd0cb36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:33.811819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb9ac1-cb9e-4cc2-837a-74df7c34f289 service glance] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:33.812088 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb9ac1-cb9e-4cc2-837a-74df7c34f289 service glance] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:33.812350 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb9ac1-cb9e-4cc2-837a-74df7c34f289 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:33.822585 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb9ac1-cb9e-4cc2-837a-74df7c34f289 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:33.823942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb9ac1-cb9e-4cc2-837a-74df7c34f289 service glance] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:33.834294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1153/2344] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:21:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:21:36.620613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e497493-bca4-4e41-8768-d6b65ed229a0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:36.621163 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e497493-bca4-4e41-8768-d6b65ed229a0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:36.621163 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e497493-bca4-4e41-8768-d6b65ed229a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:36.641993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8e497493-bca4-4e41-8768-d6b65ed229a0 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:21:36.643192 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8e497493-bca4-4e41-8768-d6b65ed229a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:36.694788 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:36.704730 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1192/2345] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Aug 9 11:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:21:36.721388 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb9ac1-cb9e-4cc2-837a-74df7c34f289 service glance] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:36.722981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5dcb9ac1-cb9e-4cc2-837a-74df7c34f289 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:36.802234 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb9ac1-cb9e-4cc2-837a-74df7c34f289 service glance] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:36.808300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe086ff-5cab-4851-9756-75e312936fa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:36.808850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe086ff-5cab-4851-9756-75e312936fa0 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:36.809118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe086ff-5cab-4851-9756-75e312936fa0 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:36.809387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe086ff-5cab-4851-9756-75e312936fa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:36.817740 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe086ff-5cab-4851-9756-75e312936fa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:36.819338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe086ff-5cab-4851-9756-75e312936fa0 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:36.830217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1154/2346] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:21:46.824822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=73,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:21:54.282659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb7bf9-f34e-463f-9b00-1d4ac0ca44e3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:54.283335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb7bf9-f34e-463f-9b00-1d4ac0ca44e3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:54.283335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb7bf9-f34e-463f-9b00-1d4ac0ca44e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:54.305670 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8fcb7bf9-f34e-463f-9b00-1d4ac0ca44e3 None None] MFA Rules not processed for user `badd43a25b614721a05cd1a3697ee0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:21:54.307209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8fcb7bf9-f34e-463f-9b00-1d4ac0ca44e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:54.366332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1193/2347] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:21:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:21:56.559699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eba2f6-b185-4c7c-92ee-4ffd31203b97 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:56.560724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eba2f6-b185-4c7c-92ee-4ffd31203b97 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:56.560724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eba2f6-b185-4c7c-92ee-4ffd31203b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:56.589972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-06eba2f6-b185-4c7c-92ee-4ffd31203b97 None None] MFA Rules not processed for user `d98fa7056d4247edbda7c8e406e2dcb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:21:56.592451 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-06eba2f6-b185-4c7c-92ee-4ffd31203b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:56.686477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1155/2348] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:21:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:21:58.045732 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb7bf9-f34e-463f-9b00-1d4ac0ca44e3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:58.047842 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8fcb7bf9-f34e-463f-9b00-1d4ac0ca44e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:58.091654 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eba2f6-b185-4c7c-92ee-4ffd31203b97 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:21:58.093180 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-06eba2f6-b185-4c7c-92ee-4ffd31203b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:58.133115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb7bf9-f34e-463f-9b00-1d4ac0ca44e3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:58.140450 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd1d4e-1236-450a-8c10-6aed33557b6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:58.142423 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd1d4e-1236-450a-8c10-6aed33557b6d service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:58.142777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd1d4e-1236-450a-8c10-6aed33557b6d service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:58.143152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd1d4e-1236-450a-8c10-6aed33557b6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:58.145122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-03bd1d4e-1236-450a-8c10-6aed33557b6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:21:58.159862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd1d4e-1236-450a-8c10-6aed33557b6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:58.162101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd1d4e-1236-450a-8c10-6aed33557b6d service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:58.174153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1194/2349] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:21:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:21:58.195602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eba2f6-b185-4c7c-92ee-4ffd31203b97 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:21:58.203480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a11b0-e607-4d9b-9adb-83db1686be45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:21:58.204593 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a11b0-e607-4d9b-9adb-83db1686be45 service placement] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:21:58.204965 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a11b0-e607-4d9b-9adb-83db1686be45 service placement] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:21:58.205330 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a11b0-e607-4d9b-9adb-83db1686be45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:21:58.216698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a11b0-e607-4d9b-9adb-83db1686be45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:21:58.218869 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a11b0-e607-4d9b-9adb-83db1686be45 service placement] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:21:58.246916 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1156/2350] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:21:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:22:07.618732 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd1d4e-1236-450a-8c10-6aed33557b6d service placement] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:07.630444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd1d4e-1236-450a-8c10-6aed33557b6d service placement] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:07.636235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d0a91-c75f-465f-9e42-54420df8337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:07.636867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d0a91-c75f-465f-9e42-54420df8337f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:07.637149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d0a91-c75f-465f-9e42-54420df8337f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:07.637416 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d0a91-c75f-465f-9e42-54420df8337f admin admin] PATH_INFO: `/v3/users/a915171d79d846dd9646b947875e5f63` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:07.638678 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d0a91-c75f-465f-9e42-54420df8337f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a915171d79d846dd9646b947875e5f63)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:07.640704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d0a91-c75f-465f-9e42-54420df8337f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:07.689122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f3d0a91-c75f-465f-9e42-54420df8337f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a915171d79d846dd9646b947875e5f63'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:07.696077 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f3d0a91-c75f-465f-9e42-54420df8337f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a915171d79d846dd9646b947875e5f63'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:07.708016 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f3d0a91-c75f-465f-9e42-54420df8337f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a915171d79d846dd9646b947875e5f63'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:07.708715 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f3d0a91-c75f-465f-9e42-54420df8337f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a915171d79d846dd9646b947875e5f63'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:07.717078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7f3d0a91-c75f-465f-9e42-54420df8337f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a915171d79d846dd9646b947875e5f63'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:07.723393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1195/2351] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:22:07 2022] DELETE /identity/v3/users/a915171d79d846dd9646b947875e5f63 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:22:07.728089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd6e3e-4bc5-485b-a45e-5231580b7132 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:07.728667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd6e3e-4bc5-485b-a45e-5231580b7132 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:07.728667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd6e3e-4bc5-485b-a45e-5231580b7132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:07.750098 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-27dd6e3e-4bc5-485b-a45e-5231580b7132 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:07.751315 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-27dd6e3e-4bc5-485b-a45e-5231580b7132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:07.811199 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1157/2352] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:07.821524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d0a91-c75f-465f-9e42-54420df8337f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:07.823118 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7f3d0a91-c75f-465f-9e42-54420df8337f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:07.835052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:07.889495 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d0a91-c75f-465f-9e42-54420df8337f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:07.893476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ff96a-0655-4b30-8b64-20cf00ad2f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:07.894141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ff96a-0655-4b30-8b64-20cf00ad2f48 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:07.894520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ff96a-0655-4b30-8b64-20cf00ad2f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:07.894784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ff96a-0655-4b30-8b64-20cf00ad2f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:07.904602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ff96a-0655-4b30-8b64-20cf00ad2f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:07.906077 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ff96a-0655-4b30-8b64-20cf00ad2f48 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:07.916499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1196/2353] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:22:08.555240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd6e3e-4bc5-485b-a45e-5231580b7132 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:08.556802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-27dd6e3e-4bc5-485b-a45e-5231580b7132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:08.571466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd6e3e-4bc5-485b-a45e-5231580b7132 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:08.576823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9f5cbe-30c1-4a03-be78-897f257259d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:08.577901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f5cbe-30c1-4a03-be78-897f257259d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:08.578271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f5cbe-30c1-4a03-be78-897f257259d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:08.578648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f5cbe-30c1-4a03-be78-897f257259d2 admin admin] PATH_INFO: `/v3/projects/1280913a963042b4bfc402843355aa21` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:08.580180 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f5cbe-30c1-4a03-be78-897f257259d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1280913a963042b4bfc402843355aa21)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:08.582696 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9f5cbe-30c1-4a03-be78-897f257259d2 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:08.624297 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:08.638780 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-bc9f5cbe-30c1-4a03-be78-897f257259d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1280913a963042b4bfc402843355aa21', 'request_id': 'req-bc9f5cbe-30c1-4a03-be78-897f257259d2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:08.647894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-bc9f5cbe-30c1-4a03-be78-897f257259d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1280913a963042b4bfc402843355aa21', 'request_id': 'req-bc9f5cbe-30c1-4a03-be78-897f257259d2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:08.654555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-bc9f5cbe-30c1-4a03-be78-897f257259d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1280913a963042b4bfc402843355aa21', 'request_id': 'req-bc9f5cbe-30c1-4a03-be78-897f257259d2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:08.664787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-bc9f5cbe-30c1-4a03-be78-897f257259d2 admin admin] The token cache is being invalidate because project 1280913a963042b4bfc402843355aa21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:22:08.665069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-bc9f5cbe-30c1-4a03-be78-897f257259d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:08.665729 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-bc9f5cbe-30c1-4a03-be78-897f257259d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:08.667226 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1158/2354] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:22:08 2022] DELETE /identity/v3/projects/1280913a963042b4bfc402843355aa21 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:22:08.672356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23443-95f9-4943-9833-9fb577be941c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:08.672870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23443-95f9-4943-9833-9fb577be941c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:08.672961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23443-95f9-4943-9833-9fb577be941c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:08.693508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bae23443-95f9-4943-9833-9fb577be941c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:08.694762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bae23443-95f9-4943-9833-9fb577be941c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:08.755310 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1197/2355] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:22:08.763402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f3558-7d11-4d3d-8557-18ed36417f32 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:08.763920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f3558-7d11-4d3d-8557-18ed36417f32 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:08.763920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f3558-7d11-4d3d-8557-18ed36417f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:08.784160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-ae1f3558-7d11-4d3d-8557-18ed36417f32 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:08.785326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ae1f3558-7d11-4d3d-8557-18ed36417f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:08.793329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1159/2356] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:08.797907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae23443-95f9-4943-9833-9fb577be941c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:08.808674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae23443-95f9-4943-9833-9fb577be941c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:08.813684 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea11f5-10b2-416b-9fed-9d60363435cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:08.814308 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea11f5-10b2-416b-9fed-9d60363435cf admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:08.814606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea11f5-10b2-416b-9fed-9d60363435cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:08.814896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea11f5-10b2-416b-9fed-9d60363435cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:08.815524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea11f5-10b2-416b-9fed-9d60363435cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:22:08.815843 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea11f5-10b2-416b-9fed-9d60363435cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:08.817695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea11f5-10b2-416b-9fed-9d60363435cf admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:08.831124 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1198/2357] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:22:08.835911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f3558-7d11-4d3d-8557-18ed36417f32 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:08.845939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f3558-7d11-4d3d-8557-18ed36417f32 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:08.851032 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda723a-def2-4b66-ba47-965d955f60a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:08.851641 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda723a-def2-4b66-ba47-965d955f60a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:08.851907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda723a-def2-4b66-ba47-965d955f60a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:08.852160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda723a-def2-4b66-ba47-965d955f60a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:08.852776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda723a-def2-4b66-ba47-965d955f60a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:08.854695 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda723a-def2-4b66-ba47-965d955f60a1 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:08.891440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1160/2358] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:22:08 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:22:08.895753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea11f5-10b2-416b-9fed-9d60363435cf admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:08.906688 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea11f5-10b2-416b-9fed-9d60363435cf admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:08.980716 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558682f-df43-4d3f-9379-6e7c6afcf4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:08.980940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558682f-df43-4d3f-9379-6e7c6afcf4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:08.981487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558682f-df43-4d3f-9379-6e7c6afcf4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:08.981487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558682f-df43-4d3f-9379-6e7c6afcf4f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:08.982130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558682f-df43-4d3f-9379-6e7c6afcf4f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:08.984414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558682f-df43-4d3f-9379-6e7c6afcf4f3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:09.010987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1199/2359] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:22:08 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:22:09.015231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda723a-def2-4b66-ba47-965d955f60a1 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:09.027637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda723a-def2-4b66-ba47-965d955f60a1 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:09.032543 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b09526-acf5-4995-aaa6-54aabd516961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:09.033245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b09526-acf5-4995-aaa6-54aabd516961 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:09.033575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b09526-acf5-4995-aaa6-54aabd516961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:09.033935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b09526-acf5-4995-aaa6-54aabd516961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:09.034640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b09526-acf5-4995-aaa6-54aabd516961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:09.036416 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b09526-acf5-4995-aaa6-54aabd516961 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:09.047103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1161/2360] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:22:09.051626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558682f-df43-4d3f-9379-6e7c6afcf4f3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:09.062570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558682f-df43-4d3f-9379-6e7c6afcf4f3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:09.067812 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e9e08-2f57-4b77-bac3-5b9f6d450f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:09.068437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e9e08-2f57-4b77-bac3-5b9f6d450f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:09.068713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e9e08-2f57-4b77-bac3-5b9f6d450f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:09.068983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e9e08-2f57-4b77-bac3-5b9f6d450f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:09.069686 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e9e08-2f57-4b77-bac3-5b9f6d450f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:09.071325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e9e08-2f57-4b77-bac3-5b9f6d450f3d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:09.084272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1200/2361] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:22:09.088536 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b09526-acf5-4995-aaa6-54aabd516961 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:09.100246 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b09526-acf5-4995-aaa6-54aabd516961 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:09.105224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0744c-4f46-4928-a4be-2f8105bae987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:09.106201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0744c-4f46-4928-a4be-2f8105bae987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:09.106201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0744c-4f46-4928-a4be-2f8105bae987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:09.106438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0744c-4f46-4928-a4be-2f8105bae987 admin admin] PATH_INFO: `/v3/projects/7b0b9e8375aa48879c076ee0f3f32bde/users/83421b11bde147d7aa16ce3fb1a15285/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:09.126870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0744c-4f46-4928-a4be-2f8105bae987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0b9e8375aa48879c076ee0f3f32bde, user_id=83421b11bde147d7aa16ce3fb1a15285, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:09.129676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0744c-4f46-4928-a4be-2f8105bae987 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:09.144843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1162/2362] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:22:09 2022] PUT /identity/v3/projects/7b0b9e8375aa48879c076ee0f3f32bde/users/83421b11bde147d7aa16ce3fb1a15285/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:22:09.216218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c456c1d-e2fd-470c-aec0-aacbbebe9809 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:09.216483 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c456c1d-e2fd-470c-aec0-aacbbebe9809 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:09.216773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c456c1d-e2fd-470c-aec0-aacbbebe9809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:09.247299 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4c456c1d-e2fd-470c-aec0-aacbbebe9809 None None] MFA Rules not processed for user `83421b11bde147d7aa16ce3fb1a15285`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:09.248551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4c456c1d-e2fd-470c-aec0-aacbbebe9809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:09.253043 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:09.321241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1201/2363] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:22:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:09.334953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0744c-4f46-4928-a4be-2f8105bae987 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:09.336948 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6ce0744c-4f46-4928-a4be-2f8105bae987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:09.399939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0744c-4f46-4928-a4be-2f8105bae987 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:09.404152 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b995b-4966-435c-851b-cf6bcf3f0c82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:09.404783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b995b-4966-435c-851b-cf6bcf3f0c82 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:09.405060 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b995b-4966-435c-851b-cf6bcf3f0c82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:09.405321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b995b-4966-435c-851b-cf6bcf3f0c82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:09.416070 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b995b-4966-435c-851b-cf6bcf3f0c82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:09.418022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b995b-4966-435c-851b-cf6bcf3f0c82 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:09.427867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1163/2364] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:22:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:22:14.797124 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54df2f-dd8f-4db5-ae01-272ad65e545d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:14.797764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54df2f-dd8f-4db5-ae01-272ad65e545d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:14.797764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54df2f-dd8f-4db5-ae01-272ad65e545d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:14.819602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8f54df2f-dd8f-4db5-ae01-272ad65e545d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:14.821410 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8f54df2f-dd8f-4db5-ae01-272ad65e545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:14.902118 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1202/2365] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Aug 9 11:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:22:14.917805 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b995b-4966-435c-851b-cf6bcf3f0c82 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:14.919270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5f8b995b-4966-435c-851b-cf6bcf3f0c82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:14.975961 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:15.001355 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b995b-4966-435c-851b-cf6bcf3f0c82 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:15.010053 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9d3ae-d0f1-4194-b2c2-ece06bd93f65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:15.011041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9d3ae-d0f1-4194-b2c2-ece06bd93f65 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:15.011507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9d3ae-d0f1-4194-b2c2-ece06bd93f65 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:15.011939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9d3ae-d0f1-4194-b2c2-ece06bd93f65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:15.024374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9d3ae-d0f1-4194-b2c2-ece06bd93f65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:15.026185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9d3ae-d0f1-4194-b2c2-ece06bd93f65 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:15.046177 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1164/2366] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:22:19.172378 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09939ff-2764-46e4-8b68-c129ee5a2c45 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:19.172953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09939ff-2764-46e4-8b68-c129ee5a2c45 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:19.172953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09939ff-2764-46e4-8b68-c129ee5a2c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:19.194613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f09939ff-2764-46e4-8b68-c129ee5a2c45 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:19.195840 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f09939ff-2764-46e4-8b68-c129ee5a2c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:19.204621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1203/2367] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Aug 9 11:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:19.219566 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9d3ae-d0f1-4194-b2c2-ece06bd93f65 service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:19.221710 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fab9d3ae-d0f1-4194-b2c2-ece06bd93f65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:19.240122 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9d3ae-d0f1-4194-b2c2-ece06bd93f65 service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:19.247022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122d55a-4a44-4551-b10b-3530c71fb280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:19.247957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122d55a-4a44-4551-b10b-3530c71fb280 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:19.248385 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122d55a-4a44-4551-b10b-3530c71fb280 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:19.248652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122d55a-4a44-4551-b10b-3530c71fb280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:19.262732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122d55a-4a44-4551-b10b-3530c71fb280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:19.264357 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122d55a-4a44-4551-b10b-3530c71fb280 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:19.274823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1165/2368] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:22:22.395912 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6229c-7d17-4da3-a721-373da8904b86 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:22.396469 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6229c-7d17-4da3-a721-373da8904b86 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:22.396469 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6229c-7d17-4da3-a721-373da8904b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:22.417443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-3ec6229c-7d17-4da3-a721-373da8904b86 None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:22.418686 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3ec6229c-7d17-4da3-a721-373da8904b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:22.477324 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1204/2369] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Aug 9 11:22:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:22:22.502872 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122d55a-4a44-4551-b10b-3530c71fb280 service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:22.504618 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d122d55a-4a44-4551-b10b-3530c71fb280 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:22.580573 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122d55a-4a44-4551-b10b-3530c71fb280 service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:22.589389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25367af3-004f-447a-90ed-c1fd799ff1d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:22.590105 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25367af3-004f-447a-90ed-c1fd799ff1d0 service swift] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:22.590471 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25367af3-004f-447a-90ed-c1fd799ff1d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:22.590749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25367af3-004f-447a-90ed-c1fd799ff1d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:22.599683 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25367af3-004f-447a-90ed-c1fd799ff1d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:22.601271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25367af3-004f-447a-90ed-c1fd799ff1d0 service swift] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:22.610363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1166/2370] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:22:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:22:23.313821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba2545-d34f-4f9d-94ab-cca503c235f8 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:23.313821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba2545-d34f-4f9d-94ab-cca503c235f8 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:23.313821 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba2545-d34f-4f9d-94ab-cca503c235f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:23.342556 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d3ba2545-d34f-4f9d-94ab-cca503c235f8 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:23.343795 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d3ba2545-d34f-4f9d-94ab-cca503c235f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:23.373729 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1205/2371] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Aug 9 11:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:23.392968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25367af3-004f-447a-90ed-c1fd799ff1d0 service swift] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:23.418284 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25367af3-004f-447a-90ed-c1fd799ff1d0 service swift] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:23.427966 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07536462-5a0c-45b3-a46b-2677c57dd275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:23.430287 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07536462-5a0c-45b3-a46b-2677c57dd275 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:23.430287 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07536462-5a0c-45b3-a46b-2677c57dd275 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:23.430287 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07536462-5a0c-45b3-a46b-2677c57dd275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:23.445042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07536462-5a0c-45b3-a46b-2677c57dd275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:23.446799 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07536462-5a0c-45b3-a46b-2677c57dd275 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:23.463521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1167/2372] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:22:27.618998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a87482-f5f2-4a38-88c1-39babb2eccbc None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:27.619538 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a87482-f5f2-4a38-88c1-39babb2eccbc None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:27.619538 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a87482-f5f2-4a38-88c1-39babb2eccbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:27.665018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c5a87482-f5f2-4a38-88c1-39babb2eccbc None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:27.666917 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c5a87482-f5f2-4a38-88c1-39babb2eccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:27.684742 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1206/2373] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Aug 9 11:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:27.710405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07536462-5a0c-45b3-a46b-2677c57dd275 service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:27.729951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07536462-5a0c-45b3-a46b-2677c57dd275 service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:27.736705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5659a-d12a-43f5-a24c-a7b6e2283c9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:27.737538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5659a-d12a-43f5-a24c-a7b6e2283c9a service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:27.738039 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5659a-d12a-43f5-a24c-a7b6e2283c9a service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:27.738824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5659a-d12a-43f5-a24c-a7b6e2283c9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:27.751798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5659a-d12a-43f5-a24c-a7b6e2283c9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:27.753557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb5659a-d12a-43f5-a24c-a7b6e2283c9a service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:27.778725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1168/2374] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:22:32.907451 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d65da-86dd-49bb-ad49-101052022fbe None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:32.908131 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d65da-86dd-49bb-ad49-101052022fbe None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:32.908131 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d65da-86dd-49bb-ad49-101052022fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:32.928620 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-412d65da-86dd-49bb-ad49-101052022fbe None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:32.929863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-412d65da-86dd-49bb-ad49-101052022fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:32.938024 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1207/2375] 10.222.0.39 () {58 vars in 1016 bytes} [Tue Aug 9 11:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:32.961152 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5659a-d12a-43f5-a24c-a7b6e2283c9a service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:32.973024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb5659a-d12a-43f5-a24c-a7b6e2283c9a service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:32.979617 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de59d9-7771-4548-ac80-472c854914d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:32.980209 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de59d9-7771-4548-ac80-472c854914d8 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:32.980657 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de59d9-7771-4548-ac80-472c854914d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:32.981086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de59d9-7771-4548-ac80-472c854914d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:32.990428 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de59d9-7771-4548-ac80-472c854914d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:32.992019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de59d9-7771-4548-ac80-472c854914d8 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:33.002487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1169/2376] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:22:39.127033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb44a4-40f6-4e0d-9c3b-9e3d5570a2bd None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:39.127574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb44a4-40f6-4e0d-9c3b-9e3d5570a2bd None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:39.127574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb44a4-40f6-4e0d-9c3b-9e3d5570a2bd None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:39.129009 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1208/2377] 10.222.0.15 () {54 vars in 921 bytes} [Tue Aug 9 11:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:22:39.136400 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659dc4f-1fed-4207-a7f5-5aa0fd32951d None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:39.136919 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659dc4f-1fed-4207-a7f5-5aa0fd32951d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:39.136919 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659dc4f-1fed-4207-a7f5-5aa0fd32951d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:39.160711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-d659dc4f-1fed-4207-a7f5-5aa0fd32951d None None] MFA Rules not processed for user `881030d7605b40879762d1c199362ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:39.161942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d659dc4f-1fed-4207-a7f5-5aa0fd32951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:39.185994 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1170/2378] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Aug 9 11:22:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:22:39.199974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb44a4-40f6-4e0d-9c3b-9e3d5570a2bd None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:39.202324 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d9fb44a4-40f6-4e0d-9c3b-9e3d5570a2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:39.234230 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:39.286606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb44a4-40f6-4e0d-9c3b-9e3d5570a2bd None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:39.296721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938e47a-0432-44d2-a747-9d178d2e253e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5356835ef79c458bbfa7d6adafd0cb36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:39.298127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938e47a-0432-44d2-a747-9d178d2e253e service glance] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:39.298569 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938e47a-0432-44d2-a747-9d178d2e253e service glance] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:39.299147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938e47a-0432-44d2-a747-9d178d2e253e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:39.312093 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938e47a-0432-44d2-a747-9d178d2e253e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:39.314141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938e47a-0432-44d2-a747-9d178d2e253e service glance] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:39.325935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1209/2379] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:22:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:22:39.402238 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b70b0e-cfa0-493a-b738-ff4b2a81e969 None None] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:39.402520 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b70b0e-cfa0-493a-b738-ff4b2a81e969 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:39.402797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b70b0e-cfa0-493a-b738-ff4b2a81e969 None None] PATH_INFO: `/` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:39.404164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1171/2380] 10.222.0.15 () {54 vars in 921 bytes} [Tue Aug 9 11:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:22:39.409559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953d395-75f1-4ac3-8e6b-bea878d83418 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:39.409876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953d395-75f1-4ac3-8e6b-bea878d83418 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:39.410148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953d395-75f1-4ac3-8e6b-bea878d83418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:39.430189 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-2953d395-75f1-4ac3-8e6b-bea878d83418 None None] MFA Rules not processed for user `0ee3889add1541418ccda24268831979`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:39.431375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2953d395-75f1-4ac3-8e6b-bea878d83418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:39.491156 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1210/2381] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Aug 9 11:22:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:39.505456 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b70b0e-cfa0-493a-b738-ff4b2a81e969 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:39.507411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-13b70b0e-cfa0-493a-b738-ff4b2a81e969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:39.522321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b70b0e-cfa0-493a-b738-ff4b2a81e969 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:39.526835 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429bbef-92a9-482e-92bc-099d0fb294ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:39.527415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429bbef-92a9-482e-92bc-099d0fb294ff service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:39.527682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429bbef-92a9-482e-92bc-099d0fb294ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:39.527942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429bbef-92a9-482e-92bc-099d0fb294ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:39.535358 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429bbef-92a9-482e-92bc-099d0fb294ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:39.536769 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429bbef-92a9-482e-92bc-099d0fb294ff service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:39.544528 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1172/2382] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:22:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:22:39.632657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4dd0a-2e3b-4311-851f-0f2c790a3da3 None None] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:39.632829 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4dd0a-2e3b-4311-851f-0f2c790a3da3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:39.633218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4dd0a-2e3b-4311-851f-0f2c790a3da3 None None] PATH_INFO: `/` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:39.635227 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1211/2383] 10.222.0.15 () {54 vars in 921 bytes} [Tue Aug 9 11:22:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 11:22:39.640814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c784411-582a-4c8d-a560-bf35a7f2d784 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:39.641093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c784411-582a-4c8d-a560-bf35a7f2d784 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:39.641347 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c784411-582a-4c8d-a560-bf35a7f2d784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:39.662294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-2c784411-582a-4c8d-a560-bf35a7f2d784 None None] MFA Rules not processed for user `881030d7605b40879762d1c199362ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:39.663493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2c784411-582a-4c8d-a560-bf35a7f2d784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:39.674208 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1173/2384] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Aug 9 11:22:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:39.687819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4dd0a-2e3b-4311-851f-0f2c790a3da3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:39.702204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4dd0a-2e3b-4311-851f-0f2c790a3da3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:39.708570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f508-458b-4f30-bc39-b8709542bdab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:39.709308 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f508-458b-4f30-bc39-b8709542bdab service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:39.709696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f508-458b-4f30-bc39-b8709542bdab service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:39.710073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254f508-458b-4f30-bc39-b8709542bdab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:39.725663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254f508-458b-4f30-bc39-b8709542bdab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:39.727098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254f508-458b-4f30-bc39-b8709542bdab service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:39.738246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1212/2385] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:22:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:22:47.550698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3b861-4c31-43c8-b247-9b8db62e738e None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:47.551334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3b861-4c31-43c8-b247-9b8db62e738e None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:47.551334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3b861-4c31-43c8-b247-9b8db62e738e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:47.558953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=77 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:47.574661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-c8f3b861-4c31-43c8-b247-9b8db62e738e None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:47.575868 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c8f3b861-4c31-43c8-b247-9b8db62e738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:47.583543 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1174/2386] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Aug 9 11:22:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:47.622104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f508-458b-4f30-bc39-b8709542bdab service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:47.636117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254f508-458b-4f30-bc39-b8709542bdab service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:47.641782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f091f-b482-443f-b8ba-ba255123a2b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:47.642514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f091f-b482-443f-b8ba-ba255123a2b1 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:47.643077 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f091f-b482-443f-b8ba-ba255123a2b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:47.643508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f091f-b482-443f-b8ba-ba255123a2b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:47.654542 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f091f-b482-443f-b8ba-ba255123a2b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:47.656530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f091f-b482-443f-b8ba-ba255123a2b1 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:47.667987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1213/2387] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:22:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:22:48.856246 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3b861-4c31-43c8-b247-9b8db62e738e None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:48.871041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3b861-4c31-43c8-b247-9b8db62e738e None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:48.876359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8ec0-dd71-468d-9b3f-98be1b0db866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:48.877016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8ec0-dd71-468d-9b3f-98be1b0db866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:48.877288 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8ec0-dd71-468d-9b3f-98be1b0db866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:48.877558 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d8ec0-dd71-468d-9b3f-98be1b0db866 admin admin] PATH_INFO: `/v3/users/83421b11bde147d7aa16ce3fb1a15285` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:48.879065 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d8ec0-dd71-468d-9b3f-98be1b0db866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83421b11bde147d7aa16ce3fb1a15285)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:48.883150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d8ec0-dd71-468d-9b3f-98be1b0db866 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:48.967373 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8c8d8ec0-dd71-468d-9b3f-98be1b0db866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83421b11bde147d7aa16ce3fb1a15285'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:48.975547 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8c8d8ec0-dd71-468d-9b3f-98be1b0db866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83421b11bde147d7aa16ce3fb1a15285'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:48.976179 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8c8d8ec0-dd71-468d-9b3f-98be1b0db866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83421b11bde147d7aa16ce3fb1a15285'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:48.983545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8c8d8ec0-dd71-468d-9b3f-98be1b0db866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83421b11bde147d7aa16ce3fb1a15285'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:49.000035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-8c8d8ec0-dd71-468d-9b3f-98be1b0db866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83421b11bde147d7aa16ce3fb1a15285'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:49.009675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1175/2388] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:22:48 2022] DELETE /identity/v3/users/83421b11bde147d7aa16ce3fb1a15285 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:22:49.011876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be10c3-7015-483f-803b-ec0035e8655f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:49.012697 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be10c3-7015-483f-803b-ec0035e8655f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:49.013116 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be10c3-7015-483f-803b-ec0035e8655f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:49.034415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-37be10c3-7015-483f-803b-ec0035e8655f None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:22:49.035890 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-37be10c3-7015-483f-803b-ec0035e8655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:49.098789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1214/2389] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:22:49.108949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8ec0-dd71-468d-9b3f-98be1b0db866 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:49.110496 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8c8d8ec0-dd71-468d-9b3f-98be1b0db866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:49.169018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d8ec0-dd71-468d-9b3f-98be1b0db866 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:49.172779 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91890fa5-900e-47c8-9bda-a1250b7a041a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:49.173394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91890fa5-900e-47c8-9bda-a1250b7a041a service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:49.173701 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91890fa5-900e-47c8-9bda-a1250b7a041a service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:49.173966 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91890fa5-900e-47c8-9bda-a1250b7a041a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:49.184593 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91890fa5-900e-47c8-9bda-a1250b7a041a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:49.186326 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91890fa5-900e-47c8-9bda-a1250b7a041a service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:49.197237 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1176/2390] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:22:49.494536 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be10c3-7015-483f-803b-ec0035e8655f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:22:49.496325 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-37be10c3-7015-483f-803b-ec0035e8655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:22:49.514786 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be10c3-7015-483f-803b-ec0035e8655f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:22:49.520081 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512f7ed-9f03-45bf-870d-60b1be94a816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:22:49.520798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512f7ed-9f03-45bf-870d-60b1be94a816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:22:49.521130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512f7ed-9f03-45bf-870d-60b1be94a816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:22:49.521451 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512f7ed-9f03-45bf-870d-60b1be94a816 admin admin] PATH_INFO: `/v3/projects/7b0b9e8375aa48879c076ee0f3f32bde` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:22:49.523446 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512f7ed-9f03-45bf-870d-60b1be94a816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0b9e8375aa48879c076ee0f3f32bde)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:22:49.525711 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512f7ed-9f03-45bf-870d-60b1be94a816 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:22:49.578645 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:49.582549 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1512f7ed-9f03-45bf-870d-60b1be94a816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0b9e8375aa48879c076ee0f3f32bde', 'request_id': 'req-1512f7ed-9f03-45bf-870d-60b1be94a816'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:49.589335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1512f7ed-9f03-45bf-870d-60b1be94a816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0b9e8375aa48879c076ee0f3f32bde', 'request_id': 'req-1512f7ed-9f03-45bf-870d-60b1be94a816'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:49.598030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1512f7ed-9f03-45bf-870d-60b1be94a816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0b9e8375aa48879c076ee0f3f32bde', 'request_id': 'req-1512f7ed-9f03-45bf-870d-60b1be94a816'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:49.614924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1512f7ed-9f03-45bf-870d-60b1be94a816 admin admin] The token cache is being invalidate because project 7b0b9e8375aa48879c076ee0f3f32bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:22:49.615592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1512f7ed-9f03-45bf-870d-60b1be94a816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:49.616478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-1512f7ed-9f03-45bf-870d-60b1be94a816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:22:49.618205 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1215/2391] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:22:49 2022] DELETE /identity/v3/projects/7b0b9e8375aa48879c076ee0f3f32bde => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:22:59.192660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=57,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:22:59.608075 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:10.093300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274721d8-a50a-4ec0-82a3-655b9640b796 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:10.094031 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274721d8-a50a-4ec0-82a3-655b9640b796 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:10.094031 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274721d8-a50a-4ec0-82a3-655b9640b796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:10.115481 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-274721d8-a50a-4ec0-82a3-655b9640b796 None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:10.117207 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-274721d8-a50a-4ec0-82a3-655b9640b796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:10.177564 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1177/2392] 10.222.0.15 () {58 vars in 967 bytes} [Tue Aug 9 11:23:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:23:10.193686 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512f7ed-9f03-45bf-870d-60b1be94a816 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:10.195771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1512f7ed-9f03-45bf-870d-60b1be94a816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:10.280733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512f7ed-9f03-45bf-870d-60b1be94a816 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:10.286478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc72809-02ff-47c2-90d7-df924a12f38a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:10.287074 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc72809-02ff-47c2-90d7-df924a12f38a service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:10.287356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc72809-02ff-47c2-90d7-df924a12f38a service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:10.287627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc72809-02ff-47c2-90d7-df924a12f38a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:10.296383 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc72809-02ff-47c2-90d7-df924a12f38a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:10.298243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc72809-02ff-47c2-90d7-df924a12f38a service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:10.313717 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1216/2393] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:23:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:23:20.170244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=25 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:20.306624 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=32 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:25.665530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274721d8-a50a-4ec0-82a3-655b9640b796 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:25.667097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-274721d8-a50a-4ec0-82a3-655b9640b796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:25.735463 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274721d8-a50a-4ec0-82a3-655b9640b796 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:25.740411 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14695f10-e075-4b05-8236-9ba41d5d3ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:25.741088 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14695f10-e075-4b05-8236-9ba41d5d3ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:25.741417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14695f10-e075-4b05-8236-9ba41d5d3ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:25.741828 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14695f10-e075-4b05-8236-9ba41d5d3ead admin admin] PATH_INFO: `/v3/users/badd43a25b614721a05cd1a3697ee0cf` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:25.743082 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14695f10-e075-4b05-8236-9ba41d5d3ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=badd43a25b614721a05cd1a3697ee0cf)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:25.745078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14695f10-e075-4b05-8236-9ba41d5d3ead admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:25.791505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-14695f10-e075-4b05-8236-9ba41d5d3ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'badd43a25b614721a05cd1a3697ee0cf'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:25.799216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-14695f10-e075-4b05-8236-9ba41d5d3ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'badd43a25b614721a05cd1a3697ee0cf'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:25.800008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-14695f10-e075-4b05-8236-9ba41d5d3ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'badd43a25b614721a05cd1a3697ee0cf'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:25.807067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-14695f10-e075-4b05-8236-9ba41d5d3ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'badd43a25b614721a05cd1a3697ee0cf'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:25.818345 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-14695f10-e075-4b05-8236-9ba41d5d3ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'badd43a25b614721a05cd1a3697ee0cf'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:25.824245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1178/2394] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:23:25 2022] DELETE /identity/v3/users/badd43a25b614721a05cd1a3697ee0cf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:23:26.001232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc72809-02ff-47c2-90d7-df924a12f38a service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:26.012640 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc72809-02ff-47c2-90d7-df924a12f38a service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:26.070997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505fda0-f967-4dfa-b464-742dcf689a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:26.071658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505fda0-f967-4dfa-b464-742dcf689a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:26.071928 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505fda0-f967-4dfa-b464-742dcf689a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:26.072190 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505fda0-f967-4dfa-b464-742dcf689a1e admin admin] PATH_INFO: `/v3/projects/f09cb08b06b24f5084b9b8667ee12876` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:26.074015 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505fda0-f967-4dfa-b464-742dcf689a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09cb08b06b24f5084b9b8667ee12876)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:26.075921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505fda0-f967-4dfa-b464-742dcf689a1e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:26.125107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c505fda0-f967-4dfa-b464-742dcf689a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09cb08b06b24f5084b9b8667ee12876', 'request_id': 'req-c505fda0-f967-4dfa-b464-742dcf689a1e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:26.131336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c505fda0-f967-4dfa-b464-742dcf689a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09cb08b06b24f5084b9b8667ee12876', 'request_id': 'req-c505fda0-f967-4dfa-b464-742dcf689a1e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:26.140417 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c505fda0-f967-4dfa-b464-742dcf689a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09cb08b06b24f5084b9b8667ee12876', 'request_id': 'req-c505fda0-f967-4dfa-b464-742dcf689a1e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:26.151575 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c505fda0-f967-4dfa-b464-742dcf689a1e admin admin] The token cache is being invalidate because project f09cb08b06b24f5084b9b8667ee12876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:23:26.151860 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c505fda0-f967-4dfa-b464-742dcf689a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:26.152488 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-c505fda0-f967-4dfa-b464-742dcf689a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:26.154037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1217/2395] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:23:26 2022] DELETE /identity/v3/projects/f09cb08b06b24f5084b9b8667ee12876 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:23:26.159113 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a8a81-20c8-4351-bf66-6fb943495b1e None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:26.159397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a8a81-20c8-4351-bf66-6fb943495b1e None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:26.159697 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a8a81-20c8-4351-bf66-6fb943495b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:26.180892 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-ad2a8a81-20c8-4351-bf66-6fb943495b1e None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:26.182522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ad2a8a81-20c8-4351-bf66-6fb943495b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:26.254611 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1179/2396] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:23:26.262736 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada50c41-7d20-4aeb-b252-93986db3e684 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:26.263053 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada50c41-7d20-4aeb-b252-93986db3e684 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:26.263355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada50c41-7d20-4aeb-b252-93986db3e684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:26.285665 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ada50c41-7d20-4aeb-b252-93986db3e684 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:26.286939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ada50c41-7d20-4aeb-b252-93986db3e684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:26.295897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1218/2397] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:23:26.300652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a8a81-20c8-4351-bf66-6fb943495b1e None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:26.311656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a8a81-20c8-4351-bf66-6fb943495b1e None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:26.317328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780f0a3-f5cf-4849-891e-eac88217004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:26.317964 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780f0a3-f5cf-4849-891e-eac88217004e admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:26.318236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780f0a3-f5cf-4849-891e-eac88217004e admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:26.318500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780f0a3-f5cf-4849-891e-eac88217004e admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:26.319173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780f0a3-f5cf-4849-891e-eac88217004e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:23:26.319473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780f0a3-f5cf-4849-891e-eac88217004e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:26.321104 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780f0a3-f5cf-4849-891e-eac88217004e admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:26.332842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1180/2398] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:23:26.337563 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada50c41-7d20-4aeb-b252-93986db3e684 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:26.347328 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada50c41-7d20-4aeb-b252-93986db3e684 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:26.352291 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b730e-0b42-4eba-9ebe-0198c0c9a733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:26.352893 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b730e-0b42-4eba-9ebe-0198c0c9a733 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:26.353165 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b730e-0b42-4eba-9ebe-0198c0c9a733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:26.353431 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b730e-0b42-4eba-9ebe-0198c0c9a733 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:26.354082 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b730e-0b42-4eba-9ebe-0198c0c9a733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:26.355985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b730e-0b42-4eba-9ebe-0198c0c9a733 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:26.385677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1219/2399] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:23:26 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:23:26.390186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780f0a3-f5cf-4849-891e-eac88217004e admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:26.400837 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780f0a3-f5cf-4849-891e-eac88217004e admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:26.405069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:26.462826 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d5175-3901-4951-83ce-533cfb8ba4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:26.463339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d5175-3901-4951-83ce-533cfb8ba4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:26.463607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d5175-3901-4951-83ce-533cfb8ba4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:26.463886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d5175-3901-4951-83ce-533cfb8ba4c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:26.464476 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d5175-3901-4951-83ce-533cfb8ba4c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:26.466441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d5175-3901-4951-83ce-533cfb8ba4c5 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:26.490254 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1181/2400] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:23:26 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:23:26.494613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b730e-0b42-4eba-9ebe-0198c0c9a733 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:26.505767 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b730e-0b42-4eba-9ebe-0198c0c9a733 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:26.510700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f9246-f569-4d5a-bb8a-f1c412e4413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:26.511299 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f9246-f569-4d5a-bb8a-f1c412e4413d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:26.511570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f9246-f569-4d5a-bb8a-f1c412e4413d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:26.511832 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f9246-f569-4d5a-bb8a-f1c412e4413d admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:26.512469 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f9246-f569-4d5a-bb8a-f1c412e4413d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:26.514123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f9246-f569-4d5a-bb8a-f1c412e4413d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:26.524336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1220/2401] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:23:26.528603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d5175-3901-4951-83ce-533cfb8ba4c5 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:26.539028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d5175-3901-4951-83ce-533cfb8ba4c5 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:26.544309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b5b2b-b021-46de-b9b1-9d7215650a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:26.544889 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b5b2b-b021-46de-b9b1-9d7215650a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:26.545127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b5b2b-b021-46de-b9b1-9d7215650a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:26.545452 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b5b2b-b021-46de-b9b1-9d7215650a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:26.546112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b5b2b-b021-46de-b9b1-9d7215650a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:26.547711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b5b2b-b021-46de-b9b1-9d7215650a8a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:26.558438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1182/2402] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:23:26.562698 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f9246-f569-4d5a-bb8a-f1c412e4413d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:26.573048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f9246-f569-4d5a-bb8a-f1c412e4413d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:26.577758 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f353b8b-0f15-417b-b94f-10260b5ebe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:26.578405 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f353b8b-0f15-417b-b94f-10260b5ebe03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:26.578695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f353b8b-0f15-417b-b94f-10260b5ebe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:26.578971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f353b8b-0f15-417b-b94f-10260b5ebe03 admin admin] PATH_INFO: `/v3/projects/b5a9df4c201842279f868c7520e4db2c/users/105e552d981f4d2fb44664e832c1e178/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:26.593873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f353b8b-0f15-417b-b94f-10260b5ebe03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a9df4c201842279f868c7520e4db2c, user_id=105e552d981f4d2fb44664e832c1e178, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:26.596477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f353b8b-0f15-417b-b94f-10260b5ebe03 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:26.611626 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1221/2403] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:23:26 2022] PUT /identity/v3/projects/b5a9df4c201842279f868c7520e4db2c/users/105e552d981f4d2fb44664e832c1e178/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:23:26.683084 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6048f8b-3998-4f08-b2d1-a2bb3066693a None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:26.684013 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6048f8b-3998-4f08-b2d1-a2bb3066693a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:26.684013 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6048f8b-3998-4f08-b2d1-a2bb3066693a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:26.716789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-e6048f8b-3998-4f08-b2d1-a2bb3066693a None None] MFA Rules not processed for user `105e552d981f4d2fb44664e832c1e178`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:26.717962 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e6048f8b-3998-4f08-b2d1-a2bb3066693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:26.801316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1183/2404] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:23:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:23:26.813300 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f353b8b-0f15-417b-b94f-10260b5ebe03 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:26.815372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8f353b8b-0f15-417b-b94f-10260b5ebe03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:26.848398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:26.876844 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f353b8b-0f15-417b-b94f-10260b5ebe03 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:26.880918 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c2a60-367b-4826-ab1b-e4c384320776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:26.881533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c2a60-367b-4826-ab1b-e4c384320776 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:26.881838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c2a60-367b-4826-ab1b-e4c384320776 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:26.882103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c2a60-367b-4826-ab1b-e4c384320776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:26.890685 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c2a60-367b-4826-ab1b-e4c384320776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:26.892101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c2a60-367b-4826-ab1b-e4c384320776 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:26.902199 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1222/2405] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:23:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:23:31.959485 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6048f8b-3998-4f08-b2d1-a2bb3066693a None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:32.029174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6048f8b-3998-4f08-b2d1-a2bb3066693a None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:32.034919 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9da00-c362-4c37-8eef-26b5a57ebf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:32.035543 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9da00-c362-4c37-8eef-26b5a57ebf4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:32.035810 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9da00-c362-4c37-8eef-26b5a57ebf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:32.036069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9da00-c362-4c37-8eef-26b5a57ebf4f admin admin] PATH_INFO: `/v3/users/105e552d981f4d2fb44664e832c1e178` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:32.037398 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9da00-c362-4c37-8eef-26b5a57ebf4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=105e552d981f4d2fb44664e832c1e178)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:32.039385 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9da00-c362-4c37-8eef-26b5a57ebf4f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:32.059521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:32.100453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a7a9da00-c362-4c37-8eef-26b5a57ebf4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105e552d981f4d2fb44664e832c1e178'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:32.110283 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a7a9da00-c362-4c37-8eef-26b5a57ebf4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105e552d981f4d2fb44664e832c1e178'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:32.111142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a7a9da00-c362-4c37-8eef-26b5a57ebf4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105e552d981f4d2fb44664e832c1e178'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:32.120201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a7a9da00-c362-4c37-8eef-26b5a57ebf4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105e552d981f4d2fb44664e832c1e178'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:32.133936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a7a9da00-c362-4c37-8eef-26b5a57ebf4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105e552d981f4d2fb44664e832c1e178'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:32.140095 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1184/2406] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:23:31 2022] DELETE /identity/v3/users/105e552d981f4d2fb44664e832c1e178 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:23:32.144780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0003422-15c4-4bc4-934d-433ac12cd5b6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:32.145273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0003422-15c4-4bc4-934d-433ac12cd5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:32.145370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0003422-15c4-4bc4-934d-433ac12cd5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:32.165417 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c0003422-15c4-4bc4-934d-433ac12cd5b6 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:32.166654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c0003422-15c4-4bc4-934d-433ac12cd5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:32.226972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1223/2407] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:23:32.236962 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9da00-c362-4c37-8eef-26b5a57ebf4f admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:32.238945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a7a9da00-c362-4c37-8eef-26b5a57ebf4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:32.298407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9da00-c362-4c37-8eef-26b5a57ebf4f admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:32.302427 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e2702-a77a-4479-a290-bc5e3035c89e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:32.303035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e2702-a77a-4479-a290-bc5e3035c89e service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:32.303310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e2702-a77a-4479-a290-bc5e3035c89e service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:32.303603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e2702-a77a-4479-a290-bc5e3035c89e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:32.313152 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e2702-a77a-4479-a290-bc5e3035c89e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:32.314730 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e2702-a77a-4479-a290-bc5e3035c89e service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:32.324399 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1185/2408] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:23:32.602813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0003422-15c4-4bc4-934d-433ac12cd5b6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:32.605351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c0003422-15c4-4bc4-934d-433ac12cd5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:32.618909 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0003422-15c4-4bc4-934d-433ac12cd5b6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:32.624430 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24437d-f82e-4127-bf7e-ed2766ed90b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:32.625079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24437d-f82e-4127-bf7e-ed2766ed90b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:32.625352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24437d-f82e-4127-bf7e-ed2766ed90b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:32.625716 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24437d-f82e-4127-bf7e-ed2766ed90b1 admin admin] PATH_INFO: `/v3/projects/b5a9df4c201842279f868c7520e4db2c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:32.626812 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24437d-f82e-4127-bf7e-ed2766ed90b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a9df4c201842279f868c7520e4db2c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:32.628813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24437d-f82e-4127-bf7e-ed2766ed90b1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:32.677843 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf24437d-f82e-4127-bf7e-ed2766ed90b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a9df4c201842279f868c7520e4db2c', 'request_id': 'req-bf24437d-f82e-4127-bf7e-ed2766ed90b1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:32.683452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf24437d-f82e-4127-bf7e-ed2766ed90b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a9df4c201842279f868c7520e4db2c', 'request_id': 'req-bf24437d-f82e-4127-bf7e-ed2766ed90b1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:32.691977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf24437d-f82e-4127-bf7e-ed2766ed90b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a9df4c201842279f868c7520e4db2c', 'request_id': 'req-bf24437d-f82e-4127-bf7e-ed2766ed90b1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:32.703568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf24437d-f82e-4127-bf7e-ed2766ed90b1 admin admin] The token cache is being invalidate because project b5a9df4c201842279f868c7520e4db2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:23:32.703922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf24437d-f82e-4127-bf7e-ed2766ed90b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:32.704592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bf24437d-f82e-4127-bf7e-ed2766ed90b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:23:32.706129 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1224/2409] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:23:32 2022] DELETE /identity/v3/projects/b5a9df4c201842279f868c7520e4db2c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:23:32.711271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dc593-771c-4712-be62-297f289383ab None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:32.711548 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dc593-771c-4712-be62-297f289383ab None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:32.711810 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dc593-771c-4712-be62-297f289383ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:32.735271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-2a4dc593-771c-4712-be62-297f289383ab None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:32.736522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2a4dc593-771c-4712-be62-297f289383ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:32.798764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1186/2410] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:23:32.806841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8947fc-4460-4491-8b4d-36a537bedceb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:32.807151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8947fc-4460-4491-8b4d-36a537bedceb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:32.807419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8947fc-4460-4491-8b4d-36a537bedceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:32.827501 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-de8947fc-4460-4491-8b4d-36a537bedceb None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:32.828737 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-de8947fc-4460-4491-8b4d-36a537bedceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:32.837137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1225/2411] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:23:32.841706 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dc593-771c-4712-be62-297f289383ab None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:32.853130 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dc593-771c-4712-be62-297f289383ab None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:32.858075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a7175-981d-43ec-8ae5-ffb04b981bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:32.858698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a7175-981d-43ec-8ae5-ffb04b981bca admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:32.858944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a7175-981d-43ec-8ae5-ffb04b981bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:32.859206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a7175-981d-43ec-8ae5-ffb04b981bca admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:32.859844 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a7175-981d-43ec-8ae5-ffb04b981bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:23:32.860108 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a7175-981d-43ec-8ae5-ffb04b981bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:32.861758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a7175-981d-43ec-8ae5-ffb04b981bca admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:32.874576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1187/2412] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:23:32.878970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8947fc-4460-4491-8b4d-36a537bedceb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:32.888806 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8947fc-4460-4491-8b4d-36a537bedceb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:32.894403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd23f5-2f1d-43ac-83c8-04b42c290fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:32.895012 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd23f5-2f1d-43ac-83c8-04b42c290fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:32.895294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd23f5-2f1d-43ac-83c8-04b42c290fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:32.895554 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd23f5-2f1d-43ac-83c8-04b42c290fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:32.896185 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd23f5-2f1d-43ac-83c8-04b42c290fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:32.898118 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd23f5-2f1d-43ac-83c8-04b42c290fc6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:32.924490 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8b8c4-ced3-459f-b7be-e8ed733a3bbe None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:32.924856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8b8c4-ced3-459f-b7be-e8ed733a3bbe None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:32.925190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8b8c4-ced3-459f-b7be-e8ed733a3bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:32.930585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1226/2413] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:23:32 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:23:32.934807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd23f5-2f1d-43ac-83c8-04b42c290fc6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:32.946218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-76c8b8c4-ced3-459f-b7be-e8ed733a3bbe None None] MFA Rules not processed for user `994164cde9f14b8ca5714b5e028f33c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:32.947545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-76c8b8c4-ced3-459f-b7be-e8ed733a3bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:32.966026 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:32.969192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:33.006971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd23f5-2f1d-43ac-83c8-04b42c290fc6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:33.011901 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d7314-5b2f-4614-8f61-2dcd4d58a889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:33.012545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d7314-5b2f-4614-8f61-2dcd4d58a889 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:33.012931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1188/2414] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:23:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:23:33.013058 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d7314-5b2f-4614-8f61-2dcd4d58a889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:33.013058 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d7314-5b2f-4614-8f61-2dcd4d58a889 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:33.013713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d7314-5b2f-4614-8f61-2dcd4d58a889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:33.015673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d7314-5b2f-4614-8f61-2dcd4d58a889 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:33.047307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1227/2415] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:23:32 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:23:33.048604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8b8c4-ced3-459f-b7be-e8ed733a3bbe None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:33.059565 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8b8c4-ced3-459f-b7be-e8ed733a3bbe None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:33.064699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75e2b7-cf59-4024-90ee-a568a103d3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:33.065313 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75e2b7-cf59-4024-90ee-a568a103d3ee admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:33.065580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75e2b7-cf59-4024-90ee-a568a103d3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:33.065888 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75e2b7-cf59-4024-90ee-a568a103d3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:33.066517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75e2b7-cf59-4024-90ee-a568a103d3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:33.068383 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75e2b7-cf59-4024-90ee-a568a103d3ee admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:33.080106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1189/2416] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:23:33.084308 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d7314-5b2f-4614-8f61-2dcd4d58a889 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:33.094920 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d7314-5b2f-4614-8f61-2dcd4d58a889 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:33.100327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930821a5-bbe4-4ec6-97a5-d84401c0a0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:33.100937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930821a5-bbe4-4ec6-97a5-d84401c0a0bc admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:33.101209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930821a5-bbe4-4ec6-97a5-d84401c0a0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:33.101470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930821a5-bbe4-4ec6-97a5-d84401c0a0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:33.102183 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930821a5-bbe4-4ec6-97a5-d84401c0a0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:33.103820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930821a5-bbe4-4ec6-97a5-d84401c0a0bc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:33.115202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1228/2417] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:23:33.119436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75e2b7-cf59-4024-90ee-a568a103d3ee admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:33.129941 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75e2b7-cf59-4024-90ee-a568a103d3ee admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:33.135994 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adaf57a-29f1-4c81-9bd1-d40c47a291f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:33.136392 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adaf57a-29f1-4c81-9bd1-d40c47a291f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:33.136666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adaf57a-29f1-4c81-9bd1-d40c47a291f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:33.136937 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adaf57a-29f1-4c81-9bd1-d40c47a291f5 admin admin] PATH_INFO: `/v3/projects/e655d78df7754c8db6aaff2948c34ddf/users/354eaf39c1d84c90aa2253f199607938/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:33.153259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adaf57a-29f1-4c81-9bd1-d40c47a291f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e655d78df7754c8db6aaff2948c34ddf, user_id=354eaf39c1d84c90aa2253f199607938, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:33.156106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adaf57a-29f1-4c81-9bd1-d40c47a291f5 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:33.173825 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1190/2418] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:23:33 2022] PUT /identity/v3/projects/e655d78df7754c8db6aaff2948c34ddf/users/354eaf39c1d84c90aa2253f199607938/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:23:33.179091 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4274b3-4d56-4fbd-a53b-154b01aab4db None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:33.179610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4274b3-4d56-4fbd-a53b-154b01aab4db None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:33.179713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4274b3-4d56-4fbd-a53b-154b01aab4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:33.199179 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9d4274b3-4d56-4fbd-a53b-154b01aab4db None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:33.200397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9d4274b3-4d56-4fbd-a53b-154b01aab4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:33.271842 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1229/2419] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:23:33.281918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adaf57a-29f1-4c81-9bd1-d40c47a291f5 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:33.283853 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8adaf57a-29f1-4c81-9bd1-d40c47a291f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:33.347273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adaf57a-29f1-4c81-9bd1-d40c47a291f5 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:33.351780 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acdb8c-ee05-4925-a896-2743d6caa8c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:33.352413 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acdb8c-ee05-4925-a896-2743d6caa8c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:33.352684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acdb8c-ee05-4925-a896-2743d6caa8c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:33.352948 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acdb8c-ee05-4925-a896-2743d6caa8c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:33.364039 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acdb8c-ee05-4925-a896-2743d6caa8c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:33.365417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acdb8c-ee05-4925-a896-2743d6caa8c4 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:33.375096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1191/2420] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:23:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:23:37.756651 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5efa67-512c-4bb6-9475-d25e9a247241 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:37.757276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5efa67-512c-4bb6-9475-d25e9a247241 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:37.757276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5efa67-512c-4bb6-9475-d25e9a247241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:37.796310 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fa5efa67-512c-4bb6-9475-d25e9a247241 None None] MFA Rules not processed for user `354eaf39c1d84c90aa2253f199607938`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:37.797745 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fa5efa67-512c-4bb6-9475-d25e9a247241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:37.866331 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1230/2421] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:23:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:23:37.870865 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acdb8c-ee05-4925-a896-2743d6caa8c4 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:37.881172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acdb8c-ee05-4925-a896-2743d6caa8c4 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:37.886060 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4720398-6072-4ba1-a863-b111ce7409ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:37.886806 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4720398-6072-4ba1-a863-b111ce7409ea admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:37.887074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4720398-6072-4ba1-a863-b111ce7409ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:37.887428 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4720398-6072-4ba1-a863-b111ce7409ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:37.888088 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4720398-6072-4ba1-a863-b111ce7409ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:37.890039 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4720398-6072-4ba1-a863-b111ce7409ea admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:37.921023 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1192/2422] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:23:37 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:23:37.925099 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5efa67-512c-4bb6-9475-d25e9a247241 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:37.936453 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5efa67-512c-4bb6-9475-d25e9a247241 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:37.971832 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:38.005598 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47716e09-76f7-400a-b9f6-4ceece887452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:38.006253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47716e09-76f7-400a-b9f6-4ceece887452 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:38.006529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47716e09-76f7-400a-b9f6-4ceece887452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:38.006805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47716e09-76f7-400a-b9f6-4ceece887452 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:38.007455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47716e09-76f7-400a-b9f6-4ceece887452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:38.009416 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47716e09-76f7-400a-b9f6-4ceece887452 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:38.033348 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1231/2423] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:23:37 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:23:38.037959 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4720398-6072-4ba1-a863-b111ce7409ea admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:38.049144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4720398-6072-4ba1-a863-b111ce7409ea admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:38.053915 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397adacd-e17b-404e-89c9-d6bd5ef1cee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:38.054530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397adacd-e17b-404e-89c9-d6bd5ef1cee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:38.054799 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397adacd-e17b-404e-89c9-d6bd5ef1cee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:38.055061 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397adacd-e17b-404e-89c9-d6bd5ef1cee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:38.055705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397adacd-e17b-404e-89c9-d6bd5ef1cee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:38.057325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397adacd-e17b-404e-89c9-d6bd5ef1cee8 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:38.068731 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1193/2424] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:23:38.073198 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47716e09-76f7-400a-b9f6-4ceece887452 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:38.083986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47716e09-76f7-400a-b9f6-4ceece887452 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:38.088810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1ced9-0bc9-452b-84ce-6e3290b215c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:38.089566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1ced9-0bc9-452b-84ce-6e3290b215c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:38.089872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1ced9-0bc9-452b-84ce-6e3290b215c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:38.090140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1ced9-0bc9-452b-84ce-6e3290b215c6 admin admin] PATH_INFO: `/v3/projects/85990ae25f9a4e4181f85f3d26094858/users/bbacc1703219415c9af3e9d9da33c6e4/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:38.107052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1ced9-0bc9-452b-84ce-6e3290b215c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85990ae25f9a4e4181f85f3d26094858, user_id=bbacc1703219415c9af3e9d9da33c6e4, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:38.109637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1ced9-0bc9-452b-84ce-6e3290b215c6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:38.126880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1232/2425] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:23:38 2022] PUT /identity/v3/projects/85990ae25f9a4e4181f85f3d26094858/users/bbacc1703219415c9af3e9d9da33c6e4/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:23:38.130933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397adacd-e17b-404e-89c9-d6bd5ef1cee8 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:38.141433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397adacd-e17b-404e-89c9-d6bd5ef1cee8 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:38.201424 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dba5a-9e99-4ac7-9d56-87bc9b529953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:38.202064 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dba5a-9e99-4ac7-9d56-87bc9b529953 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:38.202331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dba5a-9e99-4ac7-9d56-87bc9b529953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:38.202592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dba5a-9e99-4ac7-9d56-87bc9b529953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:38.203240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dba5a-9e99-4ac7-9d56-87bc9b529953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:38.204842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dba5a-9e99-4ac7-9d56-87bc9b529953 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:38.210573 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:38.216041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1194/2426] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:23:38.220256 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1ced9-0bc9-452b-84ce-6e3290b215c6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:38.235472 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1ced9-0bc9-452b-84ce-6e3290b215c6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:38.241274 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526c46d-6ced-4a93-863d-63483da98aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:38.242057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526c46d-6ced-4a93-863d-63483da98aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:38.242437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526c46d-6ced-4a93-863d-63483da98aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:38.242778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526c46d-6ced-4a93-863d-63483da98aeb admin admin] PATH_INFO: `/v3/projects/85990ae25f9a4e4181f85f3d26094858/users/bbacc1703219415c9af3e9d9da33c6e4/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:38.244728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526c46d-6ced-4a93-863d-63483da98aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=85990ae25f9a4e4181f85f3d26094858, user_id=bbacc1703219415c9af3e9d9da33c6e4, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:38.247609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526c46d-6ced-4a93-863d-63483da98aeb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:38.259352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1233/2427] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:23:38 2022] PUT /identity/v3/projects/85990ae25f9a4e4181f85f3d26094858/users/bbacc1703219415c9af3e9d9da33c6e4/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:23:43.798632 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5514-4af5-472c-a783-2fe298483edd None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:43.799139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5514-4af5-472c-a783-2fe298483edd None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:43.799377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5514-4af5-472c-a783-2fe298483edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:43.828451 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-ed5b5514-4af5-472c-a783-2fe298483edd None None] MFA Rules not processed for user `bbacc1703219415c9af3e9d9da33c6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:43.829722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ed5b5514-4af5-472c-a783-2fe298483edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:43.901681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1195/2428] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:23:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:23:43.913645 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526c46d-6ced-4a93-863d-63483da98aeb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:43.915414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-3526c46d-6ced-4a93-863d-63483da98aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:43.982849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526c46d-6ced-4a93-863d-63483da98aeb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:43.986708 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b053b19-76f4-42b2-b4e3-083bdb193b08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5356835ef79c458bbfa7d6adafd0cb36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:43.987701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b053b19-76f4-42b2-b4e3-083bdb193b08 service glance] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:43.987992 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b053b19-76f4-42b2-b4e3-083bdb193b08 service glance] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:43.988312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b053b19-76f4-42b2-b4e3-083bdb193b08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:44.051343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b053b19-76f4-42b2-b4e3-083bdb193b08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:44.052824 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b053b19-76f4-42b2-b4e3-083bdb193b08 service glance] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:44.064228 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1234/2429] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:23:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:23:44.192715 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fa43f-6ceb-40a6-ad79-18ff81f58530 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:44.193002 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fa43f-6ceb-40a6-ad79-18ff81f58530 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:44.193286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fa43f-6ceb-40a6-ad79-18ff81f58530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:44.212598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-cb2fa43f-6ceb-40a6-ad79-18ff81f58530 None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:44.213853 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-cb2fa43f-6ceb-40a6-ad79-18ff81f58530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:44.272927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1196/2430] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Aug 9 11:23:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:23:44.295599 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b053b19-76f4-42b2-b4e3-083bdb193b08 service glance] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:44.297117 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6b053b19-76f4-42b2-b4e3-083bdb193b08 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:44.342662 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:44.372530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b053b19-76f4-42b2-b4e3-083bdb193b08 service glance] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:44.377902 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515aa669-2747-48c1-828b-498f2662ddc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:44.378541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aa669-2747-48c1-828b-498f2662ddc6 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:44.378818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aa669-2747-48c1-828b-498f2662ddc6 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:44.379086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515aa669-2747-48c1-828b-498f2662ddc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:44.388225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aa669-2747-48c1-828b-498f2662ddc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:44.389962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515aa669-2747-48c1-828b-498f2662ddc6 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:44.399166 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1235/2431] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:23:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:23:52.705311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd741847-ef65-4db6-a1a5-83b42fdb8425 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:52.705919 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd741847-ef65-4db6-a1a5-83b42fdb8425 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:52.705919 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd741847-ef65-4db6-a1a5-83b42fdb8425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:52.726829 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-fd741847-ef65-4db6-a1a5-83b42fdb8425 None None] MFA Rules not processed for user `354eaf39c1d84c90aa2253f199607938`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:52.728044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fd741847-ef65-4db6-a1a5-83b42fdb8425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:52.735081 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1197/2432] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:23:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:23:54.395583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=14 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:23:55.166065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b217971-1f97-4b71-b4a7-bfe4dc0ad877 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:55.166577 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b217971-1f97-4b71-b4a7-bfe4dc0ad877 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:55.166990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b217971-1f97-4b71-b4a7-bfe4dc0ad877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:55.187828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-5b217971-1f97-4b71-b4a7-bfe4dc0ad877 None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:23:55.189258 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-5b217971-1f97-4b71-b4a7-bfe4dc0ad877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:55.197543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1236/2433] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Aug 9 11:23:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:23:55.210196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd741847-ef65-4db6-a1a5-83b42fdb8425 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:55.224297 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd741847-ef65-4db6-a1a5-83b42fdb8425 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:55.230395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d0a6-845d-4e86-a153-cf79569ece61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:55.231247 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d0a6-845d-4e86-a153-cf79569ece61 service swift] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:55.231660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d0a6-845d-4e86-a153-cf79569ece61 service swift] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:55.232066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d0a6-845d-4e86-a153-cf79569ece61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:55.242086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07d0a6-845d-4e86-a153-cf79569ece61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:55.244002 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07d0a6-845d-4e86-a153-cf79569ece61 service swift] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:55.257792 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1198/2434] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:23:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:23:58.605562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b217971-1f97-4b71-b4a7-bfe4dc0ad877 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:23:58.676568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b217971-1f97-4b71-b4a7-bfe4dc0ad877 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:23:58.680409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce5d5e-356e-431e-85e4-65a276123d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:23:58.681056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce5d5e-356e-431e-85e4-65a276123d29 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:23:58.681327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce5d5e-356e-431e-85e4-65a276123d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:23:58.681610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce5d5e-356e-431e-85e4-65a276123d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:23:58.683622 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-03ce5d5e-356e-431e-85e4-65a276123d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:23:58.758524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce5d5e-356e-431e-85e4-65a276123d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:23:58.759903 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce5d5e-356e-431e-85e4-65a276123d29 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:23:58.771360 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1237/2435] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:23:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:24:05.250750 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=68 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:08.766441 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=57 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:10.628315 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d0a6-845d-4e86-a153-cf79569ece61 service swift] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:10.630200 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ce07d0a6-845d-4e86-a153-cf79569ece61 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:10.643305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d0a6-845d-4e86-a153-cf79569ece61 service swift] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:10.649408 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07282977-317d-4bef-95ff-b2b7b690a929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:10.650511 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07282977-317d-4bef-95ff-b2b7b690a929 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:10.650877 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07282977-317d-4bef-95ff-b2b7b690a929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:10.651271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07282977-317d-4bef-95ff-b2b7b690a929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:10.653413 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-07282977-317d-4bef-95ff-b2b7b690a929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:10.667596 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07282977-317d-4bef-95ff-b2b7b690a929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:10.669111 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07282977-317d-4bef-95ff-b2b7b690a929 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:10.680097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1199/2436] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:24:15.165409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce5d5e-356e-431e-85e4-65a276123d29 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:15.167106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-03ce5d5e-356e-431e-85e4-65a276123d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:15.181532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce5d5e-356e-431e-85e4-65a276123d29 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:15.188774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a051952-7424-42bf-84c1-e59ad4299a51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:15.189407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a051952-7424-42bf-84c1-e59ad4299a51 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:15.189709 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a051952-7424-42bf-84c1-e59ad4299a51 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:15.189977 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a051952-7424-42bf-84c1-e59ad4299a51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:15.192173 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8a051952-7424-42bf-84c1-e59ad4299a51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:15.255641 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a051952-7424-42bf-84c1-e59ad4299a51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:15.257260 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a051952-7424-42bf-84c1-e59ad4299a51 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:15.268267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1238/2437] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:24:19.203153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07282977-317d-4bef-95ff-b2b7b690a929 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:19.216127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07282977-317d-4bef-95ff-b2b7b690a929 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:19.222083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb3c5-86be-4473-b63d-9412af78732a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:19.222799 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb3c5-86be-4473-b63d-9412af78732a service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:19.223384 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb3c5-86be-4473-b63d-9412af78732a service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:19.223741 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb3c5-86be-4473-b63d-9412af78732a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:19.225665 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6ddfb3c5-86be-4473-b63d-9412af78732a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:19.297195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfb3c5-86be-4473-b63d-9412af78732a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:19.298867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfb3c5-86be-4473-b63d-9412af78732a service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:19.309934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1200/2438] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:24:21.314612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b09625-260a-4266-a90f-0fda6b13cd0e None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:21.315213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b09625-260a-4266-a90f-0fda6b13cd0e None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:21.315213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b09625-260a-4266-a90f-0fda6b13cd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:21.334852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c8b09625-260a-4266-a90f-0fda6b13cd0e None None] MFA Rules not processed for user `d98fa7056d4247edbda7c8e406e2dcb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:24:21.336055 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c8b09625-260a-4266-a90f-0fda6b13cd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:21.343149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1239/2439] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:24:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:24:21.671028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb3c5-86be-4473-b63d-9412af78732a service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:21.680894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb3c5-86be-4473-b63d-9412af78732a service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:21.684984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb8611-20c0-448e-81a9-9c824fda6f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:21.685580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb8611-20c0-448e-81a9-9c824fda6f59 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:21.685892 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb8611-20c0-448e-81a9-9c824fda6f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:21.686155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb8611-20c0-448e-81a9-9c824fda6f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:21.688060 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-04fb8611-20c0-448e-81a9-9c824fda6f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:21.698450 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb8611-20c0-448e-81a9-9c824fda6f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:21.699927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb8611-20c0-448e-81a9-9c824fda6f59 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:21.708670 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1201/2440] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:24:22.030998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b09625-260a-4266-a90f-0fda6b13cd0e None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:22.032669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c8b09625-260a-4266-a90f-0fda6b13cd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:22.121527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b09625-260a-4266-a90f-0fda6b13cd0e None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:22.126613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd00c09-10d8-440b-bf28-c53420648a6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:22.127228 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd00c09-10d8-440b-bf28-c53420648a6a service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:22.127503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd00c09-10d8-440b-bf28-c53420648a6a service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:22.127797 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd00c09-10d8-440b-bf28-c53420648a6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:22.129573 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ecd00c09-10d8-440b-bf28-c53420648a6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:22.141463 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd00c09-10d8-440b-bf28-c53420648a6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:22.143080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd00c09-10d8-440b-bf28-c53420648a6a service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:22.153261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1240/2441] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:24:26.066224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb8611-20c0-448e-81a9-9c824fda6f59 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:26.076944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb8611-20c0-448e-81a9-9c824fda6f59 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:26.081331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe9613-22dd-480f-a687-4e573d677e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:26.082295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe9613-22dd-480f-a687-4e573d677e18 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:26.082794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe9613-22dd-480f-a687-4e573d677e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:26.083410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe9613-22dd-480f-a687-4e573d677e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:26.095432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe9613-22dd-480f-a687-4e573d677e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:26.097449 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe9613-22dd-480f-a687-4e573d677e18 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:26.109835 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1202/2442] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:24:29.734034 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274901d-7e3e-420b-ba25-bdb8e9385cae None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:29.734951 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274901d-7e3e-420b-ba25-bdb8e9385cae None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:29.735361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274901d-7e3e-420b-ba25-bdb8e9385cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:29.756222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b274901d-7e3e-420b-ba25-bdb8e9385cae None None] MFA Rules not processed for user `84405f12c84a40d79493e02276e65266`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:24:29.758011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b274901d-7e3e-420b-ba25-bdb8e9385cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:29.770368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1241/2443] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:24:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:24:31.058780 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe9613-22dd-480f-a687-4e573d677e18 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:31.068498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe9613-22dd-480f-a687-4e573d677e18 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:31.072401 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a04260-014f-496b-b23c-cda7b82f60ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:31.072999 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a04260-014f-496b-b23c-cda7b82f60ab service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:31.073253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a04260-014f-496b-b23c-cda7b82f60ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:31.073532 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a04260-014f-496b-b23c-cda7b82f60ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:31.075335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b5a04260-014f-496b-b23c-cda7b82f60ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:31.086009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a04260-014f-496b-b23c-cda7b82f60ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:31.087656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a04260-014f-496b-b23c-cda7b82f60ab service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:31.099085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1203/2444] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:24:39.749997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=66 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:40.053777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274901d-7e3e-420b-ba25-bdb8e9385cae None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:40.067153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274901d-7e3e-420b-ba25-bdb8e9385cae None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:40.073666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4489e4-7a20-4822-a060-43708ced9d54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:40.074282 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4489e4-7a20-4822-a060-43708ced9d54 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:40.074555 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4489e4-7a20-4822-a060-43708ced9d54 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:40.074814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4489e4-7a20-4822-a060-43708ced9d54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:40.076756 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2a4489e4-7a20-4822-a060-43708ced9d54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:40.098850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4489e4-7a20-4822-a060-43708ced9d54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:40.101531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4489e4-7a20-4822-a060-43708ced9d54 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:40.118001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1242/2445] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:24:40.427745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a04260-014f-496b-b23c-cda7b82f60ab service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:40.429198 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b5a04260-014f-496b-b23c-cda7b82f60ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:40.434361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=53 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:40.495164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a04260-014f-496b-b23c-cda7b82f60ab service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:40.499092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b70d5-fb58-4afe-90a8-0dbc733ceb21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:40.499745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b70d5-fb58-4afe-90a8-0dbc733ceb21 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:40.500013 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b70d5-fb58-4afe-90a8-0dbc733ceb21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:40.500279 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b70d5-fb58-4afe-90a8-0dbc733ceb21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:40.502129 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2d2b70d5-fb58-4afe-90a8-0dbc733ceb21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:40.561537 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b70d5-fb58-4afe-90a8-0dbc733ceb21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:40.563020 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b70d5-fb58-4afe-90a8-0dbc733ceb21 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:40.573303 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1204/2446] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:24:48.070373 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4489e4-7a20-4822-a060-43708ced9d54 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:24:48.083490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4489e4-7a20-4822-a060-43708ced9d54 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:24:48.106884 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941f786-6a15-48d3-833b-37277fb526c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:24:48.107737 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941f786-6a15-48d3-833b-37277fb526c7 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:24:48.108175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941f786-6a15-48d3-833b-37277fb526c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:24:48.108544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941f786-6a15-48d3-833b-37277fb526c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:24:48.111194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a941f786-6a15-48d3-833b-37277fb526c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:24:48.131431 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941f786-6a15-48d3-833b-37277fb526c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:24:48.133256 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941f786-6a15-48d3-833b-37277fb526c7 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:24:48.159934 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1243/2447] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:24:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:24:50.568687 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=47 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:24:58.163740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=12 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:00.682624 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b70d5-fb58-4afe-90a8-0dbc733ceb21 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:00.693584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b70d5-fb58-4afe-90a8-0dbc733ceb21 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:00.698351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf24601-b915-4002-be02-4e0c2baba599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:00.698992 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf24601-b915-4002-be02-4e0c2baba599 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:00.699282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf24601-b915-4002-be02-4e0c2baba599 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:00.699548 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf24601-b915-4002-be02-4e0c2baba599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:00.701559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-edf24601-b915-4002-be02-4e0c2baba599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:00.781831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf24601-b915-4002-be02-4e0c2baba599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:00.783216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf24601-b915-4002-be02-4e0c2baba599 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:00.794306 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1205/2448] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:04.788491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941f786-6a15-48d3-833b-37277fb526c7 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:04.790231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a941f786-6a15-48d3-833b-37277fb526c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:04.805462 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941f786-6a15-48d3-833b-37277fb526c7 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:04.811672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d21877-cbb1-4bdb-99b0-58ebbfe8d68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:04.812385 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d21877-cbb1-4bdb-99b0-58ebbfe8d68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:04.812658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d21877-cbb1-4bdb-99b0-58ebbfe8d68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:04.812957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d21877-cbb1-4bdb-99b0-58ebbfe8d68a admin admin] PATH_INFO: `/v3/users/994164cde9f14b8ca5714b5e028f33c1` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:04.814304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d21877-cbb1-4bdb-99b0-58ebbfe8d68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=994164cde9f14b8ca5714b5e028f33c1)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:04.816409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d21877-cbb1-4bdb-99b0-58ebbfe8d68a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:04.870216 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-67d21877-cbb1-4bdb-99b0-58ebbfe8d68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '994164cde9f14b8ca5714b5e028f33c1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:04.877841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-67d21877-cbb1-4bdb-99b0-58ebbfe8d68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '994164cde9f14b8ca5714b5e028f33c1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:04.890726 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-67d21877-cbb1-4bdb-99b0-58ebbfe8d68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '994164cde9f14b8ca5714b5e028f33c1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:04.891656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-67d21877-cbb1-4bdb-99b0-58ebbfe8d68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '994164cde9f14b8ca5714b5e028f33c1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:04.900500 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-67d21877-cbb1-4bdb-99b0-58ebbfe8d68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '994164cde9f14b8ca5714b5e028f33c1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:04.907126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1244/2449] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:25:04 2022] DELETE /identity/v3/users/994164cde9f14b8ca5714b5e028f33c1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:05.090282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf24601-b915-4002-be02-4e0c2baba599 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:05.105516 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf24601-b915-4002-be02-4e0c2baba599 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:05.168042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1ef92-364d-4e77-ad24-38995940dc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:05.168576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1ef92-364d-4e77-ad24-38995940dc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:05.168926 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1ef92-364d-4e77-ad24-38995940dc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:05.169112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1ef92-364d-4e77-ad24-38995940dc9f admin admin] PATH_INFO: `/v3/projects/60b2cb5525ab44ffb5a9f882389ee7fb` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:05.170215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1ef92-364d-4e77-ad24-38995940dc9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b2cb5525ab44ffb5a9f882389ee7fb)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:05.172119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1ef92-364d-4e77-ad24-38995940dc9f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:05.219341 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cdf1ef92-364d-4e77-ad24-38995940dc9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b2cb5525ab44ffb5a9f882389ee7fb', 'request_id': 'req-cdf1ef92-364d-4e77-ad24-38995940dc9f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:05.226984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cdf1ef92-364d-4e77-ad24-38995940dc9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b2cb5525ab44ffb5a9f882389ee7fb', 'request_id': 'req-cdf1ef92-364d-4e77-ad24-38995940dc9f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:05.233522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cdf1ef92-364d-4e77-ad24-38995940dc9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b2cb5525ab44ffb5a9f882389ee7fb', 'request_id': 'req-cdf1ef92-364d-4e77-ad24-38995940dc9f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:05.244068 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cdf1ef92-364d-4e77-ad24-38995940dc9f admin admin] The token cache is being invalidate because project 60b2cb5525ab44ffb5a9f882389ee7fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:25:05.244335 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cdf1ef92-364d-4e77-ad24-38995940dc9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:05.244991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cdf1ef92-364d-4e77-ad24-38995940dc9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:25:05.246516 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1206/2450] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:25:05 2022] DELETE /identity/v3/projects/60b2cb5525ab44ffb5a9f882389ee7fb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:05.252191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78be2fe-ed36-46ef-946c-20a5b036825d None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:05.252476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78be2fe-ed36-46ef-946c-20a5b036825d None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:05.252753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78be2fe-ed36-46ef-946c-20a5b036825d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:05.273946 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f78be2fe-ed36-46ef-946c-20a5b036825d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:05.275215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f78be2fe-ed36-46ef-946c-20a5b036825d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:05.339761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1245/2451] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:05.348720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600afc7f-7108-4850-b4a4-6b2371d3f08b None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:05.348984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600afc7f-7108-4850-b4a4-6b2371d3f08b None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:05.349412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600afc7f-7108-4850-b4a4-6b2371d3f08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:05.370722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-600afc7f-7108-4850-b4a4-6b2371d3f08b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:05.371957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-600afc7f-7108-4850-b4a4-6b2371d3f08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:05.380955 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1207/2452] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:05.385406 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78be2fe-ed36-46ef-946c-20a5b036825d None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:05.395750 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78be2fe-ed36-46ef-946c-20a5b036825d None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:05.401269 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb1b56-f343-4940-b3b5-8f4da268fbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:05.402045 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb1b56-f343-4940-b3b5-8f4da268fbfb admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:05.402317 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb1b56-f343-4940-b3b5-8f4da268fbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:05.402577 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb1b56-f343-4940-b3b5-8f4da268fbfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:05.403221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb1b56-f343-4940-b3b5-8f4da268fbfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:25:05.403514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb1b56-f343-4940-b3b5-8f4da268fbfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:05.405164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb1b56-f343-4940-b3b5-8f4da268fbfb admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:05.420848 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1246/2453] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:25:05.425486 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600afc7f-7108-4850-b4a4-6b2371d3f08b None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:05.435212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600afc7f-7108-4850-b4a4-6b2371d3f08b None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:05.440605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90e400-c41b-43f3-b7e9-c31db944a3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:05.441244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90e400-c41b-43f3-b7e9-c31db944a3e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:05.441523 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90e400-c41b-43f3-b7e9-c31db944a3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:05.441808 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90e400-c41b-43f3-b7e9-c31db944a3e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:05.442437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90e400-c41b-43f3-b7e9-c31db944a3e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:05.444354 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90e400-c41b-43f3-b7e9-c31db944a3e0 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:05.461086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:05.480593 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1208/2454] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:25:05 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:05.485194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb1b56-f343-4940-b3b5-8f4da268fbfb admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:05.496810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb1b56-f343-4940-b3b5-8f4da268fbfb admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:05.560400 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ec4c7-189a-4f82-aa21-09547e03f557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:05.561030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ec4c7-189a-4f82-aa21-09547e03f557 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:05.561373 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ec4c7-189a-4f82-aa21-09547e03f557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:05.561667 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ec4c7-189a-4f82-aa21-09547e03f557 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:05.562302 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ec4c7-189a-4f82-aa21-09547e03f557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:05.564267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ec4c7-189a-4f82-aa21-09547e03f557 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:05.572531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:05.589972 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1247/2455] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:25:05 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:25:05.594603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90e400-c41b-43f3-b7e9-c31db944a3e0 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:05.607441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90e400-c41b-43f3-b7e9-c31db944a3e0 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:05.615076 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3473f5-d377-427c-9be0-3dc6c28fa02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:05.615823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3473f5-d377-427c-9be0-3dc6c28fa02a admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:05.616164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3473f5-d377-427c-9be0-3dc6c28fa02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:05.616438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3473f5-d377-427c-9be0-3dc6c28fa02a admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:05.617102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3473f5-d377-427c-9be0-3dc6c28fa02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:05.619008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3473f5-d377-427c-9be0-3dc6c28fa02a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:05.630493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1209/2456] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:25:05.634676 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ec4c7-189a-4f82-aa21-09547e03f557 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:05.646627 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ec4c7-189a-4f82-aa21-09547e03f557 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:05.651764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b38bb-4a77-41e2-9927-778000d459b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:05.652380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b38bb-4a77-41e2-9927-778000d459b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:05.652657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b38bb-4a77-41e2-9927-778000d459b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:05.652878 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b38bb-4a77-41e2-9927-778000d459b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:05.653608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b38bb-4a77-41e2-9927-778000d459b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:05.655531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b38bb-4a77-41e2-9927-778000d459b6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:05.667776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1248/2457] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:25:05.672394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3473f5-d377-427c-9be0-3dc6c28fa02a admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:05.682616 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3473f5-d377-427c-9be0-3dc6c28fa02a admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:05.687439 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60569f-782b-4eae-b962-018e8d39605f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:05.688080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60569f-782b-4eae-b962-018e8d39605f admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:05.688355 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60569f-782b-4eae-b962-018e8d39605f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:05.688625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60569f-782b-4eae-b962-018e8d39605f admin admin] PATH_INFO: `/v3/projects/41efb12e9d9947de959fd270a36b57bc/users/78a5e436dd4d420cb897d2c4f3620bdb/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:05.705025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60569f-782b-4eae-b962-018e8d39605f admin admin] RBAC: Authorizing `identity:create_grant(project_id=41efb12e9d9947de959fd270a36b57bc, user_id=78a5e436dd4d420cb897d2c4f3620bdb, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:05.707827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60569f-782b-4eae-b962-018e8d39605f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:05.722784 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1210/2458] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:25:05 2022] PUT /identity/v3/projects/41efb12e9d9947de959fd270a36b57bc/users/78a5e436dd4d420cb897d2c4f3620bdb/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:25:05.728106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e63142-8505-4ff6-9b80-32ce1f3b4350 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:05.728397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e63142-8505-4ff6-9b80-32ce1f3b4350 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:05.728659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e63142-8505-4ff6-9b80-32ce1f3b4350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:05.749356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f9e63142-8505-4ff6-9b80-32ce1f3b4350 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:05.750637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f9e63142-8505-4ff6-9b80-32ce1f3b4350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:05.812218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1249/2459] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:05.822605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60569f-782b-4eae-b962-018e8d39605f admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:05.825108 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7d60569f-782b-4eae-b962-018e8d39605f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:05.886318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60569f-782b-4eae-b962-018e8d39605f admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:05.890643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963238ec-7b93-4f83-adaf-f80b8516f498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:05.891262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963238ec-7b93-4f83-adaf-f80b8516f498 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:05.891535 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963238ec-7b93-4f83-adaf-f80b8516f498 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:05.891829 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963238ec-7b93-4f83-adaf-f80b8516f498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:05.902864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963238ec-7b93-4f83-adaf-f80b8516f498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:05.904539 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963238ec-7b93-4f83-adaf-f80b8516f498 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:05.917026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1211/2460] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:10.056863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce270bc9-3146-410c-9cc7-9da7692e8e16 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:10.057440 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce270bc9-3146-410c-9cc7-9da7692e8e16 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:10.057440 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce270bc9-3146-410c-9cc7-9da7692e8e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:10.086986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ce270bc9-3146-410c-9cc7-9da7692e8e16 None None] MFA Rules not processed for user `78a5e436dd4d420cb897d2c4f3620bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:10.088212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ce270bc9-3146-410c-9cc7-9da7692e8e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:10.167923 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1250/2461] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:25:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:25:10.185052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963238ec-7b93-4f83-adaf-f80b8516f498 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:10.187069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-963238ec-7b93-4f83-adaf-f80b8516f498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:10.264635 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963238ec-7b93-4f83-adaf-f80b8516f498 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:10.270069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11991a-03e5-4384-b285-91f5cf1ef12e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:10.270667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11991a-03e5-4384-b285-91f5cf1ef12e service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:10.270939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11991a-03e5-4384-b285-91f5cf1ef12e service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:10.271209 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11991a-03e5-4384-b285-91f5cf1ef12e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:10.279772 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11991a-03e5-4384-b285-91f5cf1ef12e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:10.281373 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11991a-03e5-4384-b285-91f5cf1ef12e service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:10.291261 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1212/2462] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:11.683520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fe61d-fa5c-4712-b98a-65af8997820f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:11.684381 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fe61d-fa5c-4712-b98a-65af8997820f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:11.684647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fe61d-fa5c-4712-b98a-65af8997820f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:11.705515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bb8fe61d-fa5c-4712-b98a-65af8997820f None None] MFA Rules not processed for user `78a5e436dd4d420cb897d2c4f3620bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:25:11.706783 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bb8fe61d-fa5c-4712-b98a-65af8997820f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:11.714976 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1251/2463] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:25:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:25:12.061550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11991a-03e5-4384-b285-91f5cf1ef12e service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:12.065223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ed11991a-03e5-4384-b285-91f5cf1ef12e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:12.076072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11991a-03e5-4384-b285-91f5cf1ef12e service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:12.080352 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47cac3-c683-4552-a3ba-6cafe5b08de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:12.080966 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47cac3-c683-4552-a3ba-6cafe5b08de5 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:12.081237 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47cac3-c683-4552-a3ba-6cafe5b08de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:12.081497 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47cac3-c683-4552-a3ba-6cafe5b08de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:12.084088 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5c47cac3-c683-4552-a3ba-6cafe5b08de5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:12.095628 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47cac3-c683-4552-a3ba-6cafe5b08de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:12.097182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47cac3-c683-4552-a3ba-6cafe5b08de5 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:12.105851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1213/2464] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:21.699562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:21.987565 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fe61d-fa5c-4712-b98a-65af8997820f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:25:22.001612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fe61d-fa5c-4712-b98a-65af8997820f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:25:22.007525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac45db9-7b84-4aa8-a392-269e98a4575a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:25:22.008232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac45db9-7b84-4aa8-a392-269e98a4575a service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:25:22.008510 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac45db9-7b84-4aa8-a392-269e98a4575a service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:25:22.008852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac45db9-7b84-4aa8-a392-269e98a4575a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:25:22.010983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dac45db9-7b84-4aa8-a392-269e98a4575a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:25:22.024033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac45db9-7b84-4aa8-a392-269e98a4575a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:25:22.025669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac45db9-7b84-4aa8-a392-269e98a4575a service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:25:22.036760 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1252/2465] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:25:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:25:22.102097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=83,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:25:32.032268 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:19.082853 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e354992-b793-485f-8784-808eee2e277c None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:19.083934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e354992-b793-485f-8784-808eee2e277c None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:19.083934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e354992-b793-485f-8784-808eee2e277c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:19.104379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-3e354992-b793-485f-8784-808eee2e277c None None] MFA Rules not processed for user `d98fa7056d4247edbda7c8e406e2dcb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:19.105657 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3e354992-b793-485f-8784-808eee2e277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:19.171041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1214/2466] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:26:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:29.163518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=25 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:34.128502 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f3098-aa98-45e6-a302-10cf3826f2ca None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:34.129157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f3098-aa98-45e6-a302-10cf3826f2ca None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:34.129950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f3098-aa98-45e6-a302-10cf3826f2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:34.165569 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cb4f3098-aa98-45e6-a302-10cf3826f2ca None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:34.168064 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cb4f3098-aa98-45e6-a302-10cf3826f2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:34.243529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1253/2467] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Aug 9 11:26:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:34.300614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e354992-b793-485f-8784-808eee2e277c None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:34.303029 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3e354992-b793-485f-8784-808eee2e277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:34.428587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e354992-b793-485f-8784-808eee2e277c None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:34.434195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6f893-6659-4f42-b4ab-76d9bb57fb9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:34.434864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6f893-6659-4f42-b4ab-76d9bb57fb9c service swift] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:34.435207 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6f893-6659-4f42-b4ab-76d9bb57fb9c service swift] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:34.435412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6f893-6659-4f42-b4ab-76d9bb57fb9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:34.445781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6f893-6659-4f42-b4ab-76d9bb57fb9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:34.447434 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6f893-6659-4f42-b4ab-76d9bb57fb9c service swift] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:34.457857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1215/2468] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:26:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:26:44.233367 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=25 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:44.454323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=32 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:26:51.118926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc0f6-5851-4eb4-8a4d-e376cb51b0b4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:51.119479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc0f6-5851-4eb4-8a4d-e376cb51b0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:51.119479 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc0f6-5851-4eb4-8a4d-e376cb51b0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:51.152547 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4cffc0f6-5851-4eb4-8a4d-e376cb51b0b4 None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:26:51.153796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4cffc0f6-5851-4eb4-8a4d-e376cb51b0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:26:51.189153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1254/2469] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Aug 9 11:26:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:26:51.203152 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6f893-6659-4f42-b4ab-76d9bb57fb9c service swift] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:26:51.259476 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6f893-6659-4f42-b4ab-76d9bb57fb9c service swift] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:26:51.266660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d106a6-c4c8-47e4-a0d4-2775767ac3c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:26:51.267280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d106a6-c4c8-47e4-a0d4-2775767ac3c8 service swift] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:26:51.267540 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d106a6-c4c8-47e4-a0d4-2775767ac3c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:26:51.267799 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d106a6-c4c8-47e4-a0d4-2775767ac3c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:26:51.276907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d106a6-c4c8-47e4-a0d4-2775767ac3c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:26:51.278538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d106a6-c4c8-47e4-a0d4-2775767ac3c8 service swift] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:26:51.286661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1216/2470] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:26:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:27:01.186894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=19 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:01.283353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=20 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:10.202989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffc0f6-5851-4eb4-8a4d-e376cb51b0b4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:10.204669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4cffc0f6-5851-4eb4-8a4d-e376cb51b0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:10.412767 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffc0f6-5851-4eb4-8a4d-e376cb51b0b4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:10.422029 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a7588-bede-47c9-9c97-255ac6a77eff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:10.423044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a7588-bede-47c9-9c97-255ac6a77eff service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:10.423527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a7588-bede-47c9-9c97-255ac6a77eff service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:10.424011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a7588-bede-47c9-9c97-255ac6a77eff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:10.427180 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-002a7588-bede-47c9-9c97-255ac6a77eff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:10.453846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a7588-bede-47c9-9c97-255ac6a77eff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:10.455831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a7588-bede-47c9-9c97-255ac6a77eff service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:10.480141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1255/2471] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:14.568222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd64f9f-d491-4058-ba0d-df69635d5a67 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:14.568762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd64f9f-d491-4058-ba0d-df69635d5a67 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:14.569048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd64f9f-d491-4058-ba0d-df69635d5a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:14.615333 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-1fd64f9f-d491-4058-ba0d-df69635d5a67 None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:14.616992 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-1fd64f9f-d491-4058-ba0d-df69635d5a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:14.626231 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1217/2472] 10.222.0.15 () {58 vars in 967 bytes} [Tue Aug 9 11:27:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:14.639699 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a7588-bede-47c9-9c97-255ac6a77eff service placement] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:14.651166 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a7588-bede-47c9-9c97-255ac6a77eff service placement] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:14.656608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fb513-c5b8-4ad9-8fbf-afc9dd9d9dd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:14.657201 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fb513-c5b8-4ad9-8fbf-afc9dd9d9dd9 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:14.657468 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fb513-c5b8-4ad9-8fbf-afc9dd9d9dd9 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:14.657764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fb513-c5b8-4ad9-8fbf-afc9dd9d9dd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:14.666305 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fb513-c5b8-4ad9-8fbf-afc9dd9d9dd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:14.667889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fb513-c5b8-4ad9-8fbf-afc9dd9d9dd9 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:14.676668 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1256/2473] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:27:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:27:15.747190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46391916-a367-465c-97a3-7b8f0a39cfc2 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:15.747190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46391916-a367-465c-97a3-7b8f0a39cfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:15.752533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46391916-a367-465c-97a3-7b8f0a39cfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:15.771921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-46391916-a367-465c-97a3-7b8f0a39cfc2 None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:27:15.774006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-46391916-a367-465c-97a3-7b8f0a39cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:15.783209 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1218/2474] 10.222.0.15 () {58 vars in 967 bytes} [Tue Aug 9 11:27:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:27:15.800100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fb513-c5b8-4ad9-8fbf-afc9dd9d9dd9 service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:15.812369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fb513-c5b8-4ad9-8fbf-afc9dd9d9dd9 service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:15.818752 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8afce-d39f-43a9-81ab-b5cf11bedded service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:15.819380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8afce-d39f-43a9-81ab-b5cf11bedded service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:15.819654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8afce-d39f-43a9-81ab-b5cf11bedded service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:15.819927 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8afce-d39f-43a9-81ab-b5cf11bedded service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:15.830094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8afce-d39f-43a9-81ab-b5cf11bedded service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:15.832033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8afce-d39f-43a9-81ab-b5cf11bedded service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:15.841999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1257/2475] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:27:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:27:20.296131 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46391916-a367-465c-97a3-7b8f0a39cfc2 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:20.318164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46391916-a367-465c-97a3-7b8f0a39cfc2 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:20.323461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea4334-41fb-44a6-8949-5828b9e997e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:20.324216 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea4334-41fb-44a6-8949-5828b9e997e1 service placement] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:20.324491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea4334-41fb-44a6-8949-5828b9e997e1 service placement] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:20.324751 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea4334-41fb-44a6-8949-5828b9e997e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:20.327318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b2ea4334-41fb-44a6-8949-5828b9e997e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:20.341049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea4334-41fb-44a6-8949-5828b9e997e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:20.342702 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea4334-41fb-44a6-8949-5828b9e997e1 service placement] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:20.363642 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1219/2476] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:27:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:27:24.690508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8afce-d39f-43a9-81ab-b5cf11bedded service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:24.692699 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-06a8afce-d39f-43a9-81ab-b5cf11bedded service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:24.753400 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8afce-d39f-43a9-81ab-b5cf11bedded service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:24.758669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73246731-fe9a-4efb-9463-cf42a4847088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:24.759322 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73246731-fe9a-4efb-9463-cf42a4847088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:24.759598 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73246731-fe9a-4efb-9463-cf42a4847088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:24.759854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73246731-fe9a-4efb-9463-cf42a4847088 admin admin] PATH_INFO: `/v3/users/354eaf39c1d84c90aa2253f199607938` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:24.761075 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73246731-fe9a-4efb-9463-cf42a4847088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=354eaf39c1d84c90aa2253f199607938)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:24.763079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73246731-fe9a-4efb-9463-cf42a4847088 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:24.816250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-73246731-fe9a-4efb-9463-cf42a4847088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '354eaf39c1d84c90aa2253f199607938'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:24.823436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-73246731-fe9a-4efb-9463-cf42a4847088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '354eaf39c1d84c90aa2253f199607938'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:24.834428 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:24.837424 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-73246731-fe9a-4efb-9463-cf42a4847088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '354eaf39c1d84c90aa2253f199607938'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:24.838594 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-73246731-fe9a-4efb-9463-cf42a4847088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '354eaf39c1d84c90aa2253f199607938'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:24.848506 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-73246731-fe9a-4efb-9463-cf42a4847088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '354eaf39c1d84c90aa2253f199607938'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:24.857063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1258/2477] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:24 2022] DELETE /identity/v3/users/354eaf39c1d84c90aa2253f199607938 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:25.070243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea4334-41fb-44a6-8949-5828b9e997e1 service placement] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:25.090093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea4334-41fb-44a6-8949-5828b9e997e1 service placement] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:25.158157 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069a56d-44aa-4d2c-be28-0f56349ef2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:25.158793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069a56d-44aa-4d2c-be28-0f56349ef2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:25.159066 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069a56d-44aa-4d2c-be28-0f56349ef2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:25.159339 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9069a56d-44aa-4d2c-be28-0f56349ef2e9 admin admin] PATH_INFO: `/v3/projects/e655d78df7754c8db6aaff2948c34ddf` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:25.160473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069a56d-44aa-4d2c-be28-0f56349ef2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e655d78df7754c8db6aaff2948c34ddf)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:25.162445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9069a56d-44aa-4d2c-be28-0f56349ef2e9 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:25.221718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9069a56d-44aa-4d2c-be28-0f56349ef2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e655d78df7754c8db6aaff2948c34ddf', 'request_id': 'req-9069a56d-44aa-4d2c-be28-0f56349ef2e9'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:25.236107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9069a56d-44aa-4d2c-be28-0f56349ef2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e655d78df7754c8db6aaff2948c34ddf', 'request_id': 'req-9069a56d-44aa-4d2c-be28-0f56349ef2e9'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:25.249120 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9069a56d-44aa-4d2c-be28-0f56349ef2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e655d78df7754c8db6aaff2948c34ddf', 'request_id': 'req-9069a56d-44aa-4d2c-be28-0f56349ef2e9'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:25.268255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9069a56d-44aa-4d2c-be28-0f56349ef2e9 admin admin] The token cache is being invalidate because project e655d78df7754c8db6aaff2948c34ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:25.268850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9069a56d-44aa-4d2c-be28-0f56349ef2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:25.269867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9069a56d-44aa-4d2c-be28-0f56349ef2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:25.272481 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1220/2478] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:25 2022] DELETE /identity/v3/projects/e655d78df7754c8db6aaff2948c34ddf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:25.278181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73246731-fe9a-4efb-9463-cf42a4847088 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:25.279869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-73246731-fe9a-4efb-9463-cf42a4847088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:25.293435 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73246731-fe9a-4efb-9463-cf42a4847088 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:25.377938 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2be6f-d332-4bef-85bd-251dc4ab2083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:25.378795 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2be6f-d332-4bef-85bd-251dc4ab2083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:25.379153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2be6f-d332-4bef-85bd-251dc4ab2083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:25.379487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2be6f-d332-4bef-85bd-251dc4ab2083 admin admin] PATH_INFO: `/v3/users/bbacc1703219415c9af3e9d9da33c6e4` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:25.380745 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2be6f-d332-4bef-85bd-251dc4ab2083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbacc1703219415c9af3e9d9da33c6e4)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:25.382704 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2be6f-d332-4bef-85bd-251dc4ab2083 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:25.454018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8ae2be6f-d332-4bef-85bd-251dc4ab2083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbacc1703219415c9af3e9d9da33c6e4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:25.461526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8ae2be6f-d332-4bef-85bd-251dc4ab2083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbacc1703219415c9af3e9d9da33c6e4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:25.476708 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8ae2be6f-d332-4bef-85bd-251dc4ab2083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbacc1703219415c9af3e9d9da33c6e4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:25.477836 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8ae2be6f-d332-4bef-85bd-251dc4ab2083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbacc1703219415c9af3e9d9da33c6e4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:25.493144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8ae2be6f-d332-4bef-85bd-251dc4ab2083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbacc1703219415c9af3e9d9da33c6e4'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:25.501655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1259/2479] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:27:25 2022] DELETE /identity/v3/users/bbacc1703219415c9af3e9d9da33c6e4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:27:25.755507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069a56d-44aa-4d2c-be28-0f56349ef2e9 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:27:25.757117 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9069a56d-44aa-4d2c-be28-0f56349ef2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:27:25.771218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9069a56d-44aa-4d2c-be28-0f56349ef2e9 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:27:25.833388 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:25.843602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ec9c3-ee97-402d-9682-5eccdd12db33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:27:25.844416 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ec9c3-ee97-402d-9682-5eccdd12db33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:27:25.844796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ec9c3-ee97-402d-9682-5eccdd12db33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:27:25.845074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ec9c3-ee97-402d-9682-5eccdd12db33 admin admin] PATH_INFO: `/v3/projects/85990ae25f9a4e4181f85f3d26094858` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:27:25.846733 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ec9c3-ee97-402d-9682-5eccdd12db33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85990ae25f9a4e4181f85f3d26094858)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:27:25.849013 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ec9c3-ee97-402d-9682-5eccdd12db33 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:27:25.905464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-065ec9c3-ee97-402d-9682-5eccdd12db33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85990ae25f9a4e4181f85f3d26094858', 'request_id': 'req-065ec9c3-ee97-402d-9682-5eccdd12db33'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:25.915772 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-065ec9c3-ee97-402d-9682-5eccdd12db33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85990ae25f9a4e4181f85f3d26094858', 'request_id': 'req-065ec9c3-ee97-402d-9682-5eccdd12db33'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:25.923779 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-065ec9c3-ee97-402d-9682-5eccdd12db33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85990ae25f9a4e4181f85f3d26094858', 'request_id': 'req-065ec9c3-ee97-402d-9682-5eccdd12db33'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:25.936390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-065ec9c3-ee97-402d-9682-5eccdd12db33 admin admin] The token cache is being invalidate because project 85990ae25f9a4e4181f85f3d26094858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:27:25.936678 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-065ec9c3-ee97-402d-9682-5eccdd12db33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:25.937361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-065ec9c3-ee97-402d-9682-5eccdd12db33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:27:25.938931 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1221/2480] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:27:25 2022] DELETE /identity/v3/projects/85990ae25f9a4e4181f85f3d26094858 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:27:35.497556 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:DELETE=12,keystone:SELECT=56,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:27:35.932733 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:05.623519 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2be6f-d332-4bef-85bd-251dc4ab2083 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:05.626148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8ae2be6f-d332-4bef-85bd-251dc4ab2083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:05.713478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2be6f-d332-4bef-85bd-251dc4ab2083 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:05.763477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099133d1-bfa6-4b70-a63f-edb2a0377bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:05.763989 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099133d1-bfa6-4b70-a63f-edb2a0377bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:05.764265 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099133d1-bfa6-4b70-a63f-edb2a0377bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:05.764609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099133d1-bfa6-4b70-a63f-edb2a0377bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:05.766375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-099133d1-bfa6-4b70-a63f-edb2a0377bc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:05.831792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099133d1-bfa6-4b70-a63f-edb2a0377bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:05.833711 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099133d1-bfa6-4b70-a63f-edb2a0377bc6 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:05.844276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1260/2481] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:09.333711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ec9c3-ee97-402d-9682-5eccdd12db33 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:09.336229 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-065ec9c3-ee97-402d-9682-5eccdd12db33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:09.397882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099133d1-bfa6-4b70-a63f-edb2a0377bc6 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:09.399397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-099133d1-bfa6-4b70-a63f-edb2a0377bc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:09.413090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099133d1-bfa6-4b70-a63f-edb2a0377bc6 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:09.418747 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5978b3b-6073-4754-9ff0-c2bfcc1543b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:09.419511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5978b3b-6073-4754-9ff0-c2bfcc1543b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:09.420074 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5978b3b-6073-4754-9ff0-c2bfcc1543b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:09.420409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5978b3b-6073-4754-9ff0-c2bfcc1543b7 admin admin] PATH_INFO: `/v3/users/d98fa7056d4247edbda7c8e406e2dcb1` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:09.421852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5978b3b-6073-4754-9ff0-c2bfcc1543b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98fa7056d4247edbda7c8e406e2dcb1)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:09.424006 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5978b3b-6073-4754-9ff0-c2bfcc1543b7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:09.470131 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ec9c3-ee97-402d-9682-5eccdd12db33 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:09.477830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c649ee-6ea1-4f56-9e92-d656e9b3f8aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:09.478901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c649ee-6ea1-4f56-9e92-d656e9b3f8aa service placement] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:09.479663 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c649ee-6ea1-4f56-9e92-d656e9b3f8aa service placement] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:09.480367 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c649ee-6ea1-4f56-9e92-d656e9b3f8aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:09.484542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e7c649ee-6ea1-4f56-9e92-d656e9b3f8aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:09.494219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:09.494219 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b5978b3b-6073-4754-9ff0-c2bfcc1543b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98fa7056d4247edbda7c8e406e2dcb1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:09.500200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b5978b3b-6073-4754-9ff0-c2bfcc1543b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98fa7056d4247edbda7c8e406e2dcb1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:09.507400 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c649ee-6ea1-4f56-9e92-d656e9b3f8aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:09.509100 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c649ee-6ea1-4f56-9e92-d656e9b3f8aa service placement] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:09.516855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b5978b3b-6073-4754-9ff0-c2bfcc1543b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98fa7056d4247edbda7c8e406e2dcb1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:09.517610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b5978b3b-6073-4754-9ff0-c2bfcc1543b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98fa7056d4247edbda7c8e406e2dcb1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:09.521578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1222/2482] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:09.526673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b5978b3b-6073-4754-9ff0-c2bfcc1543b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98fa7056d4247edbda7c8e406e2dcb1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:09.534591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1261/2483] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:09 2022] DELETE /identity/v3/users/d98fa7056d4247edbda7c8e406e2dcb1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:09.748515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c649ee-6ea1-4f56-9e92-d656e9b3f8aa service placement] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:09.767102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c649ee-6ea1-4f56-9e92-d656e9b3f8aa service placement] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:09.834514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed926c-0be7-4aeb-9da9-288a7fd3da21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:09.835170 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed926c-0be7-4aeb-9da9-288a7fd3da21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:09.835442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed926c-0be7-4aeb-9da9-288a7fd3da21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:09.835708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed926c-0be7-4aeb-9da9-288a7fd3da21 admin admin] PATH_INFO: `/v3/projects/118db627a2af4f11b1a35f3adeb51e8e` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:09.836956 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed926c-0be7-4aeb-9da9-288a7fd3da21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=118db627a2af4f11b1a35f3adeb51e8e)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:09.839155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ed926c-0be7-4aeb-9da9-288a7fd3da21 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:09.893302 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a3ed926c-0be7-4aeb-9da9-288a7fd3da21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118db627a2af4f11b1a35f3adeb51e8e', 'request_id': 'req-a3ed926c-0be7-4aeb-9da9-288a7fd3da21'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:09.903583 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a3ed926c-0be7-4aeb-9da9-288a7fd3da21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118db627a2af4f11b1a35f3adeb51e8e', 'request_id': 'req-a3ed926c-0be7-4aeb-9da9-288a7fd3da21'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:09.911042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a3ed926c-0be7-4aeb-9da9-288a7fd3da21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118db627a2af4f11b1a35f3adeb51e8e', 'request_id': 'req-a3ed926c-0be7-4aeb-9da9-288a7fd3da21'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:09.923239 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a3ed926c-0be7-4aeb-9da9-288a7fd3da21 admin admin] The token cache is being invalidate because project 118db627a2af4f11b1a35f3adeb51e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:09.923514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a3ed926c-0be7-4aeb-9da9-288a7fd3da21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:09.924203 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a3ed926c-0be7-4aeb-9da9-288a7fd3da21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:09.925793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1223/2484] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:09 2022] DELETE /identity/v3/projects/118db627a2af4f11b1a35f3adeb51e8e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:09.930849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0881d54-4ccd-40e8-bd69-c97c00b7d725 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:09.931129 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0881d54-4ccd-40e8-bd69-c97c00b7d725 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:09.931400 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0881d54-4ccd-40e8-bd69-c97c00b7d725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:09.999270 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f0881d54-4ccd-40e8-bd69-c97c00b7d725 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:10.000532 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f0881d54-4ccd-40e8-bd69-c97c00b7d725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:10.069435 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1262/2485] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:10.080199 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45798da1-9134-482f-a2d1-349e95a7a49c None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:10.080532 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45798da1-9134-482f-a2d1-349e95a7a49c None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:10.080866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45798da1-9134-482f-a2d1-349e95a7a49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:10.115494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-45798da1-9134-482f-a2d1-349e95a7a49c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:10.117542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-45798da1-9134-482f-a2d1-349e95a7a49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:10.131372 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1224/2486] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:10.137709 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0881d54-4ccd-40e8-bd69-c97c00b7d725 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:10.148921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0881d54-4ccd-40e8-bd69-c97c00b7d725 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:10.155182 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7dc9a-638f-44ea-918e-83944f66e837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:10.155947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7dc9a-638f-44ea-918e-83944f66e837 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:10.156307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7dc9a-638f-44ea-918e-83944f66e837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:10.156629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7dc9a-638f-44ea-918e-83944f66e837 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:10.157461 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7dc9a-638f-44ea-918e-83944f66e837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:28:10.157892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7dc9a-638f-44ea-918e-83944f66e837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:10.159771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7dc9a-638f-44ea-918e-83944f66e837 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:10.174677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1263/2487] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:28:10.179692 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45798da1-9134-482f-a2d1-349e95a7a49c None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:10.189909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45798da1-9134-482f-a2d1-349e95a7a49c None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:10.194988 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3dc0f-82f4-46f9-b766-6d6c8caeb6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:10.195595 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3dc0f-82f4-46f9-b766-6d6c8caeb6eb admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:10.195861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3dc0f-82f4-46f9-b766-6d6c8caeb6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:10.196147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3dc0f-82f4-46f9-b766-6d6c8caeb6eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:10.196751 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3dc0f-82f4-46f9-b766-6d6c8caeb6eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:10.198720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3dc0f-82f4-46f9-b766-6d6c8caeb6eb admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:10.210985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:10.233210 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1225/2488] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:10 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:10.238165 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7dc9a-638f-44ea-918e-83944f66e837 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:10.252459 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7dc9a-638f-44ea-918e-83944f66e837 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:10.353700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f387a6-90ab-489e-b572-2451a470dc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:10.354678 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f387a6-90ab-489e-b572-2451a470dc98 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:10.355159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f387a6-90ab-489e-b572-2451a470dc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:10.355647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f387a6-90ab-489e-b572-2451a470dc98 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:10.356809 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f387a6-90ab-489e-b572-2451a470dc98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:10.361063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f387a6-90ab-489e-b572-2451a470dc98 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:10.394563 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1264/2489] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:10 2022] POST /identity/v3/users => generated 282 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:10.399257 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3dc0f-82f4-46f9-b766-6d6c8caeb6eb admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:10.411207 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3dc0f-82f4-46f9-b766-6d6c8caeb6eb admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:10.417281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7545779-1211-4407-b2bd-278aead52e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:10.418009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7545779-1211-4407-b2bd-278aead52e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:10.418356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7545779-1211-4407-b2bd-278aead52e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:10.418667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7545779-1211-4407-b2bd-278aead52e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:10.419471 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7545779-1211-4407-b2bd-278aead52e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:10.421471 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7545779-1211-4407-b2bd-278aead52e4a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:10.434415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1226/2490] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:28:10.439924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f387a6-90ab-489e-b572-2451a470dc98 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:10.447693 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:10.452531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f387a6-90ab-489e-b572-2451a470dc98 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:10.460806 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910abb9-9b1c-4544-9974-801ba440d2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:10.461839 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910abb9-9b1c-4544-9974-801ba440d2aa admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:10.462172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910abb9-9b1c-4544-9974-801ba440d2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:10.462490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910abb9-9b1c-4544-9974-801ba440d2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:10.463351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910abb9-9b1c-4544-9974-801ba440d2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:10.465606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910abb9-9b1c-4544-9974-801ba440d2aa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:10.481740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1265/2491] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:10.488017 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7545779-1211-4407-b2bd-278aead52e4a admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:10.499726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7545779-1211-4407-b2bd-278aead52e4a admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:10.506490 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bf94b-5780-4037-b1a1-a6420f522f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:10.507441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bf94b-5780-4037-b1a1-a6420f522f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:10.507812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bf94b-5780-4037-b1a1-a6420f522f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:10.508174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bf94b-5780-4037-b1a1-a6420f522f65 admin admin] PATH_INFO: `/v3/projects/4fe8c9bc30414dc0a55404e221501363/users/6ec5f2723b8641138fde18c3f004f1d8/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:10.528464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bf94b-5780-4037-b1a1-a6420f522f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe8c9bc30414dc0a55404e221501363, user_id=6ec5f2723b8641138fde18c3f004f1d8, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:10.531317 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bf94b-5780-4037-b1a1-a6420f522f65 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:10.547795 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1227/2492] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:10 2022] PUT /identity/v3/projects/4fe8c9bc30414dc0a55404e221501363/users/6ec5f2723b8641138fde18c3f004f1d8/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:10.559878 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f06ab4-5dfb-4535-a769-4d6ccd829869 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:10.560306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f06ab4-5dfb-4535-a769-4d6ccd829869 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:10.560682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f06ab4-5dfb-4535-a769-4d6ccd829869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:10.593941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b7f06ab4-5dfb-4535-a769-4d6ccd829869 None None] MFA Rules not processed for user `6ec5f2723b8641138fde18c3f004f1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:10.595174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b7f06ab4-5dfb-4535-a769-4d6ccd829869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:10.690273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1266/2493] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:10.696135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bf94b-5780-4037-b1a1-a6420f522f65 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:10.804191 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bf94b-5780-4037-b1a1-a6420f522f65 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:10.810449 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc8c2a-963f-4241-80f9-ace9c14bd934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:10.811080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc8c2a-963f-4241-80f9-ace9c14bd934 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:10.811327 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc8c2a-963f-4241-80f9-ace9c14bd934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:10.811594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc8c2a-963f-4241-80f9-ace9c14bd934 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:10.812258 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc8c2a-963f-4241-80f9-ace9c14bd934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:10.814309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc8c2a-963f-4241-80f9-ace9c14bd934 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:10.849889 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1228/2494] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:10 2022] POST /identity/v3/projects => generated 363 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:28:10.855796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f06ab4-5dfb-4535-a769-4d6ccd829869 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:10.868155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f06ab4-5dfb-4535-a769-4d6ccd829869 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:10.933574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9570623-12b8-4f54-a194-f31b1944217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:10.934202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9570623-12b8-4f54-a194-f31b1944217b admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:10.934475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9570623-12b8-4f54-a194-f31b1944217b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:10.934740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9570623-12b8-4f54-a194-f31b1944217b admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:10.935371 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9570623-12b8-4f54-a194-f31b1944217b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:10.937297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9570623-12b8-4f54-a194-f31b1944217b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:10.962487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1267/2495] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:10 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:28:10.967313 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc8c2a-963f-4241-80f9-ace9c14bd934 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:10.978906 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc8c2a-963f-4241-80f9-ace9c14bd934 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:10.984080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57507d-ce1d-4520-b166-e815b7a6be97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:10.984684 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57507d-ce1d-4520-b166-e815b7a6be97 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:10.984952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57507d-ce1d-4520-b166-e815b7a6be97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:10.985212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57507d-ce1d-4520-b166-e815b7a6be97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:10.985923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57507d-ce1d-4520-b166-e815b7a6be97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:10.987558 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57507d-ce1d-4520-b166-e815b7a6be97 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:10.998935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1229/2496] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:11.004087 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9570623-12b8-4f54-a194-f31b1944217b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:11.015002 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9570623-12b8-4f54-a194-f31b1944217b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:11.020243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00841ca4-7730-46a6-a019-aa956c4a5b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:11.020900 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00841ca4-7730-46a6-a019-aa956c4a5b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:11.021178 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00841ca4-7730-46a6-a019-aa956c4a5b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:11.021551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00841ca4-7730-46a6-a019-aa956c4a5b6b admin admin] PATH_INFO: `/v3/projects/b18baf1bb14f49d1b3cc33e3297394a2/users/d47067996fa84773bc8ad3e4ddc6c576/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:11.043220 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00841ca4-7730-46a6-a019-aa956c4a5b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18baf1bb14f49d1b3cc33e3297394a2, user_id=d47067996fa84773bc8ad3e4ddc6c576, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:11.046190 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00841ca4-7730-46a6-a019-aa956c4a5b6b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:11.061913 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1268/2497] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:11 2022] PUT /identity/v3/projects/b18baf1bb14f49d1b3cc33e3297394a2/users/d47067996fa84773bc8ad3e4ddc6c576/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:11.066266 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57507d-ce1d-4520-b166-e815b7a6be97 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:11.077929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57507d-ce1d-4520-b166-e815b7a6be97 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:11.140469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0484d-739d-4a44-983b-42c738a7fd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:11.141114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0484d-739d-4a44-983b-42c738a7fd82 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:11.141385 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0484d-739d-4a44-983b-42c738a7fd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:11.141784 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0484d-739d-4a44-983b-42c738a7fd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:11.142461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0484d-739d-4a44-983b-42c738a7fd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:11.144575 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0484d-739d-4a44-983b-42c738a7fd82 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:11.157015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1230/2498] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:11.161430 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00841ca4-7730-46a6-a019-aa956c4a5b6b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:11.171943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00841ca4-7730-46a6-a019-aa956c4a5b6b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:11.176484 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e154ac-6a76-47f2-acb0-d19f41b77d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:11.177146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e154ac-6a76-47f2-acb0-d19f41b77d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:11.177416 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e154ac-6a76-47f2-acb0-d19f41b77d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:11.177767 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e154ac-6a76-47f2-acb0-d19f41b77d64 admin admin] PATH_INFO: `/v3/projects/b18baf1bb14f49d1b3cc33e3297394a2/users/d47067996fa84773bc8ad3e4ddc6c576/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:11.179674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e154ac-6a76-47f2-acb0-d19f41b77d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18baf1bb14f49d1b3cc33e3297394a2, user_id=d47067996fa84773bc8ad3e4ddc6c576, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:11.182354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e154ac-6a76-47f2-acb0-d19f41b77d64 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:11.193721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1269/2499] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:11 2022] PUT /identity/v3/projects/b18baf1bb14f49d1b3cc33e3297394a2/users/d47067996fa84773bc8ad3e4ddc6c576/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:11.204978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad3fed-8f4f-422d-9236-d384db35f780 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:11.205251 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad3fed-8f4f-422d-9236-d384db35f780 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:11.205505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad3fed-8f4f-422d-9236-d384db35f780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:11.238302 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-40ad3fed-8f4f-422d-9236-d384db35f780 None None] MFA Rules not processed for user `d47067996fa84773bc8ad3e4ddc6c576`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:11.239427 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-40ad3fed-8f4f-422d-9236-d384db35f780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:11.255296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:11.342020 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1231/2500] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:11.354835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e154ac-6a76-47f2-acb0-d19f41b77d64 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:11.357676 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c1e154ac-6a76-47f2-acb0-d19f41b77d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:11.412471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:11.466002 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e154ac-6a76-47f2-acb0-d19f41b77d64 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:11.470562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44827a-5598-47dd-b428-27f953d2c8b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:11.471182 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44827a-5598-47dd-b428-27f953d2c8b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:11.471453 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44827a-5598-47dd-b428-27f953d2c8b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:11.471723 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44827a-5598-47dd-b428-27f953d2c8b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:11.489356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44827a-5598-47dd-b428-27f953d2c8b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:11.490343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44827a-5598-47dd-b428-27f953d2c8b3 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:11.501669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1270/2501] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:11.591682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad3fed-8f4f-422d-9236-d384db35f780 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:11.602280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad3fed-8f4f-422d-9236-d384db35f780 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:11.606144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a7acd-ef06-4b73-8944-51c2e08019bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:11.606752 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a7acd-ef06-4b73-8944-51c2e08019bd service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:11.607025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a7acd-ef06-4b73-8944-51c2e08019bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:11.607655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a7acd-ef06-4b73-8944-51c2e08019bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:11.684794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a7acd-ef06-4b73-8944-51c2e08019bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:11.686228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a7acd-ef06-4b73-8944-51c2e08019bd service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:11.696787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1232/2502] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:14.563371 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44827a-5598-47dd-b428-27f953d2c8b3 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:14.665780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44827a-5598-47dd-b428-27f953d2c8b3 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:14.671437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19546815-9723-4a42-b703-039adb9a71f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:14.672185 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19546815-9723-4a42-b703-039adb9a71f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:14.673368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19546815-9723-4a42-b703-039adb9a71f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:14.673368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19546815-9723-4a42-b703-039adb9a71f9 admin admin] PATH_INFO: `/v3/users/6ec5f2723b8641138fde18c3f004f1d8` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:14.674311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19546815-9723-4a42-b703-039adb9a71f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec5f2723b8641138fde18c3f004f1d8)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:14.676077 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19546815-9723-4a42-b703-039adb9a71f9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:14.734896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-19546815-9723-4a42-b703-039adb9a71f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec5f2723b8641138fde18c3f004f1d8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:14.742694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-19546815-9723-4a42-b703-039adb9a71f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec5f2723b8641138fde18c3f004f1d8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:14.756976 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-19546815-9723-4a42-b703-039adb9a71f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec5f2723b8641138fde18c3f004f1d8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:14.758024 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-19546815-9723-4a42-b703-039adb9a71f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec5f2723b8641138fde18c3f004f1d8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:14.778297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-19546815-9723-4a42-b703-039adb9a71f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec5f2723b8641138fde18c3f004f1d8'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:14.797781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1271/2503] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:14 2022] DELETE /identity/v3/users/6ec5f2723b8641138fde18c3f004f1d8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:14.805762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba21654-55e3-4858-865f-b9831b35a601 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:14.806945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba21654-55e3-4858-865f-b9831b35a601 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:14.806945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba21654-55e3-4858-865f-b9831b35a601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:14.835081 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-aba21654-55e3-4858-865f-b9831b35a601 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:14.836577 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-aba21654-55e3-4858-865f-b9831b35a601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:14.915749 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1233/2504] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:14.927048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19546815-9723-4a42-b703-039adb9a71f9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:14.928690 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-19546815-9723-4a42-b703-039adb9a71f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:14.983578 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:15.008177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19546815-9723-4a42-b703-039adb9a71f9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:15.015226 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160e35a-9113-4f63-a397-1de55ef302cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:15.016118 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160e35a-9113-4f63-a397-1de55ef302cb service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:15.016619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160e35a-9113-4f63-a397-1de55ef302cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:15.018048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160e35a-9113-4f63-a397-1de55ef302cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:15.033095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160e35a-9113-4f63-a397-1de55ef302cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:15.035984 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160e35a-9113-4f63-a397-1de55ef302cb service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:15.054580 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1272/2505] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:15.451361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba21654-55e3-4858-865f-b9831b35a601 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:15.452992 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-aba21654-55e3-4858-865f-b9831b35a601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:15.466568 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba21654-55e3-4858-865f-b9831b35a601 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:15.472164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2b4a0-7a10-4202-b536-63caee028703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:15.473165 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2b4a0-7a10-4202-b536-63caee028703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:15.473436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2b4a0-7a10-4202-b536-63caee028703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:15.473725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2b4a0-7a10-4202-b536-63caee028703 admin admin] PATH_INFO: `/v3/projects/4fe8c9bc30414dc0a55404e221501363` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:15.478246 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2b4a0-7a10-4202-b536-63caee028703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe8c9bc30414dc0a55404e221501363)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:15.480310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2b4a0-7a10-4202-b536-63caee028703 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:15.560163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:15.567942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c6d2b4a0-7a10-4202-b536-63caee028703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe8c9bc30414dc0a55404e221501363', 'request_id': 'req-c6d2b4a0-7a10-4202-b536-63caee028703'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:15.579399 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c6d2b4a0-7a10-4202-b536-63caee028703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe8c9bc30414dc0a55404e221501363', 'request_id': 'req-c6d2b4a0-7a10-4202-b536-63caee028703'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:15.588747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c6d2b4a0-7a10-4202-b536-63caee028703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe8c9bc30414dc0a55404e221501363', 'request_id': 'req-c6d2b4a0-7a10-4202-b536-63caee028703'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:15.603798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c6d2b4a0-7a10-4202-b536-63caee028703 admin admin] The token cache is being invalidate because project 4fe8c9bc30414dc0a55404e221501363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:15.604093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c6d2b4a0-7a10-4202-b536-63caee028703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:15.605206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-c6d2b4a0-7a10-4202-b536-63caee028703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:15.606934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1234/2506] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:15 2022] DELETE /identity/v3/projects/4fe8c9bc30414dc0a55404e221501363 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:15.611727 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160e35a-9113-4f63-a397-1de55ef302cb service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:15.623466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160e35a-9113-4f63-a397-1de55ef302cb service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:15.739317 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507e35f-a3d4-4ce1-85c1-87cffdddca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:15.740095 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507e35f-a3d4-4ce1-85c1-87cffdddca01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:15.746332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507e35f-a3d4-4ce1-85c1-87cffdddca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:15.746844 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507e35f-a3d4-4ce1-85c1-87cffdddca01 admin admin] PATH_INFO: `/v3/users/d47067996fa84773bc8ad3e4ddc6c576` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:15.749354 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507e35f-a3d4-4ce1-85c1-87cffdddca01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d47067996fa84773bc8ad3e4ddc6c576)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:15.754150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507e35f-a3d4-4ce1-85c1-87cffdddca01 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:15.847607 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6507e35f-a3d4-4ce1-85c1-87cffdddca01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd47067996fa84773bc8ad3e4ddc6c576'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:15.861114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6507e35f-a3d4-4ce1-85c1-87cffdddca01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd47067996fa84773bc8ad3e4ddc6c576'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:15.883204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6507e35f-a3d4-4ce1-85c1-87cffdddca01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd47067996fa84773bc8ad3e4ddc6c576'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:15.884380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6507e35f-a3d4-4ce1-85c1-87cffdddca01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd47067996fa84773bc8ad3e4ddc6c576'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:15.896653 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-6507e35f-a3d4-4ce1-85c1-87cffdddca01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd47067996fa84773bc8ad3e4ddc6c576'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:15.915814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1273/2507] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:15 2022] DELETE /identity/v3/users/d47067996fa84773bc8ad3e4ddc6c576 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:16.378597 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2b4a0-7a10-4202-b536-63caee028703 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:16.380879 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c6d2b4a0-7a10-4202-b536-63caee028703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:16.415071 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2b4a0-7a10-4202-b536-63caee028703 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:16.559664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62585d-1f2c-4b73-94c3-57bf9fbb65d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:16.560935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62585d-1f2c-4b73-94c3-57bf9fbb65d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:16.562331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62585d-1f2c-4b73-94c3-57bf9fbb65d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:16.563416 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62585d-1f2c-4b73-94c3-57bf9fbb65d2 admin admin] PATH_INFO: `/v3/projects/b18baf1bb14f49d1b3cc33e3297394a2` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:16.567172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62585d-1f2c-4b73-94c3-57bf9fbb65d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b18baf1bb14f49d1b3cc33e3297394a2)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:16.572794 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62585d-1f2c-4b73-94c3-57bf9fbb65d2 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:16.660381 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9d62585d-1f2c-4b73-94c3-57bf9fbb65d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b18baf1bb14f49d1b3cc33e3297394a2', 'request_id': 'req-9d62585d-1f2c-4b73-94c3-57bf9fbb65d2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:16.670999 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9d62585d-1f2c-4b73-94c3-57bf9fbb65d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b18baf1bb14f49d1b3cc33e3297394a2', 'request_id': 'req-9d62585d-1f2c-4b73-94c3-57bf9fbb65d2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:16.679664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9d62585d-1f2c-4b73-94c3-57bf9fbb65d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b18baf1bb14f49d1b3cc33e3297394a2', 'request_id': 'req-9d62585d-1f2c-4b73-94c3-57bf9fbb65d2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:16.692659 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9d62585d-1f2c-4b73-94c3-57bf9fbb65d2 admin admin] The token cache is being invalidate because project b18baf1bb14f49d1b3cc33e3297394a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:16.693333 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9d62585d-1f2c-4b73-94c3-57bf9fbb65d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:16.694052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-9d62585d-1f2c-4b73-94c3-57bf9fbb65d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:16.695724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1235/2508] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:16 2022] DELETE /identity/v3/projects/b18baf1bb14f49d1b3cc33e3297394a2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:16.701087 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e555bd-a9b6-48fa-96dd-ef28bad85e24 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:16.701741 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e555bd-a9b6-48fa-96dd-ef28bad85e24 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:16.701741 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e555bd-a9b6-48fa-96dd-ef28bad85e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:16.724736 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-26e555bd-a9b6-48fa-96dd-ef28bad85e24 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:16.726039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-26e555bd-a9b6-48fa-96dd-ef28bad85e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:16.813442 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:16.827218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1274/2509] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:16.837914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484f3d8-1da4-47c1-b516-0d336480ddb9 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:16.840053 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484f3d8-1da4-47c1-b516-0d336480ddb9 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:16.840767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484f3d8-1da4-47c1-b516-0d336480ddb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:16.877907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-7484f3d8-1da4-47c1-b516-0d336480ddb9 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:16.879795 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7484f3d8-1da4-47c1-b516-0d336480ddb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:16.893826 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1236/2510] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:16.898466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e555bd-a9b6-48fa-96dd-ef28bad85e24 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:16.909218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e555bd-a9b6-48fa-96dd-ef28bad85e24 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:16.914481 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457cf43-4b1f-4c46-af0d-a9c3d2ba466f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:16.915013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457cf43-4b1f-4c46-af0d-a9c3d2ba466f admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:16.915281 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457cf43-4b1f-4c46-af0d-a9c3d2ba466f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:16.915545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457cf43-4b1f-4c46-af0d-a9c3d2ba466f admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:16.916205 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457cf43-4b1f-4c46-af0d-a9c3d2ba466f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:28:16.916502 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457cf43-4b1f-4c46-af0d-a9c3d2ba466f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:16.918192 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457cf43-4b1f-4c46-af0d-a9c3d2ba466f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:16.940240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1275/2511] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:28:16.945544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484f3d8-1da4-47c1-b516-0d336480ddb9 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:16.958971 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484f3d8-1da4-47c1-b516-0d336480ddb9 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:16.967307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d776c-b8f0-4fb5-80e8-562b502d3221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:16.968293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d776c-b8f0-4fb5-80e8-562b502d3221 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:16.968767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d776c-b8f0-4fb5-80e8-562b502d3221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:16.969244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d776c-b8f0-4fb5-80e8-562b502d3221 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:16.970790 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d776c-b8f0-4fb5-80e8-562b502d3221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:16.974305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d776c-b8f0-4fb5-80e8-562b502d3221 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.017174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1237/2512] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:16 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:28:17.022694 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457cf43-4b1f-4c46-af0d-a9c3d2ba466f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.039951 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457cf43-4b1f-4c46-af0d-a9c3d2ba466f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.117195 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f611c-4cbc-445d-ae5e-bad93992d70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.117975 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f611c-4cbc-445d-ae5e-bad93992d70c admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.118698 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f611c-4cbc-445d-ae5e-bad93992d70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.118998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f611c-4cbc-445d-ae5e-bad93992d70c admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.123122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f611c-4cbc-445d-ae5e-bad93992d70c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.125007 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f611c-4cbc-445d-ae5e-bad93992d70c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.157549 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1276/2513] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:17 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:17.162473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d776c-b8f0-4fb5-80e8-562b502d3221 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.174945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d776c-b8f0-4fb5-80e8-562b502d3221 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.180911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7758b6-7993-4114-ad34-4635eaa3b2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.183310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7758b6-7993-4114-ad34-4635eaa3b2ac admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.183310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7758b6-7993-4114-ad34-4635eaa3b2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.183310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7758b6-7993-4114-ad34-4635eaa3b2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.183310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7758b6-7993-4114-ad34-4635eaa3b2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.184483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7758b6-7993-4114-ad34-4635eaa3b2ac admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.200527 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1238/2514] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:17.202869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f611c-4cbc-445d-ae5e-bad93992d70c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.216783 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f611c-4cbc-445d-ae5e-bad93992d70c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.222130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10713a84-0e76-4981-9949-b91310fc8006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.223157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10713a84-0e76-4981-9949-b91310fc8006 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.223606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10713a84-0e76-4981-9949-b91310fc8006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.224033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10713a84-0e76-4981-9949-b91310fc8006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.224911 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10713a84-0e76-4981-9949-b91310fc8006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.227078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10713a84-0e76-4981-9949-b91310fc8006 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.240809 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1277/2515] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:17.245341 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7758b6-7993-4114-ad34-4635eaa3b2ac admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.259265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7758b6-7993-4114-ad34-4635eaa3b2ac admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.264300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eee33-4495-4863-b642-9d3cbc6fce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.265102 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eee33-4495-4863-b642-9d3cbc6fce49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.265440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eee33-4495-4863-b642-9d3cbc6fce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.265833 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eee33-4495-4863-b642-9d3cbc6fce49 admin admin] PATH_INFO: `/v3/projects/d5831eab7b7148c78ec5765f9a154f3c/users/c3bc3cd46e3a49a9ac10dca122ef215c/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.295052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254eee33-4495-4863-b642-9d3cbc6fce49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5831eab7b7148c78ec5765f9a154f3c, user_id=c3bc3cd46e3a49a9ac10dca122ef215c, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.300058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254eee33-4495-4863-b642-9d3cbc6fce49 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.312560 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:17.320212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1239/2516] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:17 2022] PUT /identity/v3/projects/d5831eab7b7148c78ec5765f9a154f3c/users/c3bc3cd46e3a49a9ac10dca122ef215c/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:17.334313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1618e-6c6b-4b1c-b745-904518201918 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.334788 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1618e-6c6b-4b1c-b745-904518201918 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.335233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1618e-6c6b-4b1c-b745-904518201918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.374313 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-aaa1618e-6c6b-4b1c-b745-904518201918 None None] MFA Rules not processed for user `c3bc3cd46e3a49a9ac10dca122ef215c`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:17.375766 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-aaa1618e-6c6b-4b1c-b745-904518201918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:17.463781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1278/2517] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:17.468824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eee33-4495-4863-b642-9d3cbc6fce49 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.548913 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eee33-4495-4863-b642-9d3cbc6fce49 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.555649 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cda66d-0380-4e01-93ec-6cf0ff0dd7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.556421 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cda66d-0380-4e01-93ec-6cf0ff0dd7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.556760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cda66d-0380-4e01-93ec-6cf0ff0dd7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.557130 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cda66d-0380-4e01-93ec-6cf0ff0dd7a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.558016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cda66d-0380-4e01-93ec-6cf0ff0dd7a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.560672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cda66d-0380-4e01-93ec-6cf0ff0dd7a1 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.602795 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1240/2518] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:17 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:28:17.607675 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1618e-6c6b-4b1c-b745-904518201918 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.624042 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1618e-6c6b-4b1c-b745-904518201918 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.715164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:17.723293 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fc763-c238-4ee3-8776-24ab39a72b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.724222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fc763-c238-4ee3-8776-24ab39a72b23 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.724556 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fc763-c238-4ee3-8776-24ab39a72b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.724817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fc763-c238-4ee3-8776-24ab39a72b23 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.725489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fc763-c238-4ee3-8776-24ab39a72b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.727472 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fc763-c238-4ee3-8776-24ab39a72b23 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.751452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1279/2519] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:17 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:17.755814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cda66d-0380-4e01-93ec-6cf0ff0dd7a1 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.766693 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cda66d-0380-4e01-93ec-6cf0ff0dd7a1 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.771671 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12a075-516b-468e-bfe3-67fe0438e79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.772293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12a075-516b-468e-bfe3-67fe0438e79b admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.772562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12a075-516b-468e-bfe3-67fe0438e79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.772823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12a075-516b-468e-bfe3-67fe0438e79b admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.773472 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12a075-516b-468e-bfe3-67fe0438e79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.775138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12a075-516b-468e-bfe3-67fe0438e79b admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.787517 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1241/2520] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:17.792487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fc763-c238-4ee3-8776-24ab39a72b23 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.805220 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fc763-c238-4ee3-8776-24ab39a72b23 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.813338 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee90f5-b079-4710-a33f-5c7ddae41265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.814611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee90f5-b079-4710-a33f-5c7ddae41265 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.815087 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee90f5-b079-4710-a33f-5c7ddae41265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.815584 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee90f5-b079-4710-a33f-5c7ddae41265 admin admin] PATH_INFO: `/v3/projects/c6d5cb55b4a54b268a4ca28455de9877/users/a495822d70824423bb3e37768f67acf9/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.842390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee90f5-b079-4710-a33f-5c7ddae41265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d5cb55b4a54b268a4ca28455de9877, user_id=a495822d70824423bb3e37768f67acf9, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.847762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee90f5-b079-4710-a33f-5c7ddae41265 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.865921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1280/2521] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:17 2022] PUT /identity/v3/projects/c6d5cb55b4a54b268a4ca28455de9877/users/a495822d70824423bb3e37768f67acf9/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:17.870391 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12a075-516b-468e-bfe3-67fe0438e79b admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.881891 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12a075-516b-468e-bfe3-67fe0438e79b admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.944039 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703ed5c-bd68-46fc-817f-7bda89bf2a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.944686 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703ed5c-bd68-46fc-817f-7bda89bf2a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.944960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703ed5c-bd68-46fc-817f-7bda89bf2a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.945227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703ed5c-bd68-46fc-817f-7bda89bf2a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.945925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703ed5c-bd68-46fc-817f-7bda89bf2a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.947645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703ed5c-bd68-46fc-817f-7bda89bf2a9e admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:17.959236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1242/2522] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:17.963945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee90f5-b079-4710-a33f-5c7ddae41265 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:17.975343 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee90f5-b079-4710-a33f-5c7ddae41265 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:17.980584 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d732b62-1f80-4c95-b803-36f0be3d012b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:17.981283 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d732b62-1f80-4c95-b803-36f0be3d012b admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:17.981576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d732b62-1f80-4c95-b803-36f0be3d012b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:17.981867 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d732b62-1f80-4c95-b803-36f0be3d012b admin admin] PATH_INFO: `/v3/projects/c6d5cb55b4a54b268a4ca28455de9877/users/a495822d70824423bb3e37768f67acf9/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:17.984421 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d732b62-1f80-4c95-b803-36f0be3d012b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d5cb55b4a54b268a4ca28455de9877, user_id=a495822d70824423bb3e37768f67acf9, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:17.987255 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d732b62-1f80-4c95-b803-36f0be3d012b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:18.009044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1281/2523] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:17 2022] PUT /identity/v3/projects/c6d5cb55b4a54b268a4ca28455de9877/users/a495822d70824423bb3e37768f67acf9/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:18.021337 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bee24-2699-4ebe-9d10-35f87800a188 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:18.021703 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bee24-2699-4ebe-9d10-35f87800a188 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:18.022054 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bee24-2699-4ebe-9d10-35f87800a188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:18.056640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-f79bee24-2699-4ebe-9d10-35f87800a188 None None] MFA Rules not processed for user `a495822d70824423bb3e37768f67acf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:18.057919 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f79bee24-2699-4ebe-9d10-35f87800a188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:18.159627 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:18.178038 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1243/2524] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:18.190081 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d732b62-1f80-4c95-b803-36f0be3d012b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:18.192188 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1d732b62-1f80-4c95-b803-36f0be3d012b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:18.286443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d732b62-1f80-4c95-b803-36f0be3d012b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:18.290487 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335723e4-5db5-4fc5-83d9-c4d6d107101e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:18.291178 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335723e4-5db5-4fc5-83d9-c4d6d107101e service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:18.291491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335723e4-5db5-4fc5-83d9-c4d6d107101e service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:18.291857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335723e4-5db5-4fc5-83d9-c4d6d107101e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:18.361257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335723e4-5db5-4fc5-83d9-c4d6d107101e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:18.362876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335723e4-5db5-4fc5-83d9-c4d6d107101e service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:18.374895 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1282/2525] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:19.861742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bee24-2699-4ebe-9d10-35f87800a188 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:19.864096 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f79bee24-2699-4ebe-9d10-35f87800a188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:19.955445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bee24-2699-4ebe-9d10-35f87800a188 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:19.961348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dff6ab-e3a9-4898-8855-e67b4b6fbce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:19.962202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dff6ab-e3a9-4898-8855-e67b4b6fbce7 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:19.962655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dff6ab-e3a9-4898-8855-e67b4b6fbce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:19.963129 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dff6ab-e3a9-4898-8855-e67b4b6fbce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:19.966134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-15dff6ab-e3a9-4898-8855-e67b4b6fbce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:20.071574 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dff6ab-e3a9-4898-8855-e67b4b6fbce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:20.073605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dff6ab-e3a9-4898-8855-e67b4b6fbce7 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:20.094841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1244/2526] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:21.191314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335723e4-5db5-4fc5-83d9-c4d6d107101e service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:21.194663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-335723e4-5db5-4fc5-83d9-c4d6d107101e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:21.217212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335723e4-5db5-4fc5-83d9-c4d6d107101e service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:21.223988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8550de8-6374-414b-9830-62738f59ecec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:21.225347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8550de8-6374-414b-9830-62738f59ecec service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:21.226003 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8550de8-6374-414b-9830-62738f59ecec service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:21.226619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8550de8-6374-414b-9830-62738f59ecec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:21.240707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8550de8-6374-414b-9830-62738f59ecec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:21.242459 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8550de8-6374-414b-9830-62738f59ecec service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:21.254341 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1283/2527] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:24.449117 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dff6ab-e3a9-4898-8855-e67b4b6fbce7 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:24.452055 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-15dff6ab-e3a9-4898-8855-e67b4b6fbce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:24.468483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dff6ab-e3a9-4898-8855-e67b4b6fbce7 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:24.487527 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bfe21-918c-4e5d-88e3-fa8e173f7f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:24.488526 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bfe21-918c-4e5d-88e3-fa8e173f7f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:24.488951 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bfe21-918c-4e5d-88e3-fa8e173f7f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:24.489119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bfe21-918c-4e5d-88e3-fa8e173f7f9d admin admin] PATH_INFO: `/v3/users/84405f12c84a40d79493e02276e65266` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:24.491898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bfe21-918c-4e5d-88e3-fa8e173f7f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=84405f12c84a40d79493e02276e65266)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:24.493942 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bfe21-918c-4e5d-88e3-fa8e173f7f9d admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:24.574304 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7e3bfe21-918c-4e5d-88e3-fa8e173f7f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84405f12c84a40d79493e02276e65266'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:24.585415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7e3bfe21-918c-4e5d-88e3-fa8e173f7f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84405f12c84a40d79493e02276e65266'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:24.586270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7e3bfe21-918c-4e5d-88e3-fa8e173f7f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84405f12c84a40d79493e02276e65266'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:24.596157 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7e3bfe21-918c-4e5d-88e3-fa8e173f7f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84405f12c84a40d79493e02276e65266'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:24.613521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7e3bfe21-918c-4e5d-88e3-fa8e173f7f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84405f12c84a40d79493e02276e65266'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:24.621252 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1245/2528] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:24 2022] DELETE /identity/v3/users/84405f12c84a40d79493e02276e65266 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:24.838838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8550de8-6374-414b-9830-62738f59ecec service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:24.852437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8550de8-6374-414b-9830-62738f59ecec service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:24.936081 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:24.950750 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac51510-a7ea-4465-94d3-67b818d14dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:24.951415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac51510-a7ea-4465-94d3-67b818d14dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:24.951680 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac51510-a7ea-4465-94d3-67b818d14dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:24.951961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac51510-a7ea-4465-94d3-67b818d14dea admin admin] PATH_INFO: `/v3/projects/ab74bccfe94f40b8939f415d93976b2d` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:24.953314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac51510-a7ea-4465-94d3-67b818d14dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab74bccfe94f40b8939f415d93976b2d)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:24.955425 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac51510-a7ea-4465-94d3-67b818d14dea admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:25.021028 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3ac51510-a7ea-4465-94d3-67b818d14dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab74bccfe94f40b8939f415d93976b2d', 'request_id': 'req-3ac51510-a7ea-4465-94d3-67b818d14dea'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:25.030901 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3ac51510-a7ea-4465-94d3-67b818d14dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab74bccfe94f40b8939f415d93976b2d', 'request_id': 'req-3ac51510-a7ea-4465-94d3-67b818d14dea'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:25.042369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3ac51510-a7ea-4465-94d3-67b818d14dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab74bccfe94f40b8939f415d93976b2d', 'request_id': 'req-3ac51510-a7ea-4465-94d3-67b818d14dea'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:25.060037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3ac51510-a7ea-4465-94d3-67b818d14dea admin admin] The token cache is being invalidate because project ab74bccfe94f40b8939f415d93976b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:25.060362 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3ac51510-a7ea-4465-94d3-67b818d14dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:25.062164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-3ac51510-a7ea-4465-94d3-67b818d14dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:25.063850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1284/2529] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:24 2022] DELETE /identity/v3/projects/ab74bccfe94f40b8939f415d93976b2d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:25.069433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915862a-4b69-4991-935d-bbea142aedb5 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:25.069754 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915862a-4b69-4991-935d-bbea142aedb5 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:25.070029 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915862a-4b69-4991-935d-bbea142aedb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:25.095579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-c915862a-4b69-4991-935d-bbea142aedb5 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:25.097888 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c915862a-4b69-4991-935d-bbea142aedb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:25.120668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:25.206619 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1246/2530] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:25.215987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcdd03-c6ac-470d-9ef6-01d238f990f4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:25.216263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcdd03-c6ac-470d-9ef6-01d238f990f4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:25.216518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcdd03-c6ac-470d-9ef6-01d238f990f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:25.241389 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-dddcdd03-c6ac-470d-9ef6-01d238f990f4 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:25.243221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dddcdd03-c6ac-470d-9ef6-01d238f990f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:25.253793 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1285/2531] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:25.258433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915862a-4b69-4991-935d-bbea142aedb5 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:25.268500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915862a-4b69-4991-935d-bbea142aedb5 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:25.273394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c0f0e-3bdc-43f8-8ca4-6f8af4e54c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:25.274051 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c0f0e-3bdc-43f8-8ca4-6f8af4e54c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:25.274298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c0f0e-3bdc-43f8-8ca4-6f8af4e54c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:25.274586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c0f0e-3bdc-43f8-8ca4-6f8af4e54c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:25.275273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c0f0e-3bdc-43f8-8ca4-6f8af4e54c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:28:25.275568 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c0f0e-3bdc-43f8-8ca4-6f8af4e54c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:25.277192 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c0f0e-3bdc-43f8-8ca4-6f8af4e54c60 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:25.289957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1247/2532] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:28:25.294658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcdd03-c6ac-470d-9ef6-01d238f990f4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:25.304663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcdd03-c6ac-470d-9ef6-01d238f990f4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:25.309801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b66733-9c28-4a6c-92f6-89208009abd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:25.310433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b66733-9c28-4a6c-92f6-89208009abd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:25.310708 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b66733-9c28-4a6c-92f6-89208009abd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:25.310976 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b66733-9c28-4a6c-92f6-89208009abd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:25.311608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b66733-9c28-4a6c-92f6-89208009abd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:25.313604 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b66733-9c28-4a6c-92f6-89208009abd1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:25.345478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1286/2533] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:25 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:25.350554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c0f0e-3bdc-43f8-8ca4-6f8af4e54c60 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:25.362169 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c0f0e-3bdc-43f8-8ca4-6f8af4e54c60 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:25.443867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445503a-50bb-4a63-a426-cdc4d4d9120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:25.444607 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445503a-50bb-4a63-a426-cdc4d4d9120f admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:25.444966 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445503a-50bb-4a63-a426-cdc4d4d9120f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:25.445323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445503a-50bb-4a63-a426-cdc4d4d9120f admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:25.446103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445503a-50bb-4a63-a426-cdc4d4d9120f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:25.448176 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445503a-50bb-4a63-a426-cdc4d4d9120f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:25.471808 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1248/2534] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:25 2022] POST /identity/v3/users => generated 282 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:25.478838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b66733-9c28-4a6c-92f6-89208009abd1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:25.500807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b66733-9c28-4a6c-92f6-89208009abd1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:25.513470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fa9ca-3c25-407d-91e8-50b7ca14fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:25.514202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fa9ca-3c25-407d-91e8-50b7ca14fa91 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:25.514584 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fa9ca-3c25-407d-91e8-50b7ca14fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:25.514899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16fa9ca-3c25-407d-91e8-50b7ca14fa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:25.515559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16fa9ca-3c25-407d-91e8-50b7ca14fa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:25.518176 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16fa9ca-3c25-407d-91e8-50b7ca14fa91 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:25.531959 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1287/2535] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:28:25.536944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445503a-50bb-4a63-a426-cdc4d4d9120f admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:25.553691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445503a-50bb-4a63-a426-cdc4d4d9120f admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:25.563642 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c3578-af41-4aa8-88a8-7087ccc1f403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:25.564842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c3578-af41-4aa8-88a8-7087ccc1f403 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:25.565247 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c3578-af41-4aa8-88a8-7087ccc1f403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:25.565688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c3578-af41-4aa8-88a8-7087ccc1f403 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:25.566803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c3578-af41-4aa8-88a8-7087ccc1f403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:25.570041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c3578-af41-4aa8-88a8-7087ccc1f403 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:25.601881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1249/2536] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:25.603572 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fa9ca-3c25-407d-91e8-50b7ca14fa91 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:25.621948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16fa9ca-3c25-407d-91e8-50b7ca14fa91 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:25.628665 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee9daf-d144-41d6-96f4-458c8e1500ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:25.629550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee9daf-d144-41d6-96f4-458c8e1500ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:25.629962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee9daf-d144-41d6-96f4-458c8e1500ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:25.630336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee9daf-d144-41d6-96f4-458c8e1500ae admin admin] PATH_INFO: `/v3/projects/f80ad8397a8b4ba2abbf3270082feff5/users/baebf9ded25b4d289d5070e51e3febdb/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:25.652306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee9daf-d144-41d6-96f4-458c8e1500ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80ad8397a8b4ba2abbf3270082feff5, user_id=baebf9ded25b4d289d5070e51e3febdb, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:25.655497 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee9daf-d144-41d6-96f4-458c8e1500ae admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:25.681664 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1288/2537] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:25 2022] PUT /identity/v3/projects/f80ad8397a8b4ba2abbf3270082feff5/users/baebf9ded25b4d289d5070e51e3febdb/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:25.693739 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82abc48-6a04-4285-9866-a5fab0149718 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:25.694246 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82abc48-6a04-4285-9866-a5fab0149718 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:25.694732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82abc48-6a04-4285-9866-a5fab0149718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:25.746600 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-c82abc48-6a04-4285-9866-a5fab0149718 None None] MFA Rules not processed for user `baebf9ded25b4d289d5070e51e3febdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:25.747984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c82abc48-6a04-4285-9866-a5fab0149718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:25.835112 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1250/2538] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:25.840404 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee9daf-d144-41d6-96f4-458c8e1500ae admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:25.949637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee9daf-d144-41d6-96f4-458c8e1500ae admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:25.957240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebe6d4-f00e-47bf-9076-ecfab55389b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:25.958301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebe6d4-f00e-47bf-9076-ecfab55389b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:25.958857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebe6d4-f00e-47bf-9076-ecfab55389b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:25.959368 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebe6d4-f00e-47bf-9076-ecfab55389b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:25.960377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebe6d4-f00e-47bf-9076-ecfab55389b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:25.962421 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebe6d4-f00e-47bf-9076-ecfab55389b5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:25.991637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:26.004583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1289/2539] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:25 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:26.010720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82abc48-6a04-4285-9866-a5fab0149718 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:26.027928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82abc48-6a04-4285-9866-a5fab0149718 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:26.038694 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:26.104561 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ed143-a96f-4d33-bbf7-0bc6b99ae6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:26.105165 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ed143-a96f-4d33-bbf7-0bc6b99ae6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:26.105435 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ed143-a96f-4d33-bbf7-0bc6b99ae6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:26.105726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ed143-a96f-4d33-bbf7-0bc6b99ae6c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:26.106352 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ed143-a96f-4d33-bbf7-0bc6b99ae6c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:26.108650 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ed143-a96f-4d33-bbf7-0bc6b99ae6c3 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:26.133646 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1251/2540] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:26 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:26.138632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebe6d4-f00e-47bf-9076-ecfab55389b5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:26.150513 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebe6d4-f00e-47bf-9076-ecfab55389b5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:26.155871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451d804-ef11-47f8-be52-ddbd3cfa902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:26.156508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451d804-ef11-47f8-be52-ddbd3cfa902d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:26.156790 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451d804-ef11-47f8-be52-ddbd3cfa902d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:26.157040 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451d804-ef11-47f8-be52-ddbd3cfa902d admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:26.157725 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451d804-ef11-47f8-be52-ddbd3cfa902d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:26.159371 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451d804-ef11-47f8-be52-ddbd3cfa902d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:26.171231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1290/2541] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:26.176356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ed143-a96f-4d33-bbf7-0bc6b99ae6c3 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:26.186979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ed143-a96f-4d33-bbf7-0bc6b99ae6c3 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:26.191950 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9830e-9e91-4224-8322-e9a21ff72136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:26.192633 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9830e-9e91-4224-8322-e9a21ff72136 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:26.192913 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9830e-9e91-4224-8322-e9a21ff72136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:26.193344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9830e-9e91-4224-8322-e9a21ff72136 admin admin] PATH_INFO: `/v3/projects/65da6e324b5547959367b8f983c98a3b/users/30f844bb32f54227bb1d56ca38f5d6dd/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:26.212410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9830e-9e91-4224-8322-e9a21ff72136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65da6e324b5547959367b8f983c98a3b, user_id=30f844bb32f54227bb1d56ca38f5d6dd, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:26.215178 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9830e-9e91-4224-8322-e9a21ff72136 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:26.230573 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1252/2542] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:26 2022] PUT /identity/v3/projects/65da6e324b5547959367b8f983c98a3b/users/30f844bb32f54227bb1d56ca38f5d6dd/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:26.236537 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451d804-ef11-47f8-be52-ddbd3cfa902d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:26.247174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451d804-ef11-47f8-be52-ddbd3cfa902d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:26.339918 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8b529-18d7-48ae-860e-b68e35083ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:26.340610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8b529-18d7-48ae-860e-b68e35083ecd admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:26.340927 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8b529-18d7-48ae-860e-b68e35083ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:26.341239 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8b529-18d7-48ae-860e-b68e35083ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:26.342121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8b529-18d7-48ae-860e-b68e35083ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:26.343854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8b529-18d7-48ae-860e-b68e35083ecd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:26.356439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1291/2543] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:26.362305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9830e-9e91-4224-8322-e9a21ff72136 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:26.373460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9830e-9e91-4224-8322-e9a21ff72136 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:26.378475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2728aeb-8cb9-41fc-afb0-a3abce6cf7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:26.379164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2728aeb-8cb9-41fc-afb0-a3abce6cf7f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:26.379435 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2728aeb-8cb9-41fc-afb0-a3abce6cf7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:26.379702 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2728aeb-8cb9-41fc-afb0-a3abce6cf7f9 admin admin] PATH_INFO: `/v3/projects/65da6e324b5547959367b8f983c98a3b/users/30f844bb32f54227bb1d56ca38f5d6dd/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:26.381881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2728aeb-8cb9-41fc-afb0-a3abce6cf7f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65da6e324b5547959367b8f983c98a3b, user_id=30f844bb32f54227bb1d56ca38f5d6dd, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:26.384598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2728aeb-8cb9-41fc-afb0-a3abce6cf7f9 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:26.396573 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1253/2544] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:26 2022] PUT /identity/v3/projects/65da6e324b5547959367b8f983c98a3b/users/30f844bb32f54227bb1d56ca38f5d6dd/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:26.409878 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f9532-5d35-4fe8-8818-c505826cafaf None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:26.410284 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f9532-5d35-4fe8-8818-c505826cafaf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:26.410823 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f9532-5d35-4fe8-8818-c505826cafaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:26.443671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-890f9532-5d35-4fe8-8818-c505826cafaf None None] MFA Rules not processed for user `30f844bb32f54227bb1d56ca38f5d6dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:26.444944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-890f9532-5d35-4fe8-8818-c505826cafaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:26.525458 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1292/2545] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:26.539000 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2728aeb-8cb9-41fc-afb0-a3abce6cf7f9 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:26.541015 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a2728aeb-8cb9-41fc-afb0-a3abce6cf7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:26.624731 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2728aeb-8cb9-41fc-afb0-a3abce6cf7f9 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:26.628917 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334ae9-203f-4ad3-9348-334245cac68e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:26.629681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334ae9-203f-4ad3-9348-334245cac68e service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:26.630042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334ae9-203f-4ad3-9348-334245cac68e service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:26.630583 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49334ae9-203f-4ad3-9348-334245cac68e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:26.641097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49334ae9-203f-4ad3-9348-334245cac68e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:26.642605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49334ae9-203f-4ad3-9348-334245cac68e service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:26.654123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1254/2546] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:26.741701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f9532-5d35-4fe8-8818-c505826cafaf None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:26.752319 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f9532-5d35-4fe8-8818-c505826cafaf None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:26.756276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ae942-aa15-4c34-bf47-22bda383e238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:26.756914 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ae942-aa15-4c34-bf47-22bda383e238 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:26.757192 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ae942-aa15-4c34-bf47-22bda383e238 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:26.757462 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ae942-aa15-4c34-bf47-22bda383e238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:26.824960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ae942-aa15-4c34-bf47-22bda383e238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:26.826669 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ae942-aa15-4c34-bf47-22bda383e238 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:26.841168 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1293/2547] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:28:34.353022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334ae9-203f-4ad3-9348-334245cac68e service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:34.416760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49334ae9-203f-4ad3-9348-334245cac68e service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:34.421998 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b3963-30f7-4e75-9da8-d2f83f5b7620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:34.422667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b3963-30f7-4e75-9da8-d2f83f5b7620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:34.422955 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b3963-30f7-4e75-9da8-d2f83f5b7620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:34.423245 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b3963-30f7-4e75-9da8-d2f83f5b7620 admin admin] PATH_INFO: `/v3/users/baebf9ded25b4d289d5070e51e3febdb` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:34.424461 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b3963-30f7-4e75-9da8-d2f83f5b7620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baebf9ded25b4d289d5070e51e3febdb)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:34.426442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b3963-30f7-4e75-9da8-d2f83f5b7620 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:34.438920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:34.486704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f31b3963-30f7-4e75-9da8-d2f83f5b7620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baebf9ded25b4d289d5070e51e3febdb'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:34.504109 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f31b3963-30f7-4e75-9da8-d2f83f5b7620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baebf9ded25b4d289d5070e51e3febdb'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:34.504784 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f31b3963-30f7-4e75-9da8-d2f83f5b7620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baebf9ded25b4d289d5070e51e3febdb'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:34.512660 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f31b3963-30f7-4e75-9da8-d2f83f5b7620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baebf9ded25b4d289d5070e51e3febdb'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:34.529985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f31b3963-30f7-4e75-9da8-d2f83f5b7620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baebf9ded25b4d289d5070e51e3febdb'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:34.536783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1255/2548] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:34 2022] DELETE /identity/v3/users/baebf9ded25b4d289d5070e51e3febdb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:34.543008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf4729-1465-461e-b488-c41c1179cbf9 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:34.543591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf4729-1465-461e-b488-c41c1179cbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:34.543591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf4729-1465-461e-b488-c41c1179cbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:34.565105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-feaf4729-1465-461e-b488-c41c1179cbf9 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:34.566445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-feaf4729-1465-461e-b488-c41c1179cbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:34.571540 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:34.635217 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1294/2549] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:34.646983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b3963-30f7-4e75-9da8-d2f83f5b7620 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:34.648823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f31b3963-30f7-4e75-9da8-d2f83f5b7620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:34.717193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b3963-30f7-4e75-9da8-d2f83f5b7620 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:34.729736 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b70f34-a045-4409-8646-314acb70983e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:34.730436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b70f34-a045-4409-8646-314acb70983e service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:34.730704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b70f34-a045-4409-8646-314acb70983e service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:34.731007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b70f34-a045-4409-8646-314acb70983e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:34.745674 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b70f34-a045-4409-8646-314acb70983e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:34.747027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b70f34-a045-4409-8646-314acb70983e service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:34.757492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1256/2550] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:34.885835 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf4729-1465-461e-b488-c41c1179cbf9 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:34.887471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-feaf4729-1465-461e-b488-c41c1179cbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:34.902223 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf4729-1465-461e-b488-c41c1179cbf9 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:34.907593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732b8b3-f409-421d-94d8-ce3496bb03f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:34.908388 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732b8b3-f409-421d-94d8-ce3496bb03f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:34.908671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732b8b3-f409-421d-94d8-ce3496bb03f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:34.908945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732b8b3-f409-421d-94d8-ce3496bb03f9 admin admin] PATH_INFO: `/v3/users/c3bc3cd46e3a49a9ac10dca122ef215c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:34.910245 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732b8b3-f409-421d-94d8-ce3496bb03f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3bc3cd46e3a49a9ac10dca122ef215c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:34.912281 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732b8b3-f409-421d-94d8-ce3496bb03f9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:34.983794 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d732b8b3-f409-421d-94d8-ce3496bb03f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3bc3cd46e3a49a9ac10dca122ef215c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:34.993367 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d732b8b3-f409-421d-94d8-ce3496bb03f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3bc3cd46e3a49a9ac10dca122ef215c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:35.007093 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d732b8b3-f409-421d-94d8-ce3496bb03f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3bc3cd46e3a49a9ac10dca122ef215c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:35.007827 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d732b8b3-f409-421d-94d8-ce3496bb03f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3bc3cd46e3a49a9ac10dca122ef215c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:35.017469 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d732b8b3-f409-421d-94d8-ce3496bb03f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3bc3cd46e3a49a9ac10dca122ef215c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:35.025765 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1295/2551] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:34 2022] DELETE /identity/v3/users/c3bc3cd46e3a49a9ac10dca122ef215c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:35.031496 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43158f5a-26c5-4ba1-a5ff-5d5f70135780 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:35.031902 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43158f5a-26c5-4ba1-a5ff-5d5f70135780 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:35.032218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43158f5a-26c5-4ba1-a5ff-5d5f70135780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:35.062817 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-43158f5a-26c5-4ba1-a5ff-5d5f70135780 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:35.065008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-43158f5a-26c5-4ba1-a5ff-5d5f70135780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:35.129753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732b8b3-f409-421d-94d8-ce3496bb03f9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:35.131753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d732b8b3-f409-421d-94d8-ce3496bb03f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:35.151227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1257/2552] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:35.161448 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43158f5a-26c5-4ba1-a5ff-5d5f70135780 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:35.164666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-43158f5a-26c5-4ba1-a5ff-5d5f70135780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:35.217839 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732b8b3-f409-421d-94d8-ce3496bb03f9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:35.221661 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:35.223330 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342cb6f-3635-43c8-b2ad-db11c9194996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:35.224175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342cb6f-3635-43c8-b2ad-db11c9194996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:35.224556 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342cb6f-3635-43c8-b2ad-db11c9194996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:35.224827 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342cb6f-3635-43c8-b2ad-db11c9194996 admin admin] PATH_INFO: `/v3/projects/f80ad8397a8b4ba2abbf3270082feff5` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:35.226319 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342cb6f-3635-43c8-b2ad-db11c9194996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80ad8397a8b4ba2abbf3270082feff5)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:35.228202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342cb6f-3635-43c8-b2ad-db11c9194996 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:35.259336 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43158f5a-26c5-4ba1-a5ff-5d5f70135780 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:35.261141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:35.265943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca8016-cfef-4496-a6e5-c44e77df4c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:35.266705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca8016-cfef-4496-a6e5-c44e77df4c5f service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:35.266977 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca8016-cfef-4496-a6e5-c44e77df4c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:35.267409 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca8016-cfef-4496-a6e5-c44e77df4c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:35.279586 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca8016-cfef-4496-a6e5-c44e77df4c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:35.281177 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca8016-cfef-4496-a6e5-c44e77df4c5f service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:35.291122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8342cb6f-3635-43c8-b2ad-db11c9194996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80ad8397a8b4ba2abbf3270082feff5', 'request_id': 'req-8342cb6f-3635-43c8-b2ad-db11c9194996'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:35.294787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1258/2553] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:35.298190 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8342cb6f-3635-43c8-b2ad-db11c9194996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80ad8397a8b4ba2abbf3270082feff5', 'request_id': 'req-8342cb6f-3635-43c8-b2ad-db11c9194996'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:35.308370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8342cb6f-3635-43c8-b2ad-db11c9194996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80ad8397a8b4ba2abbf3270082feff5', 'request_id': 'req-8342cb6f-3635-43c8-b2ad-db11c9194996'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:35.324423 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8342cb6f-3635-43c8-b2ad-db11c9194996 admin admin] The token cache is being invalidate because project f80ad8397a8b4ba2abbf3270082feff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:35.324883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8342cb6f-3635-43c8-b2ad-db11c9194996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:35.325820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8342cb6f-3635-43c8-b2ad-db11c9194996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:35.327803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1296/2554] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:35 2022] DELETE /identity/v3/projects/f80ad8397a8b4ba2abbf3270082feff5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:35.332300 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca8016-cfef-4496-a6e5-c44e77df4c5f service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:35.346974 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca8016-cfef-4496-a6e5-c44e77df4c5f service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:35.442626 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04579a-fe97-4c29-b938-e7fa33abc7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:35.443389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04579a-fe97-4c29-b938-e7fa33abc7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:35.443712 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04579a-fe97-4c29-b938-e7fa33abc7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:35.444001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04579a-fe97-4c29-b938-e7fa33abc7e7 admin admin] PATH_INFO: `/v3/users/30f844bb32f54227bb1d56ca38f5d6dd` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:35.445723 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04579a-fe97-4c29-b938-e7fa33abc7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f844bb32f54227bb1d56ca38f5d6dd)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:35.448501 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04579a-fe97-4c29-b938-e7fa33abc7e7 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:35.535073 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cb04579a-fe97-4c29-b938-e7fa33abc7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f844bb32f54227bb1d56ca38f5d6dd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:35.555324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cb04579a-fe97-4c29-b938-e7fa33abc7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f844bb32f54227bb1d56ca38f5d6dd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:35.556511 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cb04579a-fe97-4c29-b938-e7fa33abc7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f844bb32f54227bb1d56ca38f5d6dd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:35.568748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cb04579a-fe97-4c29-b938-e7fa33abc7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f844bb32f54227bb1d56ca38f5d6dd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:35.607822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-cb04579a-fe97-4c29-b938-e7fa33abc7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f844bb32f54227bb1d56ca38f5d6dd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:35.620442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1259/2555] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:35 2022] DELETE /identity/v3/users/30f844bb32f54227bb1d56ca38f5d6dd => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:35.797986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342cb6f-3635-43c8-b2ad-db11c9194996 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:35.799857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8342cb6f-3635-43c8-b2ad-db11c9194996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:35.814341 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342cb6f-3635-43c8-b2ad-db11c9194996 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:35.907069 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc988a22-ad4e-4798-a56e-8f4a4601ff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:35.908476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc988a22-ad4e-4798-a56e-8f4a4601ff77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:35.909527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc988a22-ad4e-4798-a56e-8f4a4601ff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:35.910176 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc988a22-ad4e-4798-a56e-8f4a4601ff77 admin admin] PATH_INFO: `/v3/projects/d5831eab7b7148c78ec5765f9a154f3c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:35.913850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc988a22-ad4e-4798-a56e-8f4a4601ff77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5831eab7b7148c78ec5765f9a154f3c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:35.918525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc988a22-ad4e-4798-a56e-8f4a4601ff77 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:35.980811 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cc988a22-ad4e-4798-a56e-8f4a4601ff77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5831eab7b7148c78ec5765f9a154f3c', 'request_id': 'req-cc988a22-ad4e-4798-a56e-8f4a4601ff77'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:35.990094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cc988a22-ad4e-4798-a56e-8f4a4601ff77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5831eab7b7148c78ec5765f9a154f3c', 'request_id': 'req-cc988a22-ad4e-4798-a56e-8f4a4601ff77'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.002678 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cc988a22-ad4e-4798-a56e-8f4a4601ff77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5831eab7b7148c78ec5765f9a154f3c', 'request_id': 'req-cc988a22-ad4e-4798-a56e-8f4a4601ff77'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.021887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cc988a22-ad4e-4798-a56e-8f4a4601ff77 admin admin] The token cache is being invalidate because project d5831eab7b7148c78ec5765f9a154f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:36.022556 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cc988a22-ad4e-4798-a56e-8f4a4601ff77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.024023 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cc988a22-ad4e-4798-a56e-8f4a4601ff77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.026837 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1297/2556] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:35 2022] DELETE /identity/v3/projects/d5831eab7b7148c78ec5765f9a154f3c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:36.033401 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04579a-fe97-4c29-b938-e7fa33abc7e7 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:36.036228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-cb04579a-fe97-4c29-b938-e7fa33abc7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:36.051100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc988a22-ad4e-4798-a56e-8f4a4601ff77 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:36.052592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04579a-fe97-4c29-b938-e7fa33abc7e7 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:36.054078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cc988a22-ad4e-4798-a56e-8f4a4601ff77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:36.117453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:36.130141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05741f9-77b7-43c5-935c-d7624e7ba8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:36.131214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05741f9-77b7-43c5-935c-d7624e7ba8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:36.131214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05741f9-77b7-43c5-935c-d7624e7ba8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:36.131470 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05741f9-77b7-43c5-935c-d7624e7ba8ae admin admin] PATH_INFO: `/v3/users/a495822d70824423bb3e37768f67acf9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:36.132937 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05741f9-77b7-43c5-935c-d7624e7ba8ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a495822d70824423bb3e37768f67acf9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:36.136920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05741f9-77b7-43c5-935c-d7624e7ba8ae admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:36.137866 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:36.174871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc988a22-ad4e-4798-a56e-8f4a4601ff77 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:36.181550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b78438-c25c-45cc-a2ca-5b068db851b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:36.182619 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b78438-c25c-45cc-a2ca-5b068db851b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:36.183012 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b78438-c25c-45cc-a2ca-5b068db851b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:36.183347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b78438-c25c-45cc-a2ca-5b068db851b9 admin admin] PATH_INFO: `/v3/projects/65da6e324b5547959367b8f983c98a3b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:36.184695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b78438-c25c-45cc-a2ca-5b068db851b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65da6e324b5547959367b8f983c98a3b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:36.186773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b78438-c25c-45cc-a2ca-5b068db851b9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:36.210643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d05741f9-77b7-43c5-935c-d7624e7ba8ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a495822d70824423bb3e37768f67acf9'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.220935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d05741f9-77b7-43c5-935c-d7624e7ba8ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a495822d70824423bb3e37768f67acf9'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.221984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d05741f9-77b7-43c5-935c-d7624e7ba8ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a495822d70824423bb3e37768f67acf9'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.236307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d05741f9-77b7-43c5-935c-d7624e7ba8ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a495822d70824423bb3e37768f67acf9'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.253543 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d05741f9-77b7-43c5-935c-d7624e7ba8ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a495822d70824423bb3e37768f67acf9'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.253916 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-92b78438-c25c-45cc-a2ca-5b068db851b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65da6e324b5547959367b8f983c98a3b', 'request_id': 'req-92b78438-c25c-45cc-a2ca-5b068db851b9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.260416 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-92b78438-c25c-45cc-a2ca-5b068db851b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65da6e324b5547959367b8f983c98a3b', 'request_id': 'req-92b78438-c25c-45cc-a2ca-5b068db851b9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.263829 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1260/2557] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:36 2022] DELETE /identity/v3/users/a495822d70824423bb3e37768f67acf9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:36.269525 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-92b78438-c25c-45cc-a2ca-5b068db851b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65da6e324b5547959367b8f983c98a3b', 'request_id': 'req-92b78438-c25c-45cc-a2ca-5b068db851b9'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.282859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-92b78438-c25c-45cc-a2ca-5b068db851b9 admin admin] The token cache is being invalidate because project 65da6e324b5547959367b8f983c98a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:36.283131 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-92b78438-c25c-45cc-a2ca-5b068db851b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.283834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-92b78438-c25c-45cc-a2ca-5b068db851b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.285460 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1298/2558] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:36 2022] DELETE /identity/v3/projects/65da6e324b5547959367b8f983c98a3b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:36.291380 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44640cb-26d5-42e5-837a-d32500a7a610 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:36.291685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44640cb-26d5-42e5-837a-d32500a7a610 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:36.291957 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44640cb-26d5-42e5-837a-d32500a7a610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:36.314399 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-a44640cb-26d5-42e5-837a-d32500a7a610 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:36.316784 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a44640cb-26d5-42e5-837a-d32500a7a610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:36.397670 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1261/2559] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:36.405886 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4840-65bf-4910-8add-a955d0a62b50 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:36.406175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4840-65bf-4910-8add-a955d0a62b50 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:36.406430 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4840-65bf-4910-8add-a955d0a62b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:36.428662 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f02a4840-65bf-4910-8add-a955d0a62b50 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:36.430027 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f02a4840-65bf-4910-8add-a955d0a62b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:36.438662 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1299/2560] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:36.442827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44640cb-26d5-42e5-837a-d32500a7a610 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:36.453106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44640cb-26d5-42e5-837a-d32500a7a610 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:36.457915 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e043e-86ce-4fc6-ad97-e605bd3d550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:36.458600 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e043e-86ce-4fc6-ad97-e605bd3d550b admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:36.458936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e043e-86ce-4fc6-ad97-e605bd3d550b admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:36.459288 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e043e-86ce-4fc6-ad97-e605bd3d550b admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:36.460007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e043e-86ce-4fc6-ad97-e605bd3d550b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:28:36.460416 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e043e-86ce-4fc6-ad97-e605bd3d550b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:36.462114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0e043e-86ce-4fc6-ad97-e605bd3d550b admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:36.475022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1262/2561] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:28:36.480030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4840-65bf-4910-8add-a955d0a62b50 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:36.490720 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4840-65bf-4910-8add-a955d0a62b50 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:36.496753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389533f6-abf8-4bac-b48a-b4cc7b085cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:36.497729 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389533f6-abf8-4bac-b48a-b4cc7b085cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:36.498150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389533f6-abf8-4bac-b48a-b4cc7b085cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:36.498657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389533f6-abf8-4bac-b48a-b4cc7b085cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:36.499765 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389533f6-abf8-4bac-b48a-b4cc7b085cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:36.503326 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389533f6-abf8-4bac-b48a-b4cc7b085cb1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:36.547391 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1300/2562] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:36 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:28:36.552554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e043e-86ce-4fc6-ad97-e605bd3d550b admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:36.563177 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e043e-86ce-4fc6-ad97-e605bd3d550b admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:36.626022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f01a0-367f-4898-a75e-df7d258eea8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:36.626668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f01a0-367f-4898-a75e-df7d258eea8e admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:36.627428 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f01a0-367f-4898-a75e-df7d258eea8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:36.627428 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f01a0-367f-4898-a75e-df7d258eea8e admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:36.627902 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f01a0-367f-4898-a75e-df7d258eea8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:36.630417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f01a0-367f-4898-a75e-df7d258eea8e admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:36.640040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:36.658985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389533f6-abf8-4bac-b48a-b4cc7b085cb1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:36.660862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-389533f6-abf8-4bac-b48a-b4cc7b085cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:36.666445 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1263/2563] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:36 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:36.672726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f01a0-367f-4898-a75e-df7d258eea8e admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:36.676106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389533f6-abf8-4bac-b48a-b4cc7b085cb1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:36.681945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4a484-9169-4d79-9b28-0a0b4b51da41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:36.682440 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4a484-9169-4d79-9b28-0a0b4b51da41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:36.682733 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4a484-9169-4d79-9b28-0a0b4b51da41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:36.683006 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4a484-9169-4d79-9b28-0a0b4b51da41 admin admin] PATH_INFO: `/v3/projects/c6d5cb55b4a54b268a4ca28455de9877` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:36.684272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4a484-9169-4d79-9b28-0a0b4b51da41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d5cb55b4a54b268a4ca28455de9877)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:36.686458 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4a484-9169-4d79-9b28-0a0b4b51da41 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:36.699358 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f01a0-367f-4898-a75e-df7d258eea8e admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:36.705726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b272ac0-5bb7-4e62-907a-0f530b64be5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:36.706405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b272ac0-5bb7-4e62-907a-0f530b64be5c admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:36.706680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b272ac0-5bb7-4e62-907a-0f530b64be5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:36.706956 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b272ac0-5bb7-4e62-907a-0f530b64be5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:36.707672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b272ac0-5bb7-4e62-907a-0f530b64be5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:36.709392 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b272ac0-5bb7-4e62-907a-0f530b64be5c admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:36.728468 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1264/2564] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:36.735637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b272ac0-5bb7-4e62-907a-0f530b64be5c admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:36.754248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b272ac0-5bb7-4e62-907a-0f530b64be5c admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:36.755788 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e6d4a484-9169-4d79-9b28-0a0b4b51da41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d5cb55b4a54b268a4ca28455de9877', 'request_id': 'req-e6d4a484-9169-4d79-9b28-0a0b4b51da41'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.763961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e6d4a484-9169-4d79-9b28-0a0b4b51da41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d5cb55b4a54b268a4ca28455de9877', 'request_id': 'req-e6d4a484-9169-4d79-9b28-0a0b4b51da41'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.775431 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e6d4a484-9169-4d79-9b28-0a0b4b51da41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d5cb55b4a54b268a4ca28455de9877', 'request_id': 'req-e6d4a484-9169-4d79-9b28-0a0b4b51da41'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.794132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e6d4a484-9169-4d79-9b28-0a0b4b51da41 admin admin] The token cache is being invalidate because project c6d5cb55b4a54b268a4ca28455de9877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:36.794771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e6d4a484-9169-4d79-9b28-0a0b4b51da41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.796004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-e6d4a484-9169-4d79-9b28-0a0b4b51da41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:36.798283 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1301/2565] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:36 2022] DELETE /identity/v3/projects/c6d5cb55b4a54b268a4ca28455de9877 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:36.803208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c7f04-3070-4109-bd18-b574c305dd05 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:36.803531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c7f04-3070-4109-bd18-b574c305dd05 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:36.803918 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c7f04-3070-4109-bd18-b574c305dd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:36.827672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a39c7f04-3070-4109-bd18-b574c305dd05 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:36.828957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a39c7f04-3070-4109-bd18-b574c305dd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:36.860827 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:36.864163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4ab0f-5227-4ee2-8acc-a43ef2d5c32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:36.864905 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4ab0f-5227-4ee2-8acc-a43ef2d5c32b admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:36.865247 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4ab0f-5227-4ee2-8acc-a43ef2d5c32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:36.865613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4ab0f-5227-4ee2-8acc-a43ef2d5c32b admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:36.866474 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4ab0f-5227-4ee2-8acc-a43ef2d5c32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:36.868261 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4ab0f-5227-4ee2-8acc-a43ef2d5c32b admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:36.885740 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1265/2566] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:36.887685 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4ab0f-5227-4ee2-8acc-a43ef2d5c32b admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:36.890169 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-45e4ab0f-5227-4ee2-8acc-a43ef2d5c32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:36.908742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4ab0f-5227-4ee2-8acc-a43ef2d5c32b admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:36.915447 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be265a1-9ba1-400b-bfc2-b71f1cb74623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:36.916613 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be265a1-9ba1-400b-bfc2-b71f1cb74623 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:36.916934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be265a1-9ba1-400b-bfc2-b71f1cb74623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:36.917201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be265a1-9ba1-400b-bfc2-b71f1cb74623 admin admin] PATH_INFO: `/v3/projects/a328d2ef545e4dcb814d8e988a9f463f/users/972f9732d31241b0a74aaa7ecdabd7c9/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:36.937820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1302/2567] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:36.940172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be265a1-9ba1-400b-bfc2-b71f1cb74623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a328d2ef545e4dcb814d8e988a9f463f, user_id=972f9732d31241b0a74aaa7ecdabd7c9, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:36.943065 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be265a1-9ba1-400b-bfc2-b71f1cb74623 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:36.947486 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce96f63-3aa3-45e7-b2b3-d3373520a463 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:36.947800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce96f63-3aa3-45e7-b2b3-d3373520a463 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:36.948060 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce96f63-3aa3-45e7-b2b3-d3373520a463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:36.967287 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1266/2568] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:36 2022] PUT /identity/v3/projects/a328d2ef545e4dcb814d8e988a9f463f/users/972f9732d31241b0a74aaa7ecdabd7c9/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:36.975546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-fce96f63-3aa3-45e7-b2b3-d3373520a463 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:36.978083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-fce96f63-3aa3-45e7-b2b3-d3373520a463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:36.978535 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efbb37-39bc-4f07-869a-ac091d2049b9 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:36.978858 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efbb37-39bc-4f07-869a-ac091d2049b9 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:36.979048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efbb37-39bc-4f07-869a-ac091d2049b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:37.014218 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-f4efbb37-39bc-4f07-869a-ac091d2049b9 None None] MFA Rules not processed for user `972f9732d31241b0a74aaa7ecdabd7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:37.015851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f4efbb37-39bc-4f07-869a-ac091d2049b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:37.068813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1303/2569] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:37.076555 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce96f63-3aa3-45e7-b2b3-d3373520a463 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:37.093834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce96f63-3aa3-45e7-b2b3-d3373520a463 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:37.103950 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4b3e7-de35-4b31-a072-2711bb79e99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:37.104889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4b3e7-de35-4b31-a072-2711bb79e99a admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:37.105323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4b3e7-de35-4b31-a072-2711bb79e99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:37.105762 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4b3e7-de35-4b31-a072-2711bb79e99a admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:37.107204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4b3e7-de35-4b31-a072-2711bb79e99a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:28:37.107732 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4b3e7-de35-4b31-a072-2711bb79e99a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:37.110560 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4b3e7-de35-4b31-a072-2711bb79e99a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:37.131072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1267/2570] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:37.131380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1304/2571] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:28:37.132894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4b3e7-de35-4b31-a072-2711bb79e99a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:37.135989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efbb37-39bc-4f07-869a-ac091d2049b9 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:37.150727 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4b3e7-de35-4b31-a072-2711bb79e99a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:37.159353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efbb37-39bc-4f07-869a-ac091d2049b9 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:37.159767 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580202c8-1a97-424b-bc7f-44926cf6787e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:37.160955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580202c8-1a97-424b-bc7f-44926cf6787e admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:37.161426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580202c8-1a97-424b-bc7f-44926cf6787e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:37.161894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580202c8-1a97-424b-bc7f-44926cf6787e admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:37.163346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580202c8-1a97-424b-bc7f-44926cf6787e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:37.166765 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60e55d-748f-471e-ba69-fb61db0fb293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:37.167208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580202c8-1a97-424b-bc7f-44926cf6787e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:37.167395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60e55d-748f-471e-ba69-fb61db0fb293 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:37.167698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60e55d-748f-471e-ba69-fb61db0fb293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:37.167938 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60e55d-748f-471e-ba69-fb61db0fb293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:37.169507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60e55d-748f-471e-ba69-fb61db0fb293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:37.173027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60e55d-748f-471e-ba69-fb61db0fb293 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:37.229510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1268/2572] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:37 2022] POST /identity/v3/projects => generated 389 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:28:37.229810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1305/2573] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:37 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:37.232280 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580202c8-1a97-424b-bc7f-44926cf6787e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:37.232552 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60e55d-748f-471e-ba69-fb61db0fb293 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:37.259244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:37.322418 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60e55d-748f-471e-ba69-fb61db0fb293 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:37.367184 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580202c8-1a97-424b-bc7f-44926cf6787e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:37.373156 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fde90a-e249-4387-ae02-329966d73e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:37.374386 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fde90a-e249-4387-ae02-329966d73e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:37.374960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fde90a-e249-4387-ae02-329966d73e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:37.375544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fde90a-e249-4387-ae02-329966d73e6f admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:37.376828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fde90a-e249-4387-ae02-329966d73e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:37.380720 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fde90a-e249-4387-ae02-329966d73e6f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:37.410881 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0142cb-a074-4972-a572-20ed6980a1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:37.415911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0142cb-a074-4972-a572-20ed6980a1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:37.421648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1306/2574] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:37 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:37.422158 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0142cb-a074-4972-a572-20ed6980a1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:37.422438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0142cb-a074-4972-a572-20ed6980a1e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:37.423153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0142cb-a074-4972-a572-20ed6980a1e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:37.425191 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0142cb-a074-4972-a572-20ed6980a1e8 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:37.427597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fde90a-e249-4387-ae02-329966d73e6f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:37.448481 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fde90a-e249-4387-ae02-329966d73e6f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:37.456307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1269/2575] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:37 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:37.459127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64371a34-f1b4-470f-9716-0f7bd7b49209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:37.460315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64371a34-f1b4-470f-9716-0f7bd7b49209 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:37.460791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0142cb-a074-4972-a572-20ed6980a1e8 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:37.470637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64371a34-f1b4-470f-9716-0f7bd7b49209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:37.471249 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64371a34-f1b4-470f-9716-0f7bd7b49209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:37.473898 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0142cb-a074-4972-a572-20ed6980a1e8 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:37.474358 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64371a34-f1b4-470f-9716-0f7bd7b49209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:37.478084 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64371a34-f1b4-470f-9716-0f7bd7b49209 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:37.500295 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1307/2576] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:37.504466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64371a34-f1b4-470f-9716-0f7bd7b49209 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:37.509362 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275d1c0-0712-4465-a8b9-e85981c25876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:37.510538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275d1c0-0712-4465-a8b9-e85981c25876 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:37.511074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275d1c0-0712-4465-a8b9-e85981c25876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:37.511530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275d1c0-0712-4465-a8b9-e85981c25876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:37.512799 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275d1c0-0712-4465-a8b9-e85981c25876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:37.516188 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275d1c0-0712-4465-a8b9-e85981c25876 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:37.524603 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64371a34-f1b4-470f-9716-0f7bd7b49209 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:37.530997 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bca71e-628d-429c-a5c0-26b3f6d43e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:37.531858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bca71e-628d-429c-a5c0-26b3f6d43e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:37.532217 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bca71e-628d-429c-a5c0-26b3f6d43e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:37.532682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bca71e-628d-429c-a5c0-26b3f6d43e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:37.533606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bca71e-628d-429c-a5c0-26b3f6d43e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:37.535498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bca71e-628d-429c-a5c0-26b3f6d43e1e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:37.539658 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1270/2577] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:37.541308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275d1c0-0712-4465-a8b9-e85981c25876 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:37.545280 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:37.561284 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275d1c0-0712-4465-a8b9-e85981c25876 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:37.565236 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1308/2578] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:37.566466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bca71e-628d-429c-a5c0-26b3f6d43e1e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:37.572005 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38977c03-b31a-4eda-bba3-017c0da193e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:37.572534 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38977c03-b31a-4eda-bba3-017c0da193e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:37.573084 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38977c03-b31a-4eda-bba3-017c0da193e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:37.573648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38977c03-b31a-4eda-bba3-017c0da193e2 admin admin] PATH_INFO: `/v3/projects/867d9a9881a04ce8a80e0a0f4d06e9b0/users/ea60d9335a3c4eb7b27d5586fcac883f/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:37.584220 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bca71e-628d-429c-a5c0-26b3f6d43e1e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:37.596169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fe729-89f5-4fa3-838a-a4a6c373c552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:37.597545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fe729-89f5-4fa3-838a-a4a6c373c552 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:37.598188 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fe729-89f5-4fa3-838a-a4a6c373c552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:37.598610 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fe729-89f5-4fa3-838a-a4a6c373c552 admin admin] PATH_INFO: `/v3/projects/329bfbf1f5724b398a8113c68ff7d34f/users/361e1851abc64d20976db08c717160e6/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:37.600981 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38977c03-b31a-4eda-bba3-017c0da193e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=867d9a9881a04ce8a80e0a0f4d06e9b0, user_id=ea60d9335a3c4eb7b27d5586fcac883f, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:37.606101 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38977c03-b31a-4eda-bba3-017c0da193e2 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:37.619262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fe729-89f5-4fa3-838a-a4a6c373c552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=329bfbf1f5724b398a8113c68ff7d34f, user_id=361e1851abc64d20976db08c717160e6, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:37.622660 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552fe729-89f5-4fa3-838a-a4a6c373c552 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:37.631050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1271/2579] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:37 2022] PUT /identity/v3/projects/867d9a9881a04ce8a80e0a0f4d06e9b0/users/ea60d9335a3c4eb7b27d5586fcac883f/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:37.638809 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38977c03-b31a-4eda-bba3-017c0da193e2 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:37.650842 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1309/2580] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:37 2022] PUT /identity/v3/projects/329bfbf1f5724b398a8113c68ff7d34f/users/361e1851abc64d20976db08c717160e6/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:37.657819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f4a60-c67f-4f16-972e-ef50d785f05a None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:37.658137 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f4a60-c67f-4f16-972e-ef50d785f05a None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:37.658378 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f4a60-c67f-4f16-972e-ef50d785f05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:37.693006 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-717f4a60-c67f-4f16-972e-ef50d785f05a None None] MFA Rules not processed for user `361e1851abc64d20976db08c717160e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:37.694369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-717f4a60-c67f-4f16-972e-ef50d785f05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:37.760807 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38977c03-b31a-4eda-bba3-017c0da193e2 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:37.776298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1310/2581] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:37.781036 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f4a60-c67f-4f16-972e-ef50d785f05a None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:37.810371 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:37.856583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f4a60-c67f-4f16-972e-ef50d785f05a None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:37.862127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47194cd6-c195-4a30-99ea-b1589a29cda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:37.863018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47194cd6-c195-4a30-99ea-b1589a29cda7 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:37.863373 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47194cd6-c195-4a30-99ea-b1589a29cda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:37.863718 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47194cd6-c195-4a30-99ea-b1589a29cda7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:37.864466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47194cd6-c195-4a30-99ea-b1589a29cda7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:37.866615 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47194cd6-c195-4a30-99ea-b1589a29cda7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:37.873225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40115c-933b-401b-a64a-48dd7403833d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:37.874126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40115c-933b-401b-a64a-48dd7403833d admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:37.874597 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40115c-933b-401b-a64a-48dd7403833d admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:37.875080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40115c-933b-401b-a64a-48dd7403833d admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:37.876280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40115c-933b-401b-a64a-48dd7403833d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:37.879632 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40115c-933b-401b-a64a-48dd7403833d admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:37.898920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1272/2582] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:37.901657 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1311/2583] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:37 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:28:37.904797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40115c-933b-401b-a64a-48dd7403833d admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:37.906682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47194cd6-c195-4a30-99ea-b1589a29cda7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:37.922983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40115c-933b-401b-a64a-48dd7403833d admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:37.978843 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:38.002388 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47194cd6-c195-4a30-99ea-b1589a29cda7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:38.010623 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82658a15-9139-4d00-8610-60b7da5ca9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:38.011262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82658a15-9139-4d00-8610-60b7da5ca9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:38.011542 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82658a15-9139-4d00-8610-60b7da5ca9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:38.011812 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82658a15-9139-4d00-8610-60b7da5ca9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:38.012463 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82658a15-9139-4d00-8610-60b7da5ca9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:38.014289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda8d29-d45c-41c1-8f46-69a71c1892d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:38.014598 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82658a15-9139-4d00-8610-60b7da5ca9d5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:38.015475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda8d29-d45c-41c1-8f46-69a71c1892d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:38.015869 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda8d29-d45c-41c1-8f46-69a71c1892d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:38.016384 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda8d29-d45c-41c1-8f46-69a71c1892d5 admin admin] PATH_INFO: `/v3/projects/867d9a9881a04ce8a80e0a0f4d06e9b0/users/ea60d9335a3c4eb7b27d5586fcac883f/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:38.019565 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda8d29-d45c-41c1-8f46-69a71c1892d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=867d9a9881a04ce8a80e0a0f4d06e9b0, user_id=ea60d9335a3c4eb7b27d5586fcac883f, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:38.025163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda8d29-d45c-41c1-8f46-69a71c1892d5 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:38.040662 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1273/2584] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:37 2022] PUT /identity/v3/projects/867d9a9881a04ce8a80e0a0f4d06e9b0/users/ea60d9335a3c4eb7b27d5586fcac883f/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:38.048062 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1312/2585] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:37 2022] POST /identity/v3/users => generated 301 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:28:38.053033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82658a15-9139-4d00-8610-60b7da5ca9d5 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:38.053816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97115f9a-c9e1-4c12-ba32-aa955369647f None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:38.054055 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97115f9a-c9e1-4c12-ba32-aa955369647f None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:38.054397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97115f9a-c9e1-4c12-ba32-aa955369647f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:38.067849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82658a15-9139-4d00-8610-60b7da5ca9d5 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:38.087992 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-97115f9a-c9e1-4c12-ba32-aa955369647f None None] MFA Rules not processed for user `ea60d9335a3c4eb7b27d5586fcac883f`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:38.089294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-97115f9a-c9e1-4c12-ba32-aa955369647f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:38.149529 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3283e-988f-4705-9d56-dc38b5abf314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:38.150648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3283e-988f-4705-9d56-dc38b5abf314 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:38.150975 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3283e-988f-4705-9d56-dc38b5abf314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:38.151455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3283e-988f-4705-9d56-dc38b5abf314 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:38.152057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3283e-988f-4705-9d56-dc38b5abf314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:38.154051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3283e-988f-4705-9d56-dc38b5abf314 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:38.168692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1313/2586] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:38.170445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3283e-988f-4705-9d56-dc38b5abf314 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:38.178938 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1274/2587] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:38.190860 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3283e-988f-4705-9d56-dc38b5abf314 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:38.194425 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97115f9a-c9e1-4c12-ba32-aa955369647f None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:38.196317 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-97115f9a-c9e1-4c12-ba32-aa955369647f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:38.197519 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde4c37-8466-4661-aec6-20b68c2e4bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:38.198246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde4c37-8466-4661-aec6-20b68c2e4bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:38.198519 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde4c37-8466-4661-aec6-20b68c2e4bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:38.202031 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde4c37-8466-4661-aec6-20b68c2e4bcd admin admin] PATH_INFO: `/v3/projects/799d6db51ae841b8ba753965c3d7b522/users/a3a3f4d24478434685de183d56a8f5c7/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:38.239259 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde4c37-8466-4661-aec6-20b68c2e4bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=799d6db51ae841b8ba753965c3d7b522, user_id=a3a3f4d24478434685de183d56a8f5c7, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:38.242820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde4c37-8466-4661-aec6-20b68c2e4bcd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:38.260628 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:38.262944 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1314/2588] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:38 2022] PUT /identity/v3/projects/799d6db51ae841b8ba753965c3d7b522/users/a3a3f4d24478434685de183d56a8f5c7/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:38.266177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde4c37-8466-4661-aec6-20b68c2e4bcd admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:38.284279 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97115f9a-c9e1-4c12-ba32-aa955369647f None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:38.352760 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde4c37-8466-4661-aec6-20b68c2e4bcd admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:38.354401 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf2c4f-44cc-4a99-ad63-e5ba4e20d867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:38.355132 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf2c4f-44cc-4a99-ad63-e5ba4e20d867 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:38.355557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf2c4f-44cc-4a99-ad63-e5ba4e20d867 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:38.355934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf2c4f-44cc-4a99-ad63-e5ba4e20d867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:38.360653 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3b12b-af1e-4c5a-bd74-6926c847abd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:38.361654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3b12b-af1e-4c5a-bd74-6926c847abd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:38.362153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3b12b-af1e-4c5a-bd74-6926c847abd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:38.362560 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3b12b-af1e-4c5a-bd74-6926c847abd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:38.363605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3b12b-af1e-4c5a-bd74-6926c847abd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:38.366497 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3b12b-af1e-4c5a-bd74-6926c847abd0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:38.384149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1315/2589] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:38.389968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3b12b-af1e-4c5a-bd74-6926c847abd0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:38.401097 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3b12b-af1e-4c5a-bd74-6926c847abd0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:38.406106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed031f-f488-4583-840e-4a66f475876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:38.406720 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed031f-f488-4583-840e-4a66f475876e admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:38.407002 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed031f-f488-4583-840e-4a66f475876e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:38.407283 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed031f-f488-4583-840e-4a66f475876e admin admin] PATH_INFO: `/v3/projects/799d6db51ae841b8ba753965c3d7b522/users/a3a3f4d24478434685de183d56a8f5c7/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:38.409534 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed031f-f488-4583-840e-4a66f475876e admin admin] RBAC: Authorizing `identity:create_grant(project_id=799d6db51ae841b8ba753965c3d7b522, user_id=a3a3f4d24478434685de183d56a8f5c7, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:38.412347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed031f-f488-4583-840e-4a66f475876e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:38.426129 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1316/2590] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:38 2022] PUT /identity/v3/projects/799d6db51ae841b8ba753965c3d7b522/users/a3a3f4d24478434685de183d56a8f5c7/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:38.448638 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1e8ca-337d-46b7-b4b3-6a89f5802ba6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:38.449094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1e8ca-337d-46b7-b4b3-6a89f5802ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:38.449467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1e8ca-337d-46b7-b4b3-6a89f5802ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:38.453056 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf2c4f-44cc-4a99-ad63-e5ba4e20d867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:38.455648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf2c4f-44cc-4a99-ad63-e5ba4e20d867 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:38.473238 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1275/2591] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:28:38.500032 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-dfa1e8ca-337d-46b7-b4b3-6a89f5802ba6 None None] MFA Rules not processed for user `a3a3f4d24478434685de183d56a8f5c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:38.502055 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dfa1e8ca-337d-46b7-b4b3-6a89f5802ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:38.546029 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:38.559747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf2c4f-44cc-4a99-ad63-e5ba4e20d867 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:38.563188 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3fdf2c4f-44cc-4a99-ad63-e5ba4e20d867 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:38.583464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf2c4f-44cc-4a99-ad63-e5ba4e20d867 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:38.644175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1317/2592] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:38 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:38.667258 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1e8ca-337d-46b7-b4b3-6a89f5802ba6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:38.693372 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719eca7-d5a7-493d-814c-afbd83d4e1d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:38.696709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719eca7-d5a7-493d-814c-afbd83d4e1d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:38.697219 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719eca7-d5a7-493d-814c-afbd83d4e1d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:38.697746 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719eca7-d5a7-493d-814c-afbd83d4e1d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:38.759767 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1e8ca-337d-46b7-b4b3-6a89f5802ba6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:38.764397 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e475ca4-5d83-4399-8f5d-f7f151c8af1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:38.765292 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e475ca4-5d83-4399-8f5d-f7f151c8af1c service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:38.765573 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e475ca4-5d83-4399-8f5d-f7f151c8af1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:38.765873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e475ca4-5d83-4399-8f5d-f7f151c8af1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:38.777237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e475ca4-5d83-4399-8f5d-f7f151c8af1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:38.778773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e475ca4-5d83-4399-8f5d-f7f151c8af1c service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:38.791260 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1318/2593] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:38 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:38.803499 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719eca7-d5a7-493d-814c-afbd83d4e1d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:38.805295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719eca7-d5a7-493d-814c-afbd83d4e1d4 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:38.817041 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1276/2594] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:38.954079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e475ca4-5d83-4399-8f5d-f7f151c8af1c service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:39.057341 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e475ca4-5d83-4399-8f5d-f7f151c8af1c service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:39.063687 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5a1af-d130-4f81-8349-6bd1ec0b6de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:39.064413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5a1af-d130-4f81-8349-6bd1ec0b6de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:39.064801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5a1af-d130-4f81-8349-6bd1ec0b6de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:39.065130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5a1af-d130-4f81-8349-6bd1ec0b6de4 admin admin] PATH_INFO: `/v3/users/361e1851abc64d20976db08c717160e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:39.066507 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5a1af-d130-4f81-8349-6bd1ec0b6de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=361e1851abc64d20976db08c717160e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:39.068632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5a1af-d130-4f81-8349-6bd1ec0b6de4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:39.147444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cfe5a1af-d130-4f81-8349-6bd1ec0b6de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '361e1851abc64d20976db08c717160e6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:39.170121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cfe5a1af-d130-4f81-8349-6bd1ec0b6de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '361e1851abc64d20976db08c717160e6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:39.179498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:39.187983 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cfe5a1af-d130-4f81-8349-6bd1ec0b6de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '361e1851abc64d20976db08c717160e6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:39.189917 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cfe5a1af-d130-4f81-8349-6bd1ec0b6de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '361e1851abc64d20976db08c717160e6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:39.203864 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-cfe5a1af-d130-4f81-8349-6bd1ec0b6de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '361e1851abc64d20976db08c717160e6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:39.217258 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1319/2595] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:38 2022] DELETE /identity/v3/users/361e1851abc64d20976db08c717160e6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:39.221811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a99cb-1d4f-41e5-ae90-ce47c9bb7f0d None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:39.222293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a99cb-1d4f-41e5-ae90-ce47c9bb7f0d None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:39.222512 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a99cb-1d4f-41e5-ae90-ce47c9bb7f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:39.243051 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:39.257847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-4e5a99cb-1d4f-41e5-ae90-ce47c9bb7f0d None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:39.259113 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-4e5a99cb-1d4f-41e5-ae90-ce47c9bb7f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:39.325714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1277/2596] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:39.338188 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5a1af-d130-4f81-8349-6bd1ec0b6de4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:39.339907 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cfe5a1af-d130-4f81-8349-6bd1ec0b6de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:39.409267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5a1af-d130-4f81-8349-6bd1ec0b6de4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:39.412897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d4148-25cb-4f6c-88da-4b90137361f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:39.413579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d4148-25cb-4f6c-88da-4b90137361f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:39.413890 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d4148-25cb-4f6c-88da-4b90137361f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:39.414161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d4148-25cb-4f6c-88da-4b90137361f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:39.424924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d4148-25cb-4f6c-88da-4b90137361f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:39.426498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d4148-25cb-4f6c-88da-4b90137361f5 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:39.437526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1320/2597] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:39.756680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a99cb-1d4f-41e5-ae90-ce47c9bb7f0d None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:39.758344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-4e5a99cb-1d4f-41e5-ae90-ce47c9bb7f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:39.771114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a99cb-1d4f-41e5-ae90-ce47c9bb7f0d None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:39.776541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:39.777687 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:39.778196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:39.778700 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec admin admin] PATH_INFO: `/v3/projects/329bfbf1f5724b398a8113c68ff7d34f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:39.780213 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=329bfbf1f5724b398a8113c68ff7d34f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:39.782397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:39.840538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329bfbf1f5724b398a8113c68ff7d34f', 'request_id': 'req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:39.849682 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329bfbf1f5724b398a8113c68ff7d34f', 'request_id': 'req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:39.857929 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329bfbf1f5724b398a8113c68ff7d34f', 'request_id': 'req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:39.874430 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec admin admin] The token cache is being invalidate because project 329bfbf1f5724b398a8113c68ff7d34f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:39.874988 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:39.875843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:39.878163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1278/2598] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:39 2022] DELETE /identity/v3/projects/329bfbf1f5724b398a8113c68ff7d34f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:39.884477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d4148-25cb-4f6c-88da-4b90137361f5 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:39.900873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d4148-25cb-4f6c-88da-4b90137361f5 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:40.008006 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd610e-71eb-426d-b23b-1ff712f66b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:40.009116 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd610e-71eb-426d-b23b-1ff712f66b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:40.009611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd610e-71eb-426d-b23b-1ff712f66b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:40.010169 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd610e-71eb-426d-b23b-1ff712f66b19 admin admin] PATH_INFO: `/v3/users/a3a3f4d24478434685de183d56a8f5c7` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:40.012327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd610e-71eb-426d-b23b-1ff712f66b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a3f4d24478434685de183d56a8f5c7)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:40.016221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd610e-71eb-426d-b23b-1ff712f66b19 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:40.098336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b0fd610e-71eb-426d-b23b-1ff712f66b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a3f4d24478434685de183d56a8f5c7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:40.107793 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b0fd610e-71eb-426d-b23b-1ff712f66b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a3f4d24478434685de183d56a8f5c7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:40.120723 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b0fd610e-71eb-426d-b23b-1ff712f66b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a3f4d24478434685de183d56a8f5c7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:40.121474 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b0fd610e-71eb-426d-b23b-1ff712f66b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a3f4d24478434685de183d56a8f5c7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:40.131742 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-b0fd610e-71eb-426d-b23b-1ff712f66b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a3f4d24478434685de183d56a8f5c7'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:40.139719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1321/2599] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:39 2022] DELETE /identity/v3/users/a3a3f4d24478434685de183d56a8f5c7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:40.477084 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:40.478969 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:40.496147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc9996-089d-42dc-9805-5f0bb7e5b4ec admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:40.589728 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8537650-e86a-4deb-9a55-887ef1098cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:40.590389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8537650-e86a-4deb-9a55-887ef1098cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:40.590664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8537650-e86a-4deb-9a55-887ef1098cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:40.590971 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8537650-e86a-4deb-9a55-887ef1098cc5 admin admin] PATH_INFO: `/v3/projects/799d6db51ae841b8ba753965c3d7b522` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:40.592228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8537650-e86a-4deb-9a55-887ef1098cc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=799d6db51ae841b8ba753965c3d7b522)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:40.594327 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8537650-e86a-4deb-9a55-887ef1098cc5 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:40.633323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:40.654982 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a8537650-e86a-4deb-9a55-887ef1098cc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799d6db51ae841b8ba753965c3d7b522', 'request_id': 'req-a8537650-e86a-4deb-9a55-887ef1098cc5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:40.665911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a8537650-e86a-4deb-9a55-887ef1098cc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799d6db51ae841b8ba753965c3d7b522', 'request_id': 'req-a8537650-e86a-4deb-9a55-887ef1098cc5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:40.676370 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a8537650-e86a-4deb-9a55-887ef1098cc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799d6db51ae841b8ba753965c3d7b522', 'request_id': 'req-a8537650-e86a-4deb-9a55-887ef1098cc5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:40.692281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a8537650-e86a-4deb-9a55-887ef1098cc5 admin admin] The token cache is being invalidate because project 799d6db51ae841b8ba753965c3d7b522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:40.692756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a8537650-e86a-4deb-9a55-887ef1098cc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:40.693875 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a8537650-e86a-4deb-9a55-887ef1098cc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:40.696164 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1279/2600] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:40 2022] DELETE /identity/v3/projects/799d6db51ae841b8ba753965c3d7b522 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:40.702471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bac29-e139-40f5-b482-765709e04b39 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:40.702941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bac29-e139-40f5-b482-765709e04b39 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:40.703349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bac29-e139-40f5-b482-765709e04b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:40.716271 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:40.732336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-286bac29-e139-40f5-b482-765709e04b39 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:40.734573 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-286bac29-e139-40f5-b482-765709e04b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:40.822085 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1322/2601] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:40.830990 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe604899-b84d-47eb-a364-8c75f5169409 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:40.831553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe604899-b84d-47eb-a364-8c75f5169409 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:40.831553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe604899-b84d-47eb-a364-8c75f5169409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:40.854851 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-fe604899-b84d-47eb-a364-8c75f5169409 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:40.856146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fe604899-b84d-47eb-a364-8c75f5169409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:40.865908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1280/2602] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:40.871393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bac29-e139-40f5-b482-765709e04b39 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:40.882677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bac29-e139-40f5-b482-765709e04b39 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:40.887798 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33f5b8-dcd6-49d0-8ef2-748133ce851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:40.888467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33f5b8-dcd6-49d0-8ef2-748133ce851e admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:40.888744 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33f5b8-dcd6-49d0-8ef2-748133ce851e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:40.889014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33f5b8-dcd6-49d0-8ef2-748133ce851e admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:40.889754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33f5b8-dcd6-49d0-8ef2-748133ce851e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:28:40.890082 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33f5b8-dcd6-49d0-8ef2-748133ce851e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:40.891781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33f5b8-dcd6-49d0-8ef2-748133ce851e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:40.904973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1323/2603] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:28:40.909812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe604899-b84d-47eb-a364-8c75f5169409 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:40.919823 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe604899-b84d-47eb-a364-8c75f5169409 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:40.924734 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192be165-4948-4286-992d-196867e2d5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:40.925338 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192be165-4948-4286-992d-196867e2d5ad admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:40.925724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192be165-4948-4286-992d-196867e2d5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:40.925940 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192be165-4948-4286-992d-196867e2d5ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:40.926606 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192be165-4948-4286-992d-196867e2d5ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:40.928556 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192be165-4948-4286-992d-196867e2d5ad admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:40.957852 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1281/2604] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:40 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:40.962656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33f5b8-dcd6-49d0-8ef2-748133ce851e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:40.974039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33f5b8-dcd6-49d0-8ef2-748133ce851e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:41.050558 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9262b-b41d-4241-b0b4-52ec98e66797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:41.051550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9262b-b41d-4241-b0b4-52ec98e66797 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:41.051550 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9262b-b41d-4241-b0b4-52ec98e66797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:41.051870 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9262b-b41d-4241-b0b4-52ec98e66797 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:41.052437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9262b-b41d-4241-b0b4-52ec98e66797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:41.056172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9262b-b41d-4241-b0b4-52ec98e66797 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:41.081996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1324/2605] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:40 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:41.087861 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192be165-4948-4286-992d-196867e2d5ad admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:41.105493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192be165-4948-4286-992d-196867e2d5ad admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:41.110995 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ae0ff-699c-482e-a480-b8d14e05f58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:41.111634 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ae0ff-699c-482e-a480-b8d14e05f58b admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:41.111903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ae0ff-699c-482e-a480-b8d14e05f58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:41.112168 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ae0ff-699c-482e-a480-b8d14e05f58b admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:41.112821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ae0ff-699c-482e-a480-b8d14e05f58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:41.114610 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ae0ff-699c-482e-a480-b8d14e05f58b admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:41.125914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1282/2606] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:41.130964 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9262b-b41d-4241-b0b4-52ec98e66797 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:41.142561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9262b-b41d-4241-b0b4-52ec98e66797 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:41.147841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1db5fd-5d84-4c20-9e75-2a68dbcb9dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:41.148457 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1db5fd-5d84-4c20-9e75-2a68dbcb9dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:41.148707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1db5fd-5d84-4c20-9e75-2a68dbcb9dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:41.148980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1db5fd-5d84-4c20-9e75-2a68dbcb9dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:41.149724 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1db5fd-5d84-4c20-9e75-2a68dbcb9dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:41.151710 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1db5fd-5d84-4c20-9e75-2a68dbcb9dc1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:41.165467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1325/2607] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:41.170004 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ae0ff-699c-482e-a480-b8d14e05f58b admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:41.181072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ae0ff-699c-482e-a480-b8d14e05f58b admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:41.186244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f515a-2980-4240-a0a6-cde4a8eccc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:41.186961 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f515a-2980-4240-a0a6-cde4a8eccc0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:41.187233 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f515a-2980-4240-a0a6-cde4a8eccc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:41.187515 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f515a-2980-4240-a0a6-cde4a8eccc0d admin admin] PATH_INFO: `/v3/projects/492ffb867518461c8750f78b2bc16bb9/users/1a7665bc9f7143809f381abefe708c09/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:41.205224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f515a-2980-4240-a0a6-cde4a8eccc0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=492ffb867518461c8750f78b2bc16bb9, user_id=1a7665bc9f7143809f381abefe708c09, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:41.208030 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f515a-2980-4240-a0a6-cde4a8eccc0d admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:41.225567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1283/2608] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:41 2022] PUT /identity/v3/projects/492ffb867518461c8750f78b2bc16bb9/users/1a7665bc9f7143809f381abefe708c09/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:41.247668 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ef1c1-0494-404f-91cc-3da35ce9edcb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:41.247933 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ef1c1-0494-404f-91cc-3da35ce9edcb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:41.248218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ef1c1-0494-404f-91cc-3da35ce9edcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:41.280677 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-670ef1c1-0494-404f-91cc-3da35ce9edcb None None] MFA Rules not processed for user `1a7665bc9f7143809f381abefe708c09`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:41.281994 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-670ef1c1-0494-404f-91cc-3da35ce9edcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:41.358324 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:41.363140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1326/2609] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:41.376151 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f515a-2980-4240-a0a6-cde4a8eccc0d admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:41.378331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e69f515a-2980-4240-a0a6-cde4a8eccc0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:41.443909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f515a-2980-4240-a0a6-cde4a8eccc0d admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:41.447788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ce80b-0da3-4511-82f7-080cf13ddb44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:41.448401 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ce80b-0da3-4511-82f7-080cf13ddb44 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:41.448669 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ce80b-0da3-4511-82f7-080cf13ddb44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:41.448921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ce80b-0da3-4511-82f7-080cf13ddb44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:41.458156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ce80b-0da3-4511-82f7-080cf13ddb44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:41.459618 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ce80b-0da3-4511-82f7-080cf13ddb44 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:41.470455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1284/2610] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:41.496900 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ef1c1-0494-404f-91cc-3da35ce9edcb None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:41.569917 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ef1c1-0494-404f-91cc-3da35ce9edcb None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:41.574637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10246cc9-a44a-40a0-adfb-541b534f6059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:41.575289 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10246cc9-a44a-40a0-adfb-541b534f6059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:41.575564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10246cc9-a44a-40a0-adfb-541b534f6059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:41.575831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10246cc9-a44a-40a0-adfb-541b534f6059 admin admin] PATH_INFO: `/v3/users/1a7665bc9f7143809f381abefe708c09` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:41.576999 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10246cc9-a44a-40a0-adfb-541b534f6059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a7665bc9f7143809f381abefe708c09)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:41.578978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10246cc9-a44a-40a0-adfb-541b534f6059 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:41.632647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-10246cc9-a44a-40a0-adfb-541b534f6059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a7665bc9f7143809f381abefe708c09'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:41.639924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-10246cc9-a44a-40a0-adfb-541b534f6059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a7665bc9f7143809f381abefe708c09'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:41.652323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-10246cc9-a44a-40a0-adfb-541b534f6059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a7665bc9f7143809f381abefe708c09'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:41.653104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-10246cc9-a44a-40a0-adfb-541b534f6059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a7665bc9f7143809f381abefe708c09'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:41.662011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-10246cc9-a44a-40a0-adfb-541b534f6059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a7665bc9f7143809f381abefe708c09'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:41.668567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1327/2611] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:41 2022] DELETE /identity/v3/users/1a7665bc9f7143809f381abefe708c09 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:41.673996 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96192e7a-da52-47fb-8378-48b49abc94d0 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:41.674376 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96192e7a-da52-47fb-8378-48b49abc94d0 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:41.674687 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96192e7a-da52-47fb-8378-48b49abc94d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:41.698039 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-96192e7a-da52-47fb-8378-48b49abc94d0 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:41.699303 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-96192e7a-da52-47fb-8378-48b49abc94d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:41.749455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:41.764009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1285/2612] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:41.774214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10246cc9-a44a-40a0-adfb-541b534f6059 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:41.775722 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-10246cc9-a44a-40a0-adfb-541b534f6059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:41.840860 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10246cc9-a44a-40a0-adfb-541b534f6059 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:41.844923 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f1f14-d11a-41df-9588-c8faa93fd553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:41.845836 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f1f14-d11a-41df-9588-c8faa93fd553 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:41.845836 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f1f14-d11a-41df-9588-c8faa93fd553 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:41.846242 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f1f14-d11a-41df-9588-c8faa93fd553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:41.856436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f1f14-d11a-41df-9588-c8faa93fd553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:41.858269 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f1f14-d11a-41df-9588-c8faa93fd553 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:41.869375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1328/2613] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:42.243273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96192e7a-da52-47fb-8378-48b49abc94d0 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:42.244984 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-96192e7a-da52-47fb-8378-48b49abc94d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:42.259226 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96192e7a-da52-47fb-8378-48b49abc94d0 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:42.265042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76280612-689f-4040-a312-552443d040d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:42.266275 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76280612-689f-4040-a312-552443d040d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:42.266434 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76280612-689f-4040-a312-552443d040d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:42.266708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76280612-689f-4040-a312-552443d040d4 admin admin] PATH_INFO: `/v3/projects/492ffb867518461c8750f78b2bc16bb9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:42.267930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76280612-689f-4040-a312-552443d040d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=492ffb867518461c8750f78b2bc16bb9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:42.270125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76280612-689f-4040-a312-552443d040d4 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:42.344536 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-76280612-689f-4040-a312-552443d040d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492ffb867518461c8750f78b2bc16bb9', 'request_id': 'req-76280612-689f-4040-a312-552443d040d4'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:42.355387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-76280612-689f-4040-a312-552443d040d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492ffb867518461c8750f78b2bc16bb9', 'request_id': 'req-76280612-689f-4040-a312-552443d040d4'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:42.367557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-76280612-689f-4040-a312-552443d040d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492ffb867518461c8750f78b2bc16bb9', 'request_id': 'req-76280612-689f-4040-a312-552443d040d4'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:42.380917 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-76280612-689f-4040-a312-552443d040d4 admin admin] The token cache is being invalidate because project 492ffb867518461c8750f78b2bc16bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:42.380917 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-76280612-689f-4040-a312-552443d040d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:42.381659 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-76280612-689f-4040-a312-552443d040d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:42.383557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1286/2614] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:42 2022] DELETE /identity/v3/projects/492ffb867518461c8750f78b2bc16bb9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:42.388854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa117d59-d248-4739-aceb-6d22fba6c150 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:42.389800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa117d59-d248-4739-aceb-6d22fba6c150 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:42.389971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa117d59-d248-4739-aceb-6d22fba6c150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:42.418311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-aa117d59-d248-4739-aceb-6d22fba6c150 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:42.423978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-aa117d59-d248-4739-aceb-6d22fba6c150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:42.462784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:42.551922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1329/2615] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:42.563632 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436683e0-3077-431d-b16f-a116f0bd4cfd None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:42.564044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436683e0-3077-431d-b16f-a116f0bd4cfd None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:42.564456 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436683e0-3077-431d-b16f-a116f0bd4cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:42.591089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-436683e0-3077-431d-b16f-a116f0bd4cfd None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:42.592363 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-436683e0-3077-431d-b16f-a116f0bd4cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:42.602144 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1287/2616] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:42.607235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa117d59-d248-4739-aceb-6d22fba6c150 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:42.611508 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436683e0-3077-431d-b16f-a116f0bd4cfd None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:42.613775 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-436683e0-3077-431d-b16f-a116f0bd4cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:42.622843 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa117d59-d248-4739-aceb-6d22fba6c150 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:42.630490 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a9e23-df2a-4e32-92af-b9d84739f45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:42.631464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a9e23-df2a-4e32-92af-b9d84739f45d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:42.632001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a9e23-df2a-4e32-92af-b9d84739f45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:42.632446 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a9e23-df2a-4e32-92af-b9d84739f45d admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:42.633528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a9e23-df2a-4e32-92af-b9d84739f45d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:28:42.633948 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436683e0-3077-431d-b16f-a116f0bd4cfd None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:42.634092 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a9e23-df2a-4e32-92af-b9d84739f45d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:42.636962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a9e23-df2a-4e32-92af-b9d84739f45d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:42.641771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670e0e0-c1ac-4218-8627-19626150b673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:42.642756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670e0e0-c1ac-4218-8627-19626150b673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:42.643185 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670e0e0-c1ac-4218-8627-19626150b673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:42.643604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670e0e0-c1ac-4218-8627-19626150b673 admin admin] PATH_INFO: `/v3/users/972f9732d31241b0a74aaa7ecdabd7c9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:42.645795 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670e0e0-c1ac-4218-8627-19626150b673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=972f9732d31241b0a74aaa7ecdabd7c9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:42.649731 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670e0e0-c1ac-4218-8627-19626150b673 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:42.658520 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1330/2617] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:28:42.662844 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a9e23-df2a-4e32-92af-b9d84739f45d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:42.675375 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a9e23-df2a-4e32-92af-b9d84739f45d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:42.681063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d5c6d-31b6-4a28-b4c2-c67d489f991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:42.681884 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d5c6d-31b6-4a28-b4c2-c67d489f991d admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:42.682237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d5c6d-31b6-4a28-b4c2-c67d489f991d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:42.682562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d5c6d-31b6-4a28-b4c2-c67d489f991d admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:42.683304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d5c6d-31b6-4a28-b4c2-c67d489f991d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:42.685430 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d5c6d-31b6-4a28-b4c2-c67d489f991d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:42.723802 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1331/2618] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:42 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:28:42.729553 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d5c6d-31b6-4a28-b4c2-c67d489f991d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:42.730472 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7670e0e0-c1ac-4218-8627-19626150b673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '972f9732d31241b0a74aaa7ecdabd7c9'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:42.739464 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7670e0e0-c1ac-4218-8627-19626150b673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '972f9732d31241b0a74aaa7ecdabd7c9'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:42.740592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7670e0e0-c1ac-4218-8627-19626150b673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '972f9732d31241b0a74aaa7ecdabd7c9'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:42.754679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7670e0e0-c1ac-4218-8627-19626150b673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '972f9732d31241b0a74aaa7ecdabd7c9'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:42.769944 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-7670e0e0-c1ac-4218-8627-19626150b673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '972f9732d31241b0a74aaa7ecdabd7c9'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:42.776633 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1288/2619] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:42 2022] DELETE /identity/v3/users/972f9732d31241b0a74aaa7ecdabd7c9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:42.781194 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9124b-890f-4fbd-b1e8-e2f2ef24b488 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:42.781478 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9124b-890f-4fbd-b1e8-e2f2ef24b488 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:42.781783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9124b-890f-4fbd-b1e8-e2f2ef24b488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:42.802167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-f1b9124b-890f-4fbd-b1e8-e2f2ef24b488 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:42.803396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f1b9124b-890f-4fbd-b1e8-e2f2ef24b488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:42.817218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d5c6d-31b6-4a28-b4c2-c67d489f991d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:42.865417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:42.884973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c154a7-e676-4578-88b6-8038bc44ad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:42.885877 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c154a7-e676-4578-88b6-8038bc44ad0a admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:42.886258 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c154a7-e676-4578-88b6-8038bc44ad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:42.886621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c154a7-e676-4578-88b6-8038bc44ad0a admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:42.887445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c154a7-e676-4578-88b6-8038bc44ad0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:42.889480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c154a7-e676-4578-88b6-8038bc44ad0a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:42.890679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1289/2620] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:42.901371 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9124b-890f-4fbd-b1e8-e2f2ef24b488 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:42.903486 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f1b9124b-890f-4fbd-b1e8-e2f2ef24b488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:42.917017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1332/2621] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:42 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:28:42.921364 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c154a7-e676-4578-88b6-8038bc44ad0a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:42.923566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e7c154a7-e676-4578-88b6-8038bc44ad0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:42.936777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c154a7-e676-4578-88b6-8038bc44ad0a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:42.942042 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e76e0a-a9e6-48d8-aa89-16ae42f269d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:42.942672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e76e0a-a9e6-48d8-aa89-16ae42f269d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:42.943151 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e76e0a-a9e6-48d8-aa89-16ae42f269d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:42.943423 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e76e0a-a9e6-48d8-aa89-16ae42f269d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:42.944073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e76e0a-a9e6-48d8-aa89-16ae42f269d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:42.945778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e76e0a-a9e6-48d8-aa89-16ae42f269d2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:42.957351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1333/2622] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:28:42.961359 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e76e0a-a9e6-48d8-aa89-16ae42f269d2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:42.972935 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e76e0a-a9e6-48d8-aa89-16ae42f269d2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:42.974877 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9124b-890f-4fbd-b1e8-e2f2ef24b488 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:42.978230 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc191285-e4a8-4e84-9f82-e2db1676009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:42.978557 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceb7da-7960-4bfa-b31f-5672da775285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:42.978879 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc191285-e4a8-4e84-9f82-e2db1676009b admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:42.979171 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceb7da-7960-4bfa-b31f-5672da775285 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:42.979317 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc191285-e4a8-4e84-9f82-e2db1676009b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:42.979466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceb7da-7960-4bfa-b31f-5672da775285 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:42.979629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc191285-e4a8-4e84-9f82-e2db1676009b admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:42.979734 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceb7da-7960-4bfa-b31f-5672da775285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:42.980144 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc191285-e4a8-4e84-9f82-e2db1676009b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:42.982187 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc191285-e4a8-4e84-9f82-e2db1676009b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:42.990298 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceb7da-7960-4bfa-b31f-5672da775285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:42.991904 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceb7da-7960-4bfa-b31f-5672da775285 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:42.996027 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1334/2623] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:28:43.001661 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc191285-e4a8-4e84-9f82-e2db1676009b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:43.003090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1290/2624] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:28:43.010011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:43.018100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc191285-e4a8-4e84-9f82-e2db1676009b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:43.024637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f988c3-6702-4ddc-8447-0727788180ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:43.025328 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f988c3-6702-4ddc-8447-0727788180ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:43.025601 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f988c3-6702-4ddc-8447-0727788180ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:43.026060 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f988c3-6702-4ddc-8447-0727788180ae admin admin] PATH_INFO: `/v3/projects/ae1551c989e34f6f8dc18873f0ad1407/users/3dad1eb9813b4653b3e55b090594d030/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:43.042655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f988c3-6702-4ddc-8447-0727788180ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae1551c989e34f6f8dc18873f0ad1407, user_id=3dad1eb9813b4653b3e55b090594d030, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:43.045310 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f988c3-6702-4ddc-8447-0727788180ae admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:43.064748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1335/2625] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:43 2022] PUT /identity/v3/projects/ae1551c989e34f6f8dc18873f0ad1407/users/3dad1eb9813b4653b3e55b090594d030/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:43.083195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6adab3-4a82-4011-906d-8365bfc6cd58 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:43.083493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6adab3-4a82-4011-906d-8365bfc6cd58 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:43.083761 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6adab3-4a82-4011-906d-8365bfc6cd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:43.123402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-cf6adab3-4a82-4011-906d-8365bfc6cd58 None None] MFA Rules not processed for user `3dad1eb9813b4653b3e55b090594d030`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:43.124571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-cf6adab3-4a82-4011-906d-8365bfc6cd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:43.212763 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1291/2626] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:43.228524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f988c3-6702-4ddc-8447-0727788180ae admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:43.232524 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-82f988c3-6702-4ddc-8447-0727788180ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:43.325567 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f988c3-6702-4ddc-8447-0727788180ae admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:43.329466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10462e0a-3719-428b-8c10-d9ff7f80bc3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:43.330127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10462e0a-3719-428b-8c10-d9ff7f80bc3f service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:43.330404 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10462e0a-3719-428b-8c10-d9ff7f80bc3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:43.330674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10462e0a-3719-428b-8c10-d9ff7f80bc3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:43.340700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10462e0a-3719-428b-8c10-d9ff7f80bc3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:43.342294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10462e0a-3719-428b-8c10-d9ff7f80bc3f service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:43.355859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1336/2627] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:28:43.374576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6adab3-4a82-4011-906d-8365bfc6cd58 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:43.376604 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-cf6adab3-4a82-4011-906d-8365bfc6cd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:43.455934 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6adab3-4a82-4011-906d-8365bfc6cd58 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:43.461483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4663d8-95ef-4927-93fc-3a7678054b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:43.462133 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4663d8-95ef-4927-93fc-3a7678054b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:43.462400 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4663d8-95ef-4927-93fc-3a7678054b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:43.462663 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4663d8-95ef-4927-93fc-3a7678054b1d admin admin] PATH_INFO: `/v3/projects/a328d2ef545e4dcb814d8e988a9f463f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:43.463800 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4663d8-95ef-4927-93fc-3a7678054b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a328d2ef545e4dcb814d8e988a9f463f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:43.465739 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4663d8-95ef-4927-93fc-3a7678054b1d admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:43.493926 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:43.531588 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-ba4663d8-95ef-4927-93fc-3a7678054b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a328d2ef545e4dcb814d8e988a9f463f', 'request_id': 'req-ba4663d8-95ef-4927-93fc-3a7678054b1d'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:43.542786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-ba4663d8-95ef-4927-93fc-3a7678054b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a328d2ef545e4dcb814d8e988a9f463f', 'request_id': 'req-ba4663d8-95ef-4927-93fc-3a7678054b1d'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:43.554909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-ba4663d8-95ef-4927-93fc-3a7678054b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a328d2ef545e4dcb814d8e988a9f463f', 'request_id': 'req-ba4663d8-95ef-4927-93fc-3a7678054b1d'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:43.569597 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-ba4663d8-95ef-4927-93fc-3a7678054b1d admin admin] The token cache is being invalidate because project a328d2ef545e4dcb814d8e988a9f463f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:43.570189 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-ba4663d8-95ef-4927-93fc-3a7678054b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:43.571802 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-ba4663d8-95ef-4927-93fc-3a7678054b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:43.573353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1292/2628] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:43 2022] DELETE /identity/v3/projects/a328d2ef545e4dcb814d8e988a9f463f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:43.578302 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10462e0a-3719-428b-8c10-d9ff7f80bc3f service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:43.591725 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10462e0a-3719-428b-8c10-d9ff7f80bc3f service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:43.674577 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f6412-c527-4837-b63a-cadb427e8f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:43.675653 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f6412-c527-4837-b63a-cadb427e8f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:43.676124 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f6412-c527-4837-b63a-cadb427e8f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:43.676662 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f6412-c527-4837-b63a-cadb427e8f67 admin admin] PATH_INFO: `/v3/users/ea60d9335a3c4eb7b27d5586fcac883f` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:43.678559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f6412-c527-4837-b63a-cadb427e8f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea60d9335a3c4eb7b27d5586fcac883f)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:43.682491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f6412-c527-4837-b63a-cadb427e8f67 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:43.747248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-213f6412-c527-4837-b63a-cadb427e8f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea60d9335a3c4eb7b27d5586fcac883f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:43.758050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-213f6412-c527-4837-b63a-cadb427e8f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea60d9335a3c4eb7b27d5586fcac883f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:43.771140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-213f6412-c527-4837-b63a-cadb427e8f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea60d9335a3c4eb7b27d5586fcac883f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:43.771887 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-213f6412-c527-4837-b63a-cadb427e8f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea60d9335a3c4eb7b27d5586fcac883f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:43.779357 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-213f6412-c527-4837-b63a-cadb427e8f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea60d9335a3c4eb7b27d5586fcac883f'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:43.781695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:43.788049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1337/2629] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:43 2022] DELETE /identity/v3/users/ea60d9335a3c4eb7b27d5586fcac883f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:44.121796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4663d8-95ef-4927-93fc-3a7678054b1d admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:44.123503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ba4663d8-95ef-4927-93fc-3a7678054b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:44.143051 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4663d8-95ef-4927-93fc-3a7678054b1d admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:44.207667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15190e92-47df-4316-8419-bc154d571d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:44.208546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15190e92-47df-4316-8419-bc154d571d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:44.208820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15190e92-47df-4316-8419-bc154d571d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:44.209142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15190e92-47df-4316-8419-bc154d571d61 admin admin] PATH_INFO: `/v3/projects/867d9a9881a04ce8a80e0a0f4d06e9b0` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:44.211389 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15190e92-47df-4316-8419-bc154d571d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=867d9a9881a04ce8a80e0a0f4d06e9b0)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:44.213253 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15190e92-47df-4316-8419-bc154d571d61 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:44.273979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-15190e92-47df-4316-8419-bc154d571d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867d9a9881a04ce8a80e0a0f4d06e9b0', 'request_id': 'req-15190e92-47df-4316-8419-bc154d571d61'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:44.285030 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-15190e92-47df-4316-8419-bc154d571d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867d9a9881a04ce8a80e0a0f4d06e9b0', 'request_id': 'req-15190e92-47df-4316-8419-bc154d571d61'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:44.294010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-15190e92-47df-4316-8419-bc154d571d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867d9a9881a04ce8a80e0a0f4d06e9b0', 'request_id': 'req-15190e92-47df-4316-8419-bc154d571d61'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:44.307141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-15190e92-47df-4316-8419-bc154d571d61 admin admin] The token cache is being invalidate because project 867d9a9881a04ce8a80e0a0f4d06e9b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:44.307498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-15190e92-47df-4316-8419-bc154d571d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:44.308208 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-15190e92-47df-4316-8419-bc154d571d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:44.309836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1293/2630] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:44 2022] DELETE /identity/v3/projects/867d9a9881a04ce8a80e0a0f4d06e9b0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:44.316074 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6b117-3d90-410d-9921-68eaa75cb62b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:44.316350 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6b117-3d90-410d-9921-68eaa75cb62b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:44.316668 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6b117-3d90-410d-9921-68eaa75cb62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:44.340417 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-13e6b117-3d90-410d-9921-68eaa75cb62b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:44.342159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-13e6b117-3d90-410d-9921-68eaa75cb62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:44.413565 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1338/2631] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:44.422226 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a143516-b0b7-4909-aa4a-f9e5e7db05bd None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:44.422847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a143516-b0b7-4909-aa4a-f9e5e7db05bd None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:44.422847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a143516-b0b7-4909-aa4a-f9e5e7db05bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:44.445195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-8a143516-b0b7-4909-aa4a-f9e5e7db05bd None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:44.446634 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8a143516-b0b7-4909-aa4a-f9e5e7db05bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:44.456113 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1294/2632] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:44.461044 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6b117-3d90-410d-9921-68eaa75cb62b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:44.471975 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6b117-3d90-410d-9921-68eaa75cb62b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:44.477106 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5db9e-4f89-4c32-8ee8-8242c9a5cfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:44.477799 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5db9e-4f89-4c32-8ee8-8242c9a5cfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:44.478078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5db9e-4f89-4c32-8ee8-8242c9a5cfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:44.478352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5db9e-4f89-4c32-8ee8-8242c9a5cfa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:44.479018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5db9e-4f89-4c32-8ee8-8242c9a5cfa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:28:44.479332 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5db9e-4f89-4c32-8ee8-8242c9a5cfa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:44.482016 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5db9e-4f89-4c32-8ee8-8242c9a5cfa9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:44.498141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1339/2633] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:28:44.503131 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a143516-b0b7-4909-aa4a-f9e5e7db05bd None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:44.513724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a143516-b0b7-4909-aa4a-f9e5e7db05bd None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:44.518750 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbda6f-9827-4baa-8416-8f4eb326bb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:44.519390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbda6f-9827-4baa-8416-8f4eb326bb92 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:44.519665 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbda6f-9827-4baa-8416-8f4eb326bb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:44.519970 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbda6f-9827-4baa-8416-8f4eb326bb92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:44.520640 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbda6f-9827-4baa-8416-8f4eb326bb92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:44.522714 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbda6f-9827-4baa-8416-8f4eb326bb92 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:44.556502 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1295/2634] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:44 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:44.561464 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5db9e-4f89-4c32-8ee8-8242c9a5cfa9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:44.574480 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5db9e-4f89-4c32-8ee8-8242c9a5cfa9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:44.634436 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeadcf4-96ff-42e7-bec8-4e7699798ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:44.635174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeadcf4-96ff-42e7-bec8-4e7699798ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:44.635320 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeadcf4-96ff-42e7-bec8-4e7699798ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:44.635588 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeadcf4-96ff-42e7-bec8-4e7699798ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:44.636209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeadcf4-96ff-42e7-bec8-4e7699798ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:44.638180 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeadcf4-96ff-42e7-bec8-4e7699798ed7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:44.659613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1340/2635] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:44 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:44.664146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbda6f-9827-4baa-8416-8f4eb326bb92 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:44.675134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbda6f-9827-4baa-8416-8f4eb326bb92 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:44.680186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5982660-bde8-4798-bc11-ed37c44ecfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:44.680798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5982660-bde8-4798-bc11-ed37c44ecfaa admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:44.681069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5982660-bde8-4798-bc11-ed37c44ecfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:44.681332 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5982660-bde8-4798-bc11-ed37c44ecfaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:44.682014 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5982660-bde8-4798-bc11-ed37c44ecfaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:44.683813 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5982660-bde8-4798-bc11-ed37c44ecfaa admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:44.686431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:44.695783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1296/2636] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:44.701476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeadcf4-96ff-42e7-bec8-4e7699798ed7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:44.712000 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeadcf4-96ff-42e7-bec8-4e7699798ed7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:44.717340 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95db36-4887-4316-bd4a-586772a188f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:44.717970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95db36-4887-4316-bd4a-586772a188f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:44.718237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95db36-4887-4316-bd4a-586772a188f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:44.718498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95db36-4887-4316-bd4a-586772a188f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:44.719134 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95db36-4887-4316-bd4a-586772a188f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:44.720728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95db36-4887-4316-bd4a-586772a188f6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:44.737261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1341/2637] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:44.739119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5982660-bde8-4798-bc11-ed37c44ecfaa admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:44.754977 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5982660-bde8-4798-bc11-ed37c44ecfaa admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:44.760158 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba5767-ab60-4148-9166-86897b124988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:44.760830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba5767-ab60-4148-9166-86897b124988 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:44.761100 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba5767-ab60-4148-9166-86897b124988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:44.761362 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba5767-ab60-4148-9166-86897b124988 admin admin] PATH_INFO: `/v3/projects/b07814ce808c4f66928a18672df58d68/users/b1891bc1bcab4a45a998d22a5ec18f10/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:44.782928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba5767-ab60-4148-9166-86897b124988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07814ce808c4f66928a18672df58d68, user_id=b1891bc1bcab4a45a998d22a5ec18f10, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:44.785649 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba5767-ab60-4148-9166-86897b124988 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:44.804820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1297/2638] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:44 2022] PUT /identity/v3/projects/b07814ce808c4f66928a18672df58d68/users/b1891bc1bcab4a45a998d22a5ec18f10/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:44.817512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a6332-dcd7-4735-9db1-1b6782a3aab6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:44.817932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a6332-dcd7-4735-9db1-1b6782a3aab6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:44.818279 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a6332-dcd7-4735-9db1-1b6782a3aab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:44.855962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-4c6a6332-dcd7-4735-9db1-1b6782a3aab6 None None] MFA Rules not processed for user `b1891bc1bcab4a45a998d22a5ec18f10`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:44.857591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-4c6a6332-dcd7-4735-9db1-1b6782a3aab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:44.933303 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:44.947241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1342/2639] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:44.952501 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba5767-ab60-4148-9166-86897b124988 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:45.023379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba5767-ab60-4148-9166-86897b124988 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:45.029351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9c337-afae-4942-b793-2b1ee48fdd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:45.030220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9c337-afae-4942-b793-2b1ee48fdd94 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:45.030726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9c337-afae-4942-b793-2b1ee48fdd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:45.031006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9c337-afae-4942-b793-2b1ee48fdd94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:45.031847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9c337-afae-4942-b793-2b1ee48fdd94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:45.033945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e9c337-afae-4942-b793-2b1ee48fdd94 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:45.073697 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1298/2640] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:44 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:45.074896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a6332-dcd7-4735-9db1-1b6782a3aab6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:45.089382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a6332-dcd7-4735-9db1-1b6782a3aab6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:45.184526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c8407-88fb-4a73-a71e-219805b7028e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:45.185065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c8407-88fb-4a73-a71e-219805b7028e admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:45.185342 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c8407-88fb-4a73-a71e-219805b7028e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:45.185608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c8407-88fb-4a73-a71e-219805b7028e admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:45.186278 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c8407-88fb-4a73-a71e-219805b7028e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:45.188232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c8407-88fb-4a73-a71e-219805b7028e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:45.217156 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1343/2641] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:45 2022] POST /identity/v3/users => generated 296 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:28:45.226035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9c337-afae-4942-b793-2b1ee48fdd94 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:45.239913 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9c337-afae-4942-b793-2b1ee48fdd94 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:45.245107 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e695231-75c4-4a84-a7b7-8185a15dc42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:45.245759 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e695231-75c4-4a84-a7b7-8185a15dc42c admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:45.246031 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e695231-75c4-4a84-a7b7-8185a15dc42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:45.246296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e695231-75c4-4a84-a7b7-8185a15dc42c admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:45.246947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e695231-75c4-4a84-a7b7-8185a15dc42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:45.248833 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e695231-75c4-4a84-a7b7-8185a15dc42c admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:45.260043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1299/2642] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:45.265528 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c8407-88fb-4a73-a71e-219805b7028e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:45.279818 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c8407-88fb-4a73-a71e-219805b7028e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:45.287240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed514e6-1477-44a3-98d4-5920823f9bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:45.288221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed514e6-1477-44a3-98d4-5920823f9bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:45.288608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed514e6-1477-44a3-98d4-5920823f9bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:45.289081 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed514e6-1477-44a3-98d4-5920823f9bb6 admin admin] PATH_INFO: `/v3/projects/1303c17eeb464759be46b665303dc4e8/users/4da1c6126b0a441fafa831224908d063/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:45.317281 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed514e6-1477-44a3-98d4-5920823f9bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1303c17eeb464759be46b665303dc4e8, user_id=4da1c6126b0a441fafa831224908d063, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:45.320416 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed514e6-1477-44a3-98d4-5920823f9bb6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:45.340507 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1344/2643] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:45 2022] PUT /identity/v3/projects/1303c17eeb464759be46b665303dc4e8/users/4da1c6126b0a441fafa831224908d063/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:45.345370 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e695231-75c4-4a84-a7b7-8185a15dc42c admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:45.357541 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e695231-75c4-4a84-a7b7-8185a15dc42c admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:45.448691 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadf0a3-a3ae-4c53-828c-d91265fef549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:45.449375 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadf0a3-a3ae-4c53-828c-d91265fef549 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:45.449603 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadf0a3-a3ae-4c53-828c-d91265fef549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:45.449914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadf0a3-a3ae-4c53-828c-d91265fef549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:45.450669 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadf0a3-a3ae-4c53-828c-d91265fef549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:45.452465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadf0a3-a3ae-4c53-828c-d91265fef549 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:45.467609 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1300/2644] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:45.468836 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed514e6-1477-44a3-98d4-5920823f9bb6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:45.482213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed514e6-1477-44a3-98d4-5920823f9bb6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:45.488932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599f03e-d68e-4650-aa9d-c0d84c5e16a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:45.489822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599f03e-d68e-4650-aa9d-c0d84c5e16a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:45.490189 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599f03e-d68e-4650-aa9d-c0d84c5e16a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:45.491570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599f03e-d68e-4650-aa9d-c0d84c5e16a4 admin admin] PATH_INFO: `/v3/projects/1303c17eeb464759be46b665303dc4e8/users/4da1c6126b0a441fafa831224908d063/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:45.492874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599f03e-d68e-4650-aa9d-c0d84c5e16a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1303c17eeb464759be46b665303dc4e8, user_id=4da1c6126b0a441fafa831224908d063, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:45.496285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599f03e-d68e-4650-aa9d-c0d84c5e16a4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:45.513947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1345/2645] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:45 2022] PUT /identity/v3/projects/1303c17eeb464759be46b665303dc4e8/users/4da1c6126b0a441fafa831224908d063/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:45.536136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cdb3f-477a-4ec4-afe9-76b4c34b1690 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:45.537554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cdb3f-477a-4ec4-afe9-76b4c34b1690 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:45.539342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cdb3f-477a-4ec4-afe9-76b4c34b1690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:45.591874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-7a9cdb3f-477a-4ec4-afe9-76b4c34b1690 None None] MFA Rules not processed for user `4da1c6126b0a441fafa831224908d063`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:45.593186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7a9cdb3f-477a-4ec4-afe9-76b4c34b1690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:45.636135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:45.685148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1301/2646] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:45.702135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599f03e-d68e-4650-aa9d-c0d84c5e16a4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:45.704974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b599f03e-d68e-4650-aa9d-c0d84c5e16a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:45.774860 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599f03e-d68e-4650-aa9d-c0d84c5e16a4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:45.779047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0d934-17ac-41cf-af72-90f1266b7926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:45.779777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0d934-17ac-41cf-af72-90f1266b7926 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:45.780038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0d934-17ac-41cf-af72-90f1266b7926 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:45.780403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0d934-17ac-41cf-af72-90f1266b7926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:45.864405 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0d934-17ac-41cf-af72-90f1266b7926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:45.866335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0d934-17ac-41cf-af72-90f1266b7926 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:45.880039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1346/2647] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:28:46.616110 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cdb3f-477a-4ec4-afe9-76b4c34b1690 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:46.618058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7a9cdb3f-477a-4ec4-afe9-76b4c34b1690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:46.696209 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cdb3f-477a-4ec4-afe9-76b4c34b1690 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:46.701956 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f271b-3796-4073-8751-6da08adf2f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:46.702612 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f271b-3796-4073-8751-6da08adf2f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:46.702885 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f271b-3796-4073-8751-6da08adf2f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:46.703156 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f271b-3796-4073-8751-6da08adf2f98 admin admin] PATH_INFO: `/v3/users/3dad1eb9813b4653b3e55b090594d030` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:46.704542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f271b-3796-4073-8751-6da08adf2f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dad1eb9813b4653b3e55b090594d030)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:46.706583 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f271b-3796-4073-8751-6da08adf2f98 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:46.758280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-992f271b-3796-4073-8751-6da08adf2f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dad1eb9813b4653b3e55b090594d030'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:46.767687 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-992f271b-3796-4073-8751-6da08adf2f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dad1eb9813b4653b3e55b090594d030'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:46.768569 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-992f271b-3796-4073-8751-6da08adf2f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dad1eb9813b4653b3e55b090594d030'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:46.780033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-992f271b-3796-4073-8751-6da08adf2f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dad1eb9813b4653b3e55b090594d030'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:46.794199 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-992f271b-3796-4073-8751-6da08adf2f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dad1eb9813b4653b3e55b090594d030'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:46.801175 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1302/2648] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:46 2022] DELETE /identity/v3/users/3dad1eb9813b4653b3e55b090594d030 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:46.806386 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5fa66-4d4b-4ef4-85c3-34b3c9164853 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:46.806963 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5fa66-4d4b-4ef4-85c3-34b3c9164853 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:46.806963 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5fa66-4d4b-4ef4-85c3-34b3c9164853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:46.814927 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:46.833897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-31b5fa66-4d4b-4ef4-85c3-34b3c9164853 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:46.836647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-31b5fa66-4d4b-4ef4-85c3-34b3c9164853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:46.912985 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1347/2649] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:46.923813 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f271b-3796-4073-8751-6da08adf2f98 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:46.925408 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-992f271b-3796-4073-8751-6da08adf2f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:47.026567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:47.034119 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f271b-3796-4073-8751-6da08adf2f98 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:47.040036 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da3115-eab3-4f23-9a38-3947231035db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:47.041092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da3115-eab3-4f23-9a38-3947231035db service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:47.041562 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da3115-eab3-4f23-9a38-3947231035db service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:47.041940 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da3115-eab3-4f23-9a38-3947231035db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:47.063342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da3115-eab3-4f23-9a38-3947231035db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:47.064897 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da3115-eab3-4f23-9a38-3947231035db service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:47.077071 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1303/2650] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:47.333309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5fa66-4d4b-4ef4-85c3-34b3c9164853 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:47.335121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-31b5fa66-4d4b-4ef4-85c3-34b3c9164853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:47.399920 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5fa66-4d4b-4ef4-85c3-34b3c9164853 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:47.403833 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4f3ae-be00-47b7-8c07-1c2e677d1eb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:47.404451 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4f3ae-be00-47b7-8c07-1c2e677d1eb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:47.404723 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4f3ae-be00-47b7-8c07-1c2e677d1eb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:47.404987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4f3ae-be00-47b7-8c07-1c2e677d1eb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:47.406784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9dc4f3ae-be00-47b7-8c07-1c2e677d1eb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:47.427173 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da3115-eab3-4f23-9a38-3947231035db service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:47.430456 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-25da3115-eab3-4f23-9a38-3947231035db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:47.474756 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da3115-eab3-4f23-9a38-3947231035db service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:47.482359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecc504-91cb-4375-9b51-356f4ef61fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:47.483206 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecc504-91cb-4375-9b51-356f4ef61fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:47.483618 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecc504-91cb-4375-9b51-356f4ef61fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:47.484040 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecc504-91cb-4375-9b51-356f4ef61fe5 admin admin] PATH_INFO: `/v3/projects/ae1551c989e34f6f8dc18873f0ad1407` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:47.486241 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecc504-91cb-4375-9b51-356f4ef61fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae1551c989e34f6f8dc18873f0ad1407)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:47.490091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecc504-91cb-4375-9b51-356f4ef61fe5 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:47.513066 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4f3ae-be00-47b7-8c07-1c2e677d1eb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:47.514587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4f3ae-be00-47b7-8c07-1c2e677d1eb0 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:47.526345 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1348/2651] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:28:47.549996 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-02ecc504-91cb-4375-9b51-356f4ef61fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae1551c989e34f6f8dc18873f0ad1407', 'request_id': 'req-02ecc504-91cb-4375-9b51-356f4ef61fe5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:47.560738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-02ecc504-91cb-4375-9b51-356f4ef61fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae1551c989e34f6f8dc18873f0ad1407', 'request_id': 'req-02ecc504-91cb-4375-9b51-356f4ef61fe5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:47.568409 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-02ecc504-91cb-4375-9b51-356f4ef61fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae1551c989e34f6f8dc18873f0ad1407', 'request_id': 'req-02ecc504-91cb-4375-9b51-356f4ef61fe5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:47.579495 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-02ecc504-91cb-4375-9b51-356f4ef61fe5 admin admin] The token cache is being invalidate because project ae1551c989e34f6f8dc18873f0ad1407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:47.580163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-02ecc504-91cb-4375-9b51-356f4ef61fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:47.582157 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-02ecc504-91cb-4375-9b51-356f4ef61fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:47.585897 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1304/2652] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:47 2022] DELETE /identity/v3/projects/ae1551c989e34f6f8dc18873f0ad1407 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:47.594599 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7df75-226f-4bbd-8d62-058d86075f37 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:47.594943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7df75-226f-4bbd-8d62-058d86075f37 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:47.595311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7df75-226f-4bbd-8d62-058d86075f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:47.619727 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-7fd7df75-226f-4bbd-8d62-058d86075f37 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:47.620967 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-7fd7df75-226f-4bbd-8d62-058d86075f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:47.676727 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:47.698703 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1349/2653] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:47.710359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4f217-14e0-46a4-83a7-49af8b224ae1 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:47.710945 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4f217-14e0-46a4-83a7-49af8b224ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:47.711190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4f217-14e0-46a4-83a7-49af8b224ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:47.734933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-cfb4f217-14e0-46a4-83a7-49af8b224ae1 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:47.736251 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-cfb4f217-14e0-46a4-83a7-49af8b224ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:47.746786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1305/2654] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:47.752411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7df75-226f-4bbd-8d62-058d86075f37 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:47.762549 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7df75-226f-4bbd-8d62-058d86075f37 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:47.767757 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ea327-82a1-452e-b6bf-e29aee7a5059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:47.768395 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ea327-82a1-452e-b6bf-e29aee7a5059 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:47.768672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ea327-82a1-452e-b6bf-e29aee7a5059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:47.768954 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ea327-82a1-452e-b6bf-e29aee7a5059 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:47.769682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ea327-82a1-452e-b6bf-e29aee7a5059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:28:47.770110 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ea327-82a1-452e-b6bf-e29aee7a5059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:47.771736 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ea327-82a1-452e-b6bf-e29aee7a5059 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:47.785263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1350/2655] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:28:47.790673 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4f217-14e0-46a4-83a7-49af8b224ae1 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:47.804997 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4f217-14e0-46a4-83a7-49af8b224ae1 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:47.812103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d99193-a809-4501-93e4-f0b4a14dc879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:47.812985 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d99193-a809-4501-93e4-f0b4a14dc879 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:47.813415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d99193-a809-4501-93e4-f0b4a14dc879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:47.813839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d99193-a809-4501-93e4-f0b4a14dc879 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:47.814709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d99193-a809-4501-93e4-f0b4a14dc879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:47.817783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d99193-a809-4501-93e4-f0b4a14dc879 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:47.857432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1306/2656] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:47 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:47.862741 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ea327-82a1-452e-b6bf-e29aee7a5059 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:47.875945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ea327-82a1-452e-b6bf-e29aee7a5059 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:47.950796 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c5a8d-7c08-4aab-9ebd-96eaf29290a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:47.951872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c5a8d-7c08-4aab-9ebd-96eaf29290a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:47.952356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c5a8d-7c08-4aab-9ebd-96eaf29290a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:47.952822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c5a8d-7c08-4aab-9ebd-96eaf29290a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:47.954016 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c5a8d-7c08-4aab-9ebd-96eaf29290a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:47.957456 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c5a8d-7c08-4aab-9ebd-96eaf29290a0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:47.986876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1351/2657] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:47 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:47.991655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d99193-a809-4501-93e4-f0b4a14dc879 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:48.004738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d99193-a809-4501-93e4-f0b4a14dc879 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:48.011324 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fa0c3-7caf-4dec-ba2a-13c5ec1dce71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:48.011972 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fa0c3-7caf-4dec-ba2a-13c5ec1dce71 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:48.012243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fa0c3-7caf-4dec-ba2a-13c5ec1dce71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:48.012518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fa0c3-7caf-4dec-ba2a-13c5ec1dce71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:48.013220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fa0c3-7caf-4dec-ba2a-13c5ec1dce71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:48.014918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fa0c3-7caf-4dec-ba2a-13c5ec1dce71 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:48.026180 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1307/2658] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:48.031058 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c5a8d-7c08-4aab-9ebd-96eaf29290a0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:48.041634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c5a8d-7c08-4aab-9ebd-96eaf29290a0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:48.046623 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a332634-5246-47bf-a7ff-39a6c84191fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:48.047249 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a332634-5246-47bf-a7ff-39a6c84191fa admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:48.047527 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a332634-5246-47bf-a7ff-39a6c84191fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:48.047797 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a332634-5246-47bf-a7ff-39a6c84191fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:48.048485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a332634-5246-47bf-a7ff-39a6c84191fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:48.050203 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a332634-5246-47bf-a7ff-39a6c84191fa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:48.062546 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1352/2659] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:48.067563 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fa0c3-7caf-4dec-ba2a-13c5ec1dce71 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:48.079636 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fa0c3-7caf-4dec-ba2a-13c5ec1dce71 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:48.085837 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17c90a-dae4-4594-b586-a78f4a71dec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:48.086543 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17c90a-dae4-4594-b586-a78f4a71dec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:48.086824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17c90a-dae4-4594-b586-a78f4a71dec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:48.087095 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17c90a-dae4-4594-b586-a78f4a71dec5 admin admin] PATH_INFO: `/v3/projects/ba654e6d4403454fa396b54cfd55ea75/users/bc5bcc44cce44f9b86cb57f6f0ad8bfc/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:48.104522 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17c90a-dae4-4594-b586-a78f4a71dec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba654e6d4403454fa396b54cfd55ea75, user_id=bc5bcc44cce44f9b86cb57f6f0ad8bfc, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:48.107702 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17c90a-dae4-4594-b586-a78f4a71dec5 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:48.123638 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1308/2660] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:48 2022] PUT /identity/v3/projects/ba654e6d4403454fa396b54cfd55ea75/users/bc5bcc44cce44f9b86cb57f6f0ad8bfc/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:48.135043 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cf3a5-b3e7-4f02-9af2-cadeb758cc5b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:48.135347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cf3a5-b3e7-4f02-9af2-cadeb758cc5b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:48.135600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cf3a5-b3e7-4f02-9af2-cadeb758cc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:48.174347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bd0cf3a5-b3e7-4f02-9af2-cadeb758cc5b None None] MFA Rules not processed for user `bc5bcc44cce44f9b86cb57f6f0ad8bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:48.176298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bd0cf3a5-b3e7-4f02-9af2-cadeb758cc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:48.252583 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1353/2661] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:48.267010 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17c90a-dae4-4594-b586-a78f4a71dec5 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:48.269559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8f17c90a-dae4-4594-b586-a78f4a71dec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:48.339624 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17c90a-dae4-4594-b586-a78f4a71dec5 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:48.344431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf431a3f-9f18-4b47-8b5a-1dc87c701716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:48.345871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf431a3f-9f18-4b47-8b5a-1dc87c701716 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:48.345871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf431a3f-9f18-4b47-8b5a-1dc87c701716 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:48.345871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf431a3f-9f18-4b47-8b5a-1dc87c701716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:48.355434 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf431a3f-9f18-4b47-8b5a-1dc87c701716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:48.357320 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf431a3f-9f18-4b47-8b5a-1dc87c701716 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:48.367690 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1309/2662] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:51.011126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cf3a5-b3e7-4f02-9af2-cadeb758cc5b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:51.068398 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:51.086311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cf3a5-b3e7-4f02-9af2-cadeb758cc5b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:51.091891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fd20f-a966-4065-b17d-56cf55a1ce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:51.092551 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fd20f-a966-4065-b17d-56cf55a1ce74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:51.092846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fd20f-a966-4065-b17d-56cf55a1ce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:51.093217 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fd20f-a966-4065-b17d-56cf55a1ce74 admin admin] PATH_INFO: `/v3/users/bc5bcc44cce44f9b86cb57f6f0ad8bfc` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:51.094568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fd20f-a966-4065-b17d-56cf55a1ce74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc5bcc44cce44f9b86cb57f6f0ad8bfc)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:51.096614 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fd20f-a966-4065-b17d-56cf55a1ce74 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:51.151890 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ef5fd20f-a966-4065-b17d-56cf55a1ce74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc5bcc44cce44f9b86cb57f6f0ad8bfc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:51.160101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ef5fd20f-a966-4065-b17d-56cf55a1ce74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc5bcc44cce44f9b86cb57f6f0ad8bfc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:51.173303 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ef5fd20f-a966-4065-b17d-56cf55a1ce74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc5bcc44cce44f9b86cb57f6f0ad8bfc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:51.174053 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ef5fd20f-a966-4065-b17d-56cf55a1ce74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc5bcc44cce44f9b86cb57f6f0ad8bfc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:51.184083 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ef5fd20f-a966-4065-b17d-56cf55a1ce74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc5bcc44cce44f9b86cb57f6f0ad8bfc'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:51.191001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1354/2663] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:51 2022] DELETE /identity/v3/users/bc5bcc44cce44f9b86cb57f6f0ad8bfc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:51.196301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08b8e5-0efe-46d3-b392-bc500fbba307 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:51.196827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08b8e5-0efe-46d3-b392-bc500fbba307 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:51.197032 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08b8e5-0efe-46d3-b392-bc500fbba307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:51.217847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-0a08b8e5-0efe-46d3-b392-bc500fbba307 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:51.219106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0a08b8e5-0efe-46d3-b392-bc500fbba307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:51.228623 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:51.288590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1310/2664] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:51.298906 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fd20f-a966-4065-b17d-56cf55a1ce74 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:51.300383 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ef5fd20f-a966-4065-b17d-56cf55a1ce74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:51.364301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fd20f-a966-4065-b17d-56cf55a1ce74 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:51.368399 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47182a43-9fcb-4c71-940e-ed089a7d0a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:51.369030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47182a43-9fcb-4c71-940e-ed089a7d0a7e service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:51.369294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47182a43-9fcb-4c71-940e-ed089a7d0a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:51.369566 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47182a43-9fcb-4c71-940e-ed089a7d0a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:51.380127 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47182a43-9fcb-4c71-940e-ed089a7d0a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:51.381570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47182a43-9fcb-4c71-940e-ed089a7d0a7e service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:51.392471 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1355/2665] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:51.429292 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08b8e5-0efe-46d3-b392-bc500fbba307 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:51.430920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0a08b8e5-0efe-46d3-b392-bc500fbba307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:51.443793 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08b8e5-0efe-46d3-b392-bc500fbba307 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:51.449160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ba24a-9cbe-4b8d-936a-70bb2133e6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:51.449847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ba24a-9cbe-4b8d-936a-70bb2133e6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:51.450187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ba24a-9cbe-4b8d-936a-70bb2133e6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:51.450487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ba24a-9cbe-4b8d-936a-70bb2133e6a5 admin admin] PATH_INFO: `/v3/users/b1891bc1bcab4a45a998d22a5ec18f10` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:51.451667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ba24a-9cbe-4b8d-936a-70bb2133e6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1891bc1bcab4a45a998d22a5ec18f10)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:51.453657 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ba24a-9cbe-4b8d-936a-70bb2133e6a5 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:51.514759 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a55ba24a-9cbe-4b8d-936a-70bb2133e6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1891bc1bcab4a45a998d22a5ec18f10'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:51.524318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a55ba24a-9cbe-4b8d-936a-70bb2133e6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1891bc1bcab4a45a998d22a5ec18f10'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:51.525085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a55ba24a-9cbe-4b8d-936a-70bb2133e6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1891bc1bcab4a45a998d22a5ec18f10'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:51.534258 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a55ba24a-9cbe-4b8d-936a-70bb2133e6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1891bc1bcab4a45a998d22a5ec18f10'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:51.547729 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-a55ba24a-9cbe-4b8d-936a-70bb2133e6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1891bc1bcab4a45a998d22a5ec18f10'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:51.557160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1311/2666] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:51 2022] DELETE /identity/v3/users/b1891bc1bcab4a45a998d22a5ec18f10 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:51.562947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd435d06-497b-41d2-b636-f19940db65b7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:51.563294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd435d06-497b-41d2-b636-f19940db65b7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:51.563748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd435d06-497b-41d2-b636-f19940db65b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:51.591921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-dd435d06-497b-41d2-b636-f19940db65b7 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:51.593157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dd435d06-497b-41d2-b636-f19940db65b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:51.660828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1356/2667] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:51.671503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ba24a-9cbe-4b8d-936a-70bb2133e6a5 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:51.673091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a55ba24a-9cbe-4b8d-936a-70bb2133e6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:51.715382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd435d06-497b-41d2-b636-f19940db65b7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:51.717148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-dd435d06-497b-41d2-b636-f19940db65b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:51.736635 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd435d06-497b-41d2-b636-f19940db65b7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:51.742133 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4473b14-5de9-40f6-8b03-64124be9d78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:51.743080 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4473b14-5de9-40f6-8b03-64124be9d78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:51.743489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4473b14-5de9-40f6-8b03-64124be9d78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:51.743618 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4473b14-5de9-40f6-8b03-64124be9d78c admin admin] PATH_INFO: `/v3/projects/ba654e6d4403454fa396b54cfd55ea75` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:51.744894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4473b14-5de9-40f6-8b03-64124be9d78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba654e6d4403454fa396b54cfd55ea75)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:51.746966 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4473b14-5de9-40f6-8b03-64124be9d78c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:51.756521 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:51.767381 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ba24a-9cbe-4b8d-936a-70bb2133e6a5 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:51.772998 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f16461-00b1-40a5-90d4-8e5d051d24f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:51.774021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16461-00b1-40a5-90d4-8e5d051d24f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:51.774484 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16461-00b1-40a5-90d4-8e5d051d24f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:51.774915 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f16461-00b1-40a5-90d4-8e5d051d24f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:51.788042 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f16461-00b1-40a5-90d4-8e5d051d24f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:51.789767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f16461-00b1-40a5-90d4-8e5d051d24f9 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:51.802228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1312/2668] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:51.818174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d4473b14-5de9-40f6-8b03-64124be9d78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba654e6d4403454fa396b54cfd55ea75', 'request_id': 'req-d4473b14-5de9-40f6-8b03-64124be9d78c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:51.832412 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d4473b14-5de9-40f6-8b03-64124be9d78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba654e6d4403454fa396b54cfd55ea75', 'request_id': 'req-d4473b14-5de9-40f6-8b03-64124be9d78c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:51.848896 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d4473b14-5de9-40f6-8b03-64124be9d78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba654e6d4403454fa396b54cfd55ea75', 'request_id': 'req-d4473b14-5de9-40f6-8b03-64124be9d78c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:51.864232 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d4473b14-5de9-40f6-8b03-64124be9d78c admin admin] The token cache is being invalidate because project ba654e6d4403454fa396b54cfd55ea75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:51.864678 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d4473b14-5de9-40f6-8b03-64124be9d78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:51.865861 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-d4473b14-5de9-40f6-8b03-64124be9d78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:51.868021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1357/2669] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:51 2022] DELETE /identity/v3/projects/ba654e6d4403454fa396b54cfd55ea75 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:51.873236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ba68f-561f-493f-abef-b8598f1855e6 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:51.873848 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ba68f-561f-493f-abef-b8598f1855e6 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:51.874420 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ba68f-561f-493f-abef-b8598f1855e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:51.899672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-8e9ba68f-561f-493f-abef-b8598f1855e6 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:51.900966 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8e9ba68f-561f-493f-abef-b8598f1855e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:51.940003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:52.009852 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1313/2670] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:52.018664 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db828080-2690-4b91-a1fb-a1d187b1cb0c None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:52.019304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db828080-2690-4b91-a1fb-a1d187b1cb0c None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:52.019304 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db828080-2690-4b91-a1fb-a1d187b1cb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:52.044064 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-db828080-2690-4b91-a1fb-a1d187b1cb0c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:52.045043 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-db828080-2690-4b91-a1fb-a1d187b1cb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:52.054575 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1358/2671] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:52.059148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ba68f-561f-493f-abef-b8598f1855e6 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:52.070561 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ba68f-561f-493f-abef-b8598f1855e6 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:52.075964 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273c4d-1222-4fde-8880-dbccfadf25b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:52.076595 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273c4d-1222-4fde-8880-dbccfadf25b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:52.076874 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273c4d-1222-4fde-8880-dbccfadf25b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:52.077147 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273c4d-1222-4fde-8880-dbccfadf25b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:52.077894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb273c4d-1222-4fde-8880-dbccfadf25b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:28:52.078202 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb273c4d-1222-4fde-8880-dbccfadf25b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:52.080055 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb273c4d-1222-4fde-8880-dbccfadf25b0 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:52.094032 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1314/2672] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:28:52.099289 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db828080-2690-4b91-a1fb-a1d187b1cb0c None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:52.112208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db828080-2690-4b91-a1fb-a1d187b1cb0c None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:52.120689 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627e272-e637-4876-ab4c-392bbdcae013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:52.121387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627e272-e637-4876-ab4c-392bbdcae013 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:52.121673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627e272-e637-4876-ab4c-392bbdcae013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:52.121943 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627e272-e637-4876-ab4c-392bbdcae013 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:52.122632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627e272-e637-4876-ab4c-392bbdcae013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:52.124741 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627e272-e637-4876-ab4c-392bbdcae013 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:52.163079 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1359/2673] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:52 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:52.164479 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273c4d-1222-4fde-8880-dbccfadf25b0 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:52.178883 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273c4d-1222-4fde-8880-dbccfadf25b0 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:52.224794 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627e272-e637-4876-ab4c-392bbdcae013 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:52.227224 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d627e272-e637-4876-ab4c-392bbdcae013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:52.283125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67982ad-bf0b-41c4-9cfc-1d2942bd62e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:52.284255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67982ad-bf0b-41c4-9cfc-1d2942bd62e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:52.284538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67982ad-bf0b-41c4-9cfc-1d2942bd62e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:52.284799 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67982ad-bf0b-41c4-9cfc-1d2942bd62e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:52.285612 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67982ad-bf0b-41c4-9cfc-1d2942bd62e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:52.287710 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67982ad-bf0b-41c4-9cfc-1d2942bd62e4 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:52.316233 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1315/2674] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:52 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:52.320930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67982ad-bf0b-41c4-9cfc-1d2942bd62e4 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:52.331597 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67982ad-bf0b-41c4-9cfc-1d2942bd62e4 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:52.337286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f8f77-08e5-4d1c-8037-43313122f9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:52.338035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f8f77-08e5-4d1c-8037-43313122f9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:52.338405 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f8f77-08e5-4d1c-8037-43313122f9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:52.338681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f8f77-08e5-4d1c-8037-43313122f9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:52.339396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f8f77-08e5-4d1c-8037-43313122f9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:52.341098 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f8f77-08e5-4d1c-8037-43313122f9e1 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:52.349891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627e272-e637-4876-ab4c-392bbdcae013 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:52.354816 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1316/2675] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:28:52.357403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f264d-d439-4cb6-b26e-9028f5c518fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:52.358140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f264d-d439-4cb6-b26e-9028f5c518fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:52.358695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f264d-d439-4cb6-b26e-9028f5c518fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:52.358965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f264d-d439-4cb6-b26e-9028f5c518fa admin admin] PATH_INFO: `/v3/projects/b07814ce808c4f66928a18672df58d68` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:52.359418 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f8f77-08e5-4d1c-8037-43313122f9e1 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:52.360353 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f264d-d439-4cb6-b26e-9028f5c518fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07814ce808c4f66928a18672df58d68)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:52.362393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f264d-d439-4cb6-b26e-9028f5c518fa admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:52.369977 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f8f77-08e5-4d1c-8037-43313122f9e1 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:52.375205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4988b-da81-4393-89d7-30e523a44d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:52.375833 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4988b-da81-4393-89d7-30e523a44d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:52.376098 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4988b-da81-4393-89d7-30e523a44d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:52.376372 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4988b-da81-4393-89d7-30e523a44d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:52.377027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4988b-da81-4393-89d7-30e523a44d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:52.378708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4988b-da81-4393-89d7-30e523a44d7f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:52.395958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1317/2676] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:28:52.401950 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4988b-da81-4393-89d7-30e523a44d7f admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:52.419570 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4988b-da81-4393-89d7-30e523a44d7f admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:52.431787 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-539f264d-d439-4cb6-b26e-9028f5c518fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07814ce808c4f66928a18672df58d68', 'request_id': 'req-539f264d-d439-4cb6-b26e-9028f5c518fa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:52.438087 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-539f264d-d439-4cb6-b26e-9028f5c518fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07814ce808c4f66928a18672df58d68', 'request_id': 'req-539f264d-d439-4cb6-b26e-9028f5c518fa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:52.449892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-539f264d-d439-4cb6-b26e-9028f5c518fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07814ce808c4f66928a18672df58d68', 'request_id': 'req-539f264d-d439-4cb6-b26e-9028f5c518fa'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:52.454646 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:52.477504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-539f264d-d439-4cb6-b26e-9028f5c518fa admin admin] The token cache is being invalidate because project b07814ce808c4f66928a18672df58d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:52.478048 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-539f264d-d439-4cb6-b26e-9028f5c518fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:52.479824 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-539f264d-d439-4cb6-b26e-9028f5c518fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:52.486000 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1360/2677] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:52 2022] DELETE /identity/v3/projects/b07814ce808c4f66928a18672df58d68 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:52.491342 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f264d-d439-4cb6-b26e-9028f5c518fa admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:52.492982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-539f264d-d439-4cb6-b26e-9028f5c518fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:52.504786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5a752-10a3-4f0f-889c-8342a7a1af04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:52.505498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5a752-10a3-4f0f-889c-8342a7a1af04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:52.505820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5a752-10a3-4f0f-889c-8342a7a1af04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:52.506091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5a752-10a3-4f0f-889c-8342a7a1af04 admin admin] PATH_INFO: `/v3/projects/4a6d95dfb55946ae87f0e1bc31deed72/users/0c3402d33f8f4b23ad61f89a44a12c8b/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:52.525473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5a752-10a3-4f0f-889c-8342a7a1af04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a6d95dfb55946ae87f0e1bc31deed72, user_id=0c3402d33f8f4b23ad61f89a44a12c8b, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:52.528332 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5a752-10a3-4f0f-889c-8342a7a1af04 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:52.546666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1318/2678] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:52 2022] PUT /identity/v3/projects/4a6d95dfb55946ae87f0e1bc31deed72/users/0c3402d33f8f4b23ad61f89a44a12c8b/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:52.598857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f264d-d439-4cb6-b26e-9028f5c518fa admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:52.630150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a878db-6a85-4903-bd7f-58f77015ecd6 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:52.630433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a878db-6a85-4903-bd7f-58f77015ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:52.630701 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a878db-6a85-4903-bd7f-58f77015ecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:52.645856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:52.665272 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-c3a878db-6a85-4903-bd7f-58f77015ecd6 None None] MFA Rules not processed for user `0c3402d33f8f4b23ad61f89a44a12c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:52.666920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c3a878db-6a85-4903-bd7f-58f77015ecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:52.695496 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bafe8c-eb20-4638-8b42-de9f095f7215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:52.696194 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bafe8c-eb20-4638-8b42-de9f095f7215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:52.696465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bafe8c-eb20-4638-8b42-de9f095f7215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:52.696728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bafe8c-eb20-4638-8b42-de9f095f7215 admin admin] PATH_INFO: `/v3/users/4da1c6126b0a441fafa831224908d063` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:52.698159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bafe8c-eb20-4638-8b42-de9f095f7215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da1c6126b0a441fafa831224908d063)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:52.700213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bafe8c-eb20-4638-8b42-de9f095f7215 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:52.774852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-72bafe8c-eb20-4638-8b42-de9f095f7215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da1c6126b0a441fafa831224908d063'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:52.783370 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1319/2679] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:52.787323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-72bafe8c-eb20-4638-8b42-de9f095f7215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da1c6126b0a441fafa831224908d063'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:52.800856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a878db-6a85-4903-bd7f-58f77015ecd6 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:52.803043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-c3a878db-6a85-4903-bd7f-58f77015ecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:52.808204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-72bafe8c-eb20-4638-8b42-de9f095f7215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da1c6126b0a441fafa831224908d063'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:52.809136 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-72bafe8c-eb20-4638-8b42-de9f095f7215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da1c6126b0a441fafa831224908d063'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:52.820182 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-72bafe8c-eb20-4638-8b42-de9f095f7215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da1c6126b0a441fafa831224908d063'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:52.829114 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1361/2680] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:52 2022] DELETE /identity/v3/users/4da1c6126b0a441fafa831224908d063 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:52.895224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a878db-6a85-4903-bd7f-58f77015ecd6 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:52.973491 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979abf2-954f-4d62-870e-948dd5e709b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:52.974610 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979abf2-954f-4d62-870e-948dd5e709b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:52.975091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979abf2-954f-4d62-870e-948dd5e709b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:52.975587 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979abf2-954f-4d62-870e-948dd5e709b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:52.978826 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6979abf2-954f-4d62-870e-948dd5e709b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:53.072479 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979abf2-954f-4d62-870e-948dd5e709b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:53.074090 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979abf2-954f-4d62-870e-948dd5e709b2 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:53.088454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1320/2681] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:28:53.122244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bafe8c-eb20-4638-8b42-de9f095f7215 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:53.124599 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-72bafe8c-eb20-4638-8b42-de9f095f7215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:53.161807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:53.213378 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bafe8c-eb20-4638-8b42-de9f095f7215 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:53.221448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a10dc-b732-4f27-9df0-73563128fef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:53.222830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a10dc-b732-4f27-9df0-73563128fef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:53.223203 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a10dc-b732-4f27-9df0-73563128fef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:53.223589 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a10dc-b732-4f27-9df0-73563128fef1 admin admin] PATH_INFO: `/v3/users/0c3402d33f8f4b23ad61f89a44a12c8b` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:53.225815 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a10dc-b732-4f27-9df0-73563128fef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3402d33f8f4b23ad61f89a44a12c8b)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:53.230130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a10dc-b732-4f27-9df0-73563128fef1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:53.232182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979abf2-954f-4d62-870e-948dd5e709b2 service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:53.235181 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6979abf2-954f-4d62-870e-948dd5e709b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:53.271397 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979abf2-954f-4d62-870e-948dd5e709b2 service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:53.280171 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71e5cf-3c47-47ce-af92-e14ed7215e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:53.281212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71e5cf-3c47-47ce-af92-e14ed7215e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:53.281544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71e5cf-3c47-47ce-af92-e14ed7215e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:53.281882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71e5cf-3c47-47ce-af92-e14ed7215e60 admin admin] PATH_INFO: `/v3/projects/1303c17eeb464759be46b665303dc4e8` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:53.283824 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71e5cf-3c47-47ce-af92-e14ed7215e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1303c17eeb464759be46b665303dc4e8)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:53.287311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71e5cf-3c47-47ce-af92-e14ed7215e60 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:53.290130 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=100 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:53.320458 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-919a10dc-b732-4f27-9df0-73563128fef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3402d33f8f4b23ad61f89a44a12c8b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:53.328874 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-919a10dc-b732-4f27-9df0-73563128fef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3402d33f8f4b23ad61f89a44a12c8b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:53.344734 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-919a10dc-b732-4f27-9df0-73563128fef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3402d33f8f4b23ad61f89a44a12c8b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:53.345646 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-919a10dc-b732-4f27-9df0-73563128fef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3402d33f8f4b23ad61f89a44a12c8b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:53.357570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-919a10dc-b732-4f27-9df0-73563128fef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3402d33f8f4b23ad61f89a44a12c8b'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:53.362936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-2d71e5cf-3c47-47ce-af92-e14ed7215e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1303c17eeb464759be46b665303dc4e8', 'request_id': 'req-2d71e5cf-3c47-47ce-af92-e14ed7215e60'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:53.366616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1362/2682] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:53 2022] DELETE /identity/v3/users/0c3402d33f8f4b23ad61f89a44a12c8b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:53.371574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9330b16-0612-4cbc-a7c7-185b35a19ac7 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:53.371868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9330b16-0612-4cbc-a7c7-185b35a19ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:53.372121 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9330b16-0612-4cbc-a7c7-185b35a19ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:53.373647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-2d71e5cf-3c47-47ce-af92-e14ed7215e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1303c17eeb464759be46b665303dc4e8', 'request_id': 'req-2d71e5cf-3c47-47ce-af92-e14ed7215e60'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:53.384642 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-2d71e5cf-3c47-47ce-af92-e14ed7215e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1303c17eeb464759be46b665303dc4e8', 'request_id': 'req-2d71e5cf-3c47-47ce-af92-e14ed7215e60'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:53.394658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e9330b16-0612-4cbc-a7c7-185b35a19ac7 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:53.395995 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e9330b16-0612-4cbc-a7c7-185b35a19ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:53.401748 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-2d71e5cf-3c47-47ce-af92-e14ed7215e60 admin admin] The token cache is being invalidate because project 1303c17eeb464759be46b665303dc4e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:53.402058 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-2d71e5cf-3c47-47ce-af92-e14ed7215e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:53.402822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-2d71e5cf-3c47-47ce-af92-e14ed7215e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:53.404516 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1321/2683] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:53 2022] DELETE /identity/v3/projects/1303c17eeb464759be46b665303dc4e8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:53.410124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883e95e-2d7c-4011-be83-f5e2fd1fd9e5 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:53.410412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883e95e-2d7c-4011-be83-f5e2fd1fd9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:53.410690 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883e95e-2d7c-4011-be83-f5e2fd1fd9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:53.440798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-7883e95e-2d7c-4011-be83-f5e2fd1fd9e5 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:53.442601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-7883e95e-2d7c-4011-be83-f5e2fd1fd9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:53.469220 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1363/2684] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:53.487240 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9330b16-0612-4cbc-a7c7-185b35a19ac7 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:53.489955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e9330b16-0612-4cbc-a7c7-185b35a19ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:53.545537 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1322/2685] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:28:53.558471 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12f307-7b8e-4521-88ea-edaa61716ebc None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:53.558993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12f307-7b8e-4521-88ea-edaa61716ebc None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:53.559571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12f307-7b8e-4521-88ea-edaa61716ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:53.560423 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:53.576231 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9330b16-0612-4cbc-a7c7-185b35a19ac7 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:53.580931 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a15090-b94f-4350-b4da-feed25e77f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:53.581726 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a15090-b94f-4350-b4da-feed25e77f90 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:53.582005 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a15090-b94f-4350-b4da-feed25e77f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:53.582276 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a15090-b94f-4350-b4da-feed25e77f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:53.591525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-2b12f307-7b8e-4521-88ea-edaa61716ebc None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:53.592656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a15090-b94f-4350-b4da-feed25e77f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:53.593538 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2b12f307-7b8e-4521-88ea-edaa61716ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:53.594221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a15090-b94f-4350-b4da-feed25e77f90 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:53.604619 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1323/2686] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:53.606228 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1364/2687] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:53.610805 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12f307-7b8e-4521-88ea-edaa61716ebc None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:53.621535 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12f307-7b8e-4521-88ea-edaa61716ebc None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:53.626788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8478bb-9e01-4b09-bdde-45792375d0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:53.627625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8478bb-9e01-4b09-bdde-45792375d0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:53.628062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8478bb-9e01-4b09-bdde-45792375d0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:53.628433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8478bb-9e01-4b09-bdde-45792375d0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:53.629315 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8478bb-9e01-4b09-bdde-45792375d0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:28:53.629901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8478bb-9e01-4b09-bdde-45792375d0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:53.632979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8478bb-9e01-4b09-bdde-45792375d0ed admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:53.657163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1324/2688] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:28:53.661800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a15090-b94f-4350-b4da-feed25e77f90 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:53.672782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a15090-b94f-4350-b4da-feed25e77f90 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:53.681012 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c77f5-9738-45eb-ad5a-60df2b581503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:53.682260 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c77f5-9738-45eb-ad5a-60df2b581503 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:53.682922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c77f5-9738-45eb-ad5a-60df2b581503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:53.683543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c77f5-9738-45eb-ad5a-60df2b581503 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:53.684786 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c77f5-9738-45eb-ad5a-60df2b581503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:53.689496 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c77f5-9738-45eb-ad5a-60df2b581503 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:53.746458 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1365/2689] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:53 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:53.753266 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8478bb-9e01-4b09-bdde-45792375d0ed admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:53.766601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8478bb-9e01-4b09-bdde-45792375d0ed admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:53.873581 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6f08f-0e06-44cf-8c88-276d327ad4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:53.874943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6f08f-0e06-44cf-8c88-276d327ad4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:53.875406 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6f08f-0e06-44cf-8c88-276d327ad4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:53.875732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6f08f-0e06-44cf-8c88-276d327ad4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:53.877201 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6f08f-0e06-44cf-8c88-276d327ad4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:53.880921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6f08f-0e06-44cf-8c88-276d327ad4d6 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:53.908441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:53.914404 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1325/2690] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:53 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:28:53.920039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c77f5-9738-45eb-ad5a-60df2b581503 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:53.940226 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c77f5-9738-45eb-ad5a-60df2b581503 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:53.948377 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dd8cf-ea17-42ba-be93-d146ce3a4611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:53.949423 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dd8cf-ea17-42ba-be93-d146ce3a4611 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:53.950042 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dd8cf-ea17-42ba-be93-d146ce3a4611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:53.950607 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dd8cf-ea17-42ba-be93-d146ce3a4611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:53.951888 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dd8cf-ea17-42ba-be93-d146ce3a4611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:53.954698 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dd8cf-ea17-42ba-be93-d146ce3a4611 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:53.969890 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1366/2691] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:53.975877 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6f08f-0e06-44cf-8c88-276d327ad4d6 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:53.986106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6f08f-0e06-44cf-8c88-276d327ad4d6 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:53.992356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136760f-5fd6-4223-b44d-105ea43f8875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:53.993026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136760f-5fd6-4223-b44d-105ea43f8875 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:53.993303 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136760f-5fd6-4223-b44d-105ea43f8875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:53.993576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136760f-5fd6-4223-b44d-105ea43f8875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:53.994277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136760f-5fd6-4223-b44d-105ea43f8875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:53.995928 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136760f-5fd6-4223-b44d-105ea43f8875 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:54.009910 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1326/2692] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:54.016634 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dd8cf-ea17-42ba-be93-d146ce3a4611 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:54.024280 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136760f-5fd6-4223-b44d-105ea43f8875 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:54.027230 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f136760f-5fd6-4223-b44d-105ea43f8875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:54.035409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dd8cf-ea17-42ba-be93-d146ce3a4611 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:54.044346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78173e2-f514-4478-a6d8-e2fa31cf1dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:54.045648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78173e2-f514-4478-a6d8-e2fa31cf1dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:54.046131 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78173e2-f514-4478-a6d8-e2fa31cf1dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:54.046613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78173e2-f514-4478-a6d8-e2fa31cf1dc2 admin admin] PATH_INFO: `/v3/projects/017eeedbc4ad479f9bab60a480738a39/users/1d56a9f4d1af4f3ba320e46a7ef3cdc3/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:54.053395 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136760f-5fd6-4223-b44d-105ea43f8875 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:54.061310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:54.062779 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:54.063278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:54.063894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6 admin admin] PATH_INFO: `/v3/projects/4a6d95dfb55946ae87f0e1bc31deed72` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:54.067088 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a6d95dfb55946ae87f0e1bc31deed72)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:54.072319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:54.076808 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78173e2-f514-4478-a6d8-e2fa31cf1dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017eeedbc4ad479f9bab60a480738a39, user_id=1d56a9f4d1af4f3ba320e46a7ef3cdc3, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:54.079642 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78173e2-f514-4478-a6d8-e2fa31cf1dc2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:54.100267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1367/2693] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:54 2022] PUT /identity/v3/projects/017eeedbc4ad479f9bab60a480738a39/users/1d56a9f4d1af4f3ba320e46a7ef3cdc3/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:54.114705 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a4d23-3f48-4a4c-9596-27a288ace92f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:54.115511 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a4d23-3f48-4a4c-9596-27a288ace92f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:54.116011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a4d23-3f48-4a4c-9596-27a288ace92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:54.140419 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a6d95dfb55946ae87f0e1bc31deed72', 'request_id': 'req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:54.153868 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a6d95dfb55946ae87f0e1bc31deed72', 'request_id': 'req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:54.161100 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-bc0a4d23-3f48-4a4c-9596-27a288ace92f None None] MFA Rules not processed for user `1d56a9f4d1af4f3ba320e46a7ef3cdc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:54.163250 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bc0a4d23-3f48-4a4c-9596-27a288ace92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:54.166900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a6d95dfb55946ae87f0e1bc31deed72', 'request_id': 'req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:54.184704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6 admin admin] The token cache is being invalidate because project 4a6d95dfb55946ae87f0e1bc31deed72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:54.185182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:54.186302 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:54.189155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1327/2694] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:54 2022] DELETE /identity/v3/projects/4a6d95dfb55946ae87f0e1bc31deed72 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:54.262068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1368/2695] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:54.263583 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:54.265310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:54.351195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ef9cf-71ac-427b-afcb-cb8c7ba6c2c6 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:54.357936 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb9ed7-d12d-4f02-bfda-8930bb42ade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:54.358900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb9ed7-d12d-4f02-bfda-8930bb42ade0 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:54.359320 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb9ed7-d12d-4f02-bfda-8930bb42ade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:54.359782 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb9ed7-d12d-4f02-bfda-8930bb42ade0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:54.360537 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb9ed7-d12d-4f02-bfda-8930bb42ade0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:54.362726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb9ed7-d12d-4f02-bfda-8930bb42ade0 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:54.396289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1328/2696] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:54 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:54.401432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a4d23-3f48-4a4c-9596-27a288ace92f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:54.415779 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a4d23-3f48-4a4c-9596-27a288ace92f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:54.507382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68efe44-0bfc-4ffb-8495-bc739e784979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:54.508335 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68efe44-0bfc-4ffb-8495-bc739e784979 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:54.508679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68efe44-0bfc-4ffb-8495-bc739e784979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:54.509018 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68efe44-0bfc-4ffb-8495-bc739e784979 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:54.509857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68efe44-0bfc-4ffb-8495-bc739e784979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:54.512871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68efe44-0bfc-4ffb-8495-bc739e784979 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:54.538105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:54.549674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1369/2697] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:54 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:54.555243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb9ed7-d12d-4f02-bfda-8930bb42ade0 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:54.572883 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb9ed7-d12d-4f02-bfda-8930bb42ade0 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:54.580247 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baab90-506a-4fc3-a26e-bf97d4c385f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:54.581181 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baab90-506a-4fc3-a26e-bf97d4c385f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:54.581629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baab90-506a-4fc3-a26e-bf97d4c385f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:54.582121 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baab90-506a-4fc3-a26e-bf97d4c385f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:54.583125 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61baab90-506a-4fc3-a26e-bf97d4c385f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:54.586183 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61baab90-506a-4fc3-a26e-bf97d4c385f7 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:54.605075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1329/2698] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:54.610218 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68efe44-0bfc-4ffb-8495-bc739e784979 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:54.621452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68efe44-0bfc-4ffb-8495-bc739e784979 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:54.626616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcc5e9-ada1-4cb1-9872-0fd0075ecf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:54.627214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcc5e9-ada1-4cb1-9872-0fd0075ecf61 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:54.627515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcc5e9-ada1-4cb1-9872-0fd0075ecf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:54.627768 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcc5e9-ada1-4cb1-9872-0fd0075ecf61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:54.628423 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcc5e9-ada1-4cb1-9872-0fd0075ecf61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:54.630081 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fcc5e9-ada1-4cb1-9872-0fd0075ecf61 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:54.641235 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1370/2699] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:54.645718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baab90-506a-4fc3-a26e-bf97d4c385f7 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:54.657465 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baab90-506a-4fc3-a26e-bf97d4c385f7 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:54.663198 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4a875-f1fb-4c55-9c12-04a8ee812041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:54.663882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4a875-f1fb-4c55-9c12-04a8ee812041 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:54.664157 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4a875-f1fb-4c55-9c12-04a8ee812041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:54.664422 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4a875-f1fb-4c55-9c12-04a8ee812041 admin admin] PATH_INFO: `/v3/projects/9afda8aa253d4ef6b1453814f3b0e8ab/users/12e8a83303de40dca49e61078420b05e/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:54.684005 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4a875-f1fb-4c55-9c12-04a8ee812041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9afda8aa253d4ef6b1453814f3b0e8ab, user_id=12e8a83303de40dca49e61078420b05e, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:54.688732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4a875-f1fb-4c55-9c12-04a8ee812041 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:54.706914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1330/2700] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:54 2022] PUT /identity/v3/projects/9afda8aa253d4ef6b1453814f3b0e8ab/users/12e8a83303de40dca49e61078420b05e/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:28:54.719125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc4df4-af51-4af8-86bc-78cf3949af09 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:54.719544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc4df4-af51-4af8-86bc-78cf3949af09 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:54.720034 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc4df4-af51-4af8-86bc-78cf3949af09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:54.951112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-b4fc4df4-af51-4af8-86bc-78cf3949af09 None None] MFA Rules not processed for user `12e8a83303de40dca49e61078420b05e`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:54.953096 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b4fc4df4-af51-4af8-86bc-78cf3949af09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:55.070637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1371/2701] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:55.076146 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4a875-f1fb-4c55-9c12-04a8ee812041 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:55.107472 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:55.158601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4a875-f1fb-4c55-9c12-04a8ee812041 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:55.164504 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f4f35-5d8b-479c-998f-e1f983dc85a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:55.165183 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f4f35-5d8b-479c-998f-e1f983dc85a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:55.165496 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f4f35-5d8b-479c-998f-e1f983dc85a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:55.165776 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f4f35-5d8b-479c-998f-e1f983dc85a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:55.166483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f4f35-5d8b-479c-998f-e1f983dc85a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:55.168524 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f4f35-5d8b-479c-998f-e1f983dc85a7 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:55.202025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1331/2702] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:28:55 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:55.207494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc4df4-af51-4af8-86bc-78cf3949af09 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:55.220658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc4df4-af51-4af8-86bc-78cf3949af09 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:55.282691 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935da18-992f-4cac-b28c-d2bc091ef6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:55.283294 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935da18-992f-4cac-b28c-d2bc091ef6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:55.283558 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935da18-992f-4cac-b28c-d2bc091ef6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:55.283820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935da18-992f-4cac-b28c-d2bc091ef6d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:55.284439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935da18-992f-4cac-b28c-d2bc091ef6d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:55.286378 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935da18-992f-4cac-b28c-d2bc091ef6d4 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:55.308303 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1372/2703] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:28:55 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:28:55.312457 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f4f35-5d8b-479c-998f-e1f983dc85a7 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:55.323712 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f4f35-5d8b-479c-998f-e1f983dc85a7 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:55.328514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb8f75-bbc2-4ab6-b2c1-c0d60a834b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:55.329123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb8f75-bbc2-4ab6-b2c1-c0d60a834b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:55.329426 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb8f75-bbc2-4ab6-b2c1-c0d60a834b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:55.329986 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb8f75-bbc2-4ab6-b2c1-c0d60a834b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:55.330639 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb8f75-bbc2-4ab6-b2c1-c0d60a834b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:55.332244 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb8f75-bbc2-4ab6-b2c1-c0d60a834b20 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:55.345880 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1332/2704] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:28:55.350299 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935da18-992f-4cac-b28c-d2bc091ef6d4 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:55.362622 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935da18-992f-4cac-b28c-d2bc091ef6d4 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:55.368395 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b372a40-9f78-4be7-855a-fe30aa6e64b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:55.369051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b372a40-9f78-4be7-855a-fe30aa6e64b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:55.369329 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b372a40-9f78-4be7-855a-fe30aa6e64b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:55.369596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b372a40-9f78-4be7-855a-fe30aa6e64b9 admin admin] PATH_INFO: `/v3/projects/13e0f7efa60f4421a088ab87a8e9a67f/users/9ebbbdbc8df8430cacbe49609c6986d3/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:55.386448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b372a40-9f78-4be7-855a-fe30aa6e64b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e0f7efa60f4421a088ab87a8e9a67f, user_id=9ebbbdbc8df8430cacbe49609c6986d3, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:55.389078 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b372a40-9f78-4be7-855a-fe30aa6e64b9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:55.405159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1373/2705] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:55 2022] PUT /identity/v3/projects/13e0f7efa60f4421a088ab87a8e9a67f/users/9ebbbdbc8df8430cacbe49609c6986d3/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:55.409400 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb8f75-bbc2-4ab6-b2c1-c0d60a834b20 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:55.420771 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb8f75-bbc2-4ab6-b2c1-c0d60a834b20 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:55.484003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21584fbb-1ea2-404c-8d67-7f9b2c679bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:55.484505 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21584fbb-1ea2-404c-8d67-7f9b2c679bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:55.484781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21584fbb-1ea2-404c-8d67-7f9b2c679bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:55.485500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21584fbb-1ea2-404c-8d67-7f9b2c679bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:55.485743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21584fbb-1ea2-404c-8d67-7f9b2c679bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:55.487402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21584fbb-1ea2-404c-8d67-7f9b2c679bfa admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:55.498379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1333/2706] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:28:55.503617 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b372a40-9f78-4be7-855a-fe30aa6e64b9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:55.515136 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b372a40-9f78-4be7-855a-fe30aa6e64b9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:55.521956 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d97031-0c67-45f4-92fb-a80148563e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:55.522668 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d97031-0c67-45f4-92fb-a80148563e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:55.522968 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d97031-0c67-45f4-92fb-a80148563e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:55.523244 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d97031-0c67-45f4-92fb-a80148563e46 admin admin] PATH_INFO: `/v3/projects/13e0f7efa60f4421a088ab87a8e9a67f/users/9ebbbdbc8df8430cacbe49609c6986d3/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:55.525203 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d97031-0c67-45f4-92fb-a80148563e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e0f7efa60f4421a088ab87a8e9a67f, user_id=9ebbbdbc8df8430cacbe49609c6986d3, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:55.527849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d97031-0c67-45f4-92fb-a80148563e46 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:55.539502 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1374/2707] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:28:55 2022] PUT /identity/v3/projects/13e0f7efa60f4421a088ab87a8e9a67f/users/9ebbbdbc8df8430cacbe49609c6986d3/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:55.550994 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef3262-f60d-4a35-854d-cc3d7fa646ea None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:55.551370 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef3262-f60d-4a35-854d-cc3d7fa646ea None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:55.551624 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef3262-f60d-4a35-854d-cc3d7fa646ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:55.594394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-92ef3262-f60d-4a35-854d-cc3d7fa646ea None None] MFA Rules not processed for user `9ebbbdbc8df8430cacbe49609c6986d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:55.596551 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-92ef3262-f60d-4a35-854d-cc3d7fa646ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:55.689740 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1334/2708] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:55.701825 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d97031-0c67-45f4-92fb-a80148563e46 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:55.704061 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-57d97031-0c67-45f4-92fb-a80148563e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:55.747046 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:55.780281 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d97031-0c67-45f4-92fb-a80148563e46 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:55.787019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05492ee1-2fc6-4b29-91f3-6489b16b59a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:55.787637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05492ee1-2fc6-4b29-91f3-6489b16b59a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:55.787906 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05492ee1-2fc6-4b29-91f3-6489b16b59a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:55.788157 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05492ee1-2fc6-4b29-91f3-6489b16b59a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:55.798074 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05492ee1-2fc6-4b29-91f3-6489b16b59a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:55.799501 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05492ee1-2fc6-4b29-91f3-6489b16b59a9 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:55.809287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1375/2709] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:55.863197 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef3262-f60d-4a35-854d-cc3d7fa646ea None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:55.864680 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-92ef3262-f60d-4a35-854d-cc3d7fa646ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:55.877514 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef3262-f60d-4a35-854d-cc3d7fa646ea None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:55.881718 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd8fb8-7ba0-42f4-b8f2-470762945868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:55.882305 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd8fb8-7ba0-42f4-b8f2-470762945868 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:55.882579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd8fb8-7ba0-42f4-b8f2-470762945868 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:55.882875 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd8fb8-7ba0-42f4-b8f2-470762945868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:55.896921 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:55.943135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd8fb8-7ba0-42f4-b8f2-470762945868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:55.944576 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd8fb8-7ba0-42f4-b8f2-470762945868 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:55.954807 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1335/2710] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:58.995388 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05492ee1-2fc6-4b29-91f3-6489b16b59a9 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:59.078267 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05492ee1-2fc6-4b29-91f3-6489b16b59a9 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:59.085978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899edc77-7e52-4efc-8df3-1d6a41a2e6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:59.087067 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899edc77-7e52-4efc-8df3-1d6a41a2e6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:59.087542 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899edc77-7e52-4efc-8df3-1d6a41a2e6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:59.088028 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899edc77-7e52-4efc-8df3-1d6a41a2e6f3 admin admin] PATH_INFO: `/v3/users/1d56a9f4d1af4f3ba320e46a7ef3cdc3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:59.090038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899edc77-7e52-4efc-8df3-1d6a41a2e6f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d56a9f4d1af4f3ba320e46a7ef3cdc3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:59.093909 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899edc77-7e52-4efc-8df3-1d6a41a2e6f3 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:59.154510 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-899edc77-7e52-4efc-8df3-1d6a41a2e6f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d56a9f4d1af4f3ba320e46a7ef3cdc3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:59.166536 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-899edc77-7e52-4efc-8df3-1d6a41a2e6f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d56a9f4d1af4f3ba320e46a7ef3cdc3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:59.179587 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-899edc77-7e52-4efc-8df3-1d6a41a2e6f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d56a9f4d1af4f3ba320e46a7ef3cdc3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:59.180339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-899edc77-7e52-4efc-8df3-1d6a41a2e6f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d56a9f4d1af4f3ba320e46a7ef3cdc3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:59.189493 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-899edc77-7e52-4efc-8df3-1d6a41a2e6f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d56a9f4d1af4f3ba320e46a7ef3cdc3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:59.196861 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1376/2711] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:58 2022] DELETE /identity/v3/users/1d56a9f4d1af4f3ba320e46a7ef3cdc3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:59.201703 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c44f5-917d-4359-ad1b-e42ca34c9113 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:59.202195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c44f5-917d-4359-ad1b-e42ca34c9113 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:59.202287 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c44f5-917d-4359-ad1b-e42ca34c9113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:59.225332 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-b92c44f5-917d-4359-ad1b-e42ca34c9113 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:28:59.226746 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b92c44f5-917d-4359-ad1b-e42ca34c9113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:59.294048 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1336/2712] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:28:59.304090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899edc77-7e52-4efc-8df3-1d6a41a2e6f3 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:59.305640 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-899edc77-7e52-4efc-8df3-1d6a41a2e6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:59.373261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899edc77-7e52-4efc-8df3-1d6a41a2e6f3 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:59.378307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d05f0-3e00-4be9-bf1d-c8b6bf97dcbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:59.379159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d05f0-3e00-4be9-bf1d-c8b6bf97dcbb service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:59.379736 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d05f0-3e00-4be9-bf1d-c8b6bf97dcbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:59.380252 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d05f0-3e00-4be9-bf1d-c8b6bf97dcbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:59.387200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:28:59.391871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d05f0-3e00-4be9-bf1d-c8b6bf97dcbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:59.394970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d05f0-3e00-4be9-bf1d-c8b6bf97dcbb service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:59.410049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1377/2713] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:28:59.806829 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c44f5-917d-4359-ad1b-e42ca34c9113 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:59.808337 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b92c44f5-917d-4359-ad1b-e42ca34c9113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:28:59.820916 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c44f5-917d-4359-ad1b-e42ca34c9113 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:28:59.826075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ede42-627f-4ed0-800c-f699e210db85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:28:59.826772 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ede42-627f-4ed0-800c-f699e210db85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:28:59.827044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ede42-627f-4ed0-800c-f699e210db85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:28:59.827308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ede42-627f-4ed0-800c-f699e210db85 admin admin] PATH_INFO: `/v3/projects/017eeedbc4ad479f9bab60a480738a39` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:28:59.828469 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ede42-627f-4ed0-800c-f699e210db85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=017eeedbc4ad479f9bab60a480738a39)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:28:59.830458 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ede42-627f-4ed0-800c-f699e210db85 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:28:59.888052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-579ede42-627f-4ed0-800c-f699e210db85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017eeedbc4ad479f9bab60a480738a39', 'request_id': 'req-579ede42-627f-4ed0-800c-f699e210db85'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:59.899132 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-579ede42-627f-4ed0-800c-f699e210db85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017eeedbc4ad479f9bab60a480738a39', 'request_id': 'req-579ede42-627f-4ed0-800c-f699e210db85'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:59.906533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-579ede42-627f-4ed0-800c-f699e210db85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017eeedbc4ad479f9bab60a480738a39', 'request_id': 'req-579ede42-627f-4ed0-800c-f699e210db85'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:59.919361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-579ede42-627f-4ed0-800c-f699e210db85 admin admin] The token cache is being invalidate because project 017eeedbc4ad479f9bab60a480738a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:28:59.919612 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-579ede42-627f-4ed0-800c-f699e210db85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:59.920375 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-579ede42-627f-4ed0-800c-f699e210db85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:28:59.922046 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1337/2714] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:28:59 2022] DELETE /identity/v3/projects/017eeedbc4ad479f9bab60a480738a39 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:28:59.926309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d05f0-3e00-4be9-bf1d-c8b6bf97dcbb service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:28:59.937065 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d05f0-3e00-4be9-bf1d-c8b6bf97dcbb service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:00.002774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e534d-7e8c-4f2a-a9b5-c12e8a0368ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:00.003813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e534d-7e8c-4f2a-a9b5-c12e8a0368ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:00.003813 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e534d-7e8c-4f2a-a9b5-c12e8a0368ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:00.004077 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e534d-7e8c-4f2a-a9b5-c12e8a0368ba admin admin] PATH_INFO: `/v3/users/12e8a83303de40dca49e61078420b05e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:00.005213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e534d-7e8c-4f2a-a9b5-c12e8a0368ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e8a83303de40dca49e61078420b05e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:00.007339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e534d-7e8c-4f2a-a9b5-c12e8a0368ba admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:00.067222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb8e534d-7e8c-4f2a-a9b5-c12e8a0368ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e8a83303de40dca49e61078420b05e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.078047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb8e534d-7e8c-4f2a-a9b5-c12e8a0368ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e8a83303de40dca49e61078420b05e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.093431 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb8e534d-7e8c-4f2a-a9b5-c12e8a0368ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e8a83303de40dca49e61078420b05e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.094629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb8e534d-7e8c-4f2a-a9b5-c12e8a0368ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e8a83303de40dca49e61078420b05e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.105068 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-bb8e534d-7e8c-4f2a-a9b5-c12e8a0368ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e8a83303de40dca49e61078420b05e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.112455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1378/2715] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:28:59 2022] DELETE /identity/v3/users/12e8a83303de40dca49e61078420b05e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:29:00.419983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ede42-627f-4ed0-800c-f699e210db85 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:00.421584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-579ede42-627f-4ed0-800c-f699e210db85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:00.437653 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ede42-627f-4ed0-800c-f699e210db85 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:00.482204 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:00.503859 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709d0e3-6dff-4eb6-91c7-29223c014ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:00.504492 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709d0e3-6dff-4eb6-91c7-29223c014ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:00.504790 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709d0e3-6dff-4eb6-91c7-29223c014ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:00.505035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709d0e3-6dff-4eb6-91c7-29223c014ee2 admin admin] PATH_INFO: `/v3/projects/9afda8aa253d4ef6b1453814f3b0e8ab` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:00.506193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709d0e3-6dff-4eb6-91c7-29223c014ee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9afda8aa253d4ef6b1453814f3b0e8ab)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:00.508148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709d0e3-6dff-4eb6-91c7-29223c014ee2 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:00.564846 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0709d0e3-6dff-4eb6-91c7-29223c014ee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9afda8aa253d4ef6b1453814f3b0e8ab', 'request_id': 'req-0709d0e3-6dff-4eb6-91c7-29223c014ee2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.573555 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0709d0e3-6dff-4eb6-91c7-29223c014ee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9afda8aa253d4ef6b1453814f3b0e8ab', 'request_id': 'req-0709d0e3-6dff-4eb6-91c7-29223c014ee2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.580925 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0709d0e3-6dff-4eb6-91c7-29223c014ee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9afda8aa253d4ef6b1453814f3b0e8ab', 'request_id': 'req-0709d0e3-6dff-4eb6-91c7-29223c014ee2'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.591868 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0709d0e3-6dff-4eb6-91c7-29223c014ee2 admin admin] The token cache is being invalidate because project 9afda8aa253d4ef6b1453814f3b0e8ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:29:00.592150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0709d0e3-6dff-4eb6-91c7-29223c014ee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.592839 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0709d0e3-6dff-4eb6-91c7-29223c014ee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.594510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1338/2716] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:29:00 2022] DELETE /identity/v3/projects/9afda8aa253d4ef6b1453814f3b0e8ab => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:00.598891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e534d-7e8c-4f2a-a9b5-c12e8a0368ba admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:00.600364 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-bb8e534d-7e8c-4f2a-a9b5-c12e8a0368ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:00.614280 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e534d-7e8c-4f2a-a9b5-c12e8a0368ba admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:00.684544 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b0fc6-9f56-4e4d-8ba7-9e412aaeadad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:00.685183 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b0fc6-9f56-4e4d-8ba7-9e412aaeadad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:00.685458 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b0fc6-9f56-4e4d-8ba7-9e412aaeadad admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:00.685756 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b0fc6-9f56-4e4d-8ba7-9e412aaeadad admin admin] PATH_INFO: `/v3/users/9ebbbdbc8df8430cacbe49609c6986d3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:00.686941 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b0fc6-9f56-4e4d-8ba7-9e412aaeadad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ebbbdbc8df8430cacbe49609c6986d3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:00.688858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b0fc6-9f56-4e4d-8ba7-9e412aaeadad admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:00.703891 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:00.742841 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8f4b0fc6-9f56-4e4d-8ba7-9e412aaeadad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ebbbdbc8df8430cacbe49609c6986d3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.750570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8f4b0fc6-9f56-4e4d-8ba7-9e412aaeadad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ebbbdbc8df8430cacbe49609c6986d3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.763990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8f4b0fc6-9f56-4e4d-8ba7-9e412aaeadad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ebbbdbc8df8430cacbe49609c6986d3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.764734 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8f4b0fc6-9f56-4e4d-8ba7-9e412aaeadad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ebbbdbc8df8430cacbe49609c6986d3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.772957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-8f4b0fc6-9f56-4e4d-8ba7-9e412aaeadad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ebbbdbc8df8430cacbe49609c6986d3'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:00.779092 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1379/2717] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:29:00 2022] DELETE /identity/v3/users/9ebbbdbc8df8430cacbe49609c6986d3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:29:01.099668 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709d0e3-6dff-4eb6-91c7-29223c014ee2 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.101142 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0709d0e3-6dff-4eb6-91c7-29223c014ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:01.118758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709d0e3-6dff-4eb6-91c7-29223c014ee2 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.185912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aa02c-eb6a-45aa-8917-330fdfc64bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.186550 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aa02c-eb6a-45aa-8917-330fdfc64bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.186820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aa02c-eb6a-45aa-8917-330fdfc64bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.187092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aa02c-eb6a-45aa-8917-330fdfc64bc5 admin admin] PATH_INFO: `/v3/projects/13e0f7efa60f4421a088ab87a8e9a67f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.188259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9aa02c-eb6a-45aa-8917-330fdfc64bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e0f7efa60f4421a088ab87a8e9a67f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.190182 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9aa02c-eb6a-45aa-8917-330fdfc64bc5 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.240229 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-ac9aa02c-eb6a-45aa-8917-330fdfc64bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e0f7efa60f4421a088ab87a8e9a67f', 'request_id': 'req-ac9aa02c-eb6a-45aa-8917-330fdfc64bc5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:01.249468 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-ac9aa02c-eb6a-45aa-8917-330fdfc64bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e0f7efa60f4421a088ab87a8e9a67f', 'request_id': 'req-ac9aa02c-eb6a-45aa-8917-330fdfc64bc5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:01.256948 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-ac9aa02c-eb6a-45aa-8917-330fdfc64bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e0f7efa60f4421a088ab87a8e9a67f', 'request_id': 'req-ac9aa02c-eb6a-45aa-8917-330fdfc64bc5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:01.264241 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:01.268894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-ac9aa02c-eb6a-45aa-8917-330fdfc64bc5 admin admin] The token cache is being invalidate because project 13e0f7efa60f4421a088ab87a8e9a67f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:29:01.269379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-ac9aa02c-eb6a-45aa-8917-330fdfc64bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:01.270266 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-ac9aa02c-eb6a-45aa-8917-330fdfc64bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:01.272473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1339/2718] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:29:01 2022] DELETE /identity/v3/projects/13e0f7efa60f4421a088ab87a8e9a67f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:01.279263 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba12129-cb14-43c0-a1c7-1605bfb6c243 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.279817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba12129-cb14-43c0-a1c7-1605bfb6c243 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.279915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba12129-cb14-43c0-a1c7-1605bfb6c243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.301911 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-cba12129-cb14-43c0-a1c7-1605bfb6c243 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:01.303090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-cba12129-cb14-43c0-a1c7-1605bfb6c243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:01.367455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1380/2719] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:01.379855 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e05298-ceea-4ace-8b83-b03746ec2c88 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.380128 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e05298-ceea-4ace-8b83-b03746ec2c88 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.380417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e05298-ceea-4ace-8b83-b03746ec2c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.401270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-44e05298-ceea-4ace-8b83-b03746ec2c88 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:01.402546 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-44e05298-ceea-4ace-8b83-b03746ec2c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:01.410696 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1340/2720] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:01.415990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba12129-cb14-43c0-a1c7-1605bfb6c243 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.431366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba12129-cb14-43c0-a1c7-1605bfb6c243 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.439326 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebef2f-22c5-4a8f-adcd-109a9d7cbe76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.440305 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebef2f-22c5-4a8f-adcd-109a9d7cbe76 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.440782 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebef2f-22c5-4a8f-adcd-109a9d7cbe76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.441262 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebef2f-22c5-4a8f-adcd-109a9d7cbe76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.442491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebef2f-22c5-4a8f-adcd-109a9d7cbe76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:29:01.443031 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebef2f-22c5-4a8f-adcd-109a9d7cbe76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.446248 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebef2f-22c5-4a8f-adcd-109a9d7cbe76 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.462878 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1381/2721] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:29:01.467864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e05298-ceea-4ace-8b83-b03746ec2c88 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.477797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e05298-ceea-4ace-8b83-b03746ec2c88 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.482992 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200388b-a8c4-41ba-b86c-c81343e8882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.483605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200388b-a8c4-41ba-b86c-c81343e8882a admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.483894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200388b-a8c4-41ba-b86c-c81343e8882a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.484157 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200388b-a8c4-41ba-b86c-c81343e8882a admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.484784 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200388b-a8c4-41ba-b86c-c81343e8882a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.486746 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200388b-a8c4-41ba-b86c-c81343e8882a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.520801 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1341/2722] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:29:01 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:29:01.526952 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebef2f-22c5-4a8f-adcd-109a9d7cbe76 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.537631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebef2f-22c5-4a8f-adcd-109a9d7cbe76 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.603974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7f401-91c2-47c6-bfd0-641f8c02460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.604673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7f401-91c2-47c6-bfd0-641f8c02460c admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.604924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7f401-91c2-47c6-bfd0-641f8c02460c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.605188 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7f401-91c2-47c6-bfd0-641f8c02460c admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.606102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7f401-91c2-47c6-bfd0-641f8c02460c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.608645 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7f401-91c2-47c6-bfd0-641f8c02460c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.631102 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1382/2723] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:29:01 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:29:01.636341 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200388b-a8c4-41ba-b86c-c81343e8882a admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.650349 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200388b-a8c4-41ba-b86c-c81343e8882a admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.655692 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ace39-83a3-4e29-af93-1f0714076b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.656307 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ace39-83a3-4e29-af93-1f0714076b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.656563 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ace39-83a3-4e29-af93-1f0714076b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.656841 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ace39-83a3-4e29-af93-1f0714076b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.657466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ace39-83a3-4e29-af93-1f0714076b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.659160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ace39-83a3-4e29-af93-1f0714076b13 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.670542 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1342/2724] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:29:01.674760 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7f401-91c2-47c6-bfd0-641f8c02460c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.686051 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7f401-91c2-47c6-bfd0-641f8c02460c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.691167 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70de7e-7a5f-4bda-9bef-bb2618e4382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.691888 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70de7e-7a5f-4bda-9bef-bb2618e4382f admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.692257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70de7e-7a5f-4bda-9bef-bb2618e4382f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.692611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70de7e-7a5f-4bda-9bef-bb2618e4382f admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.693376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70de7e-7a5f-4bda-9bef-bb2618e4382f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.695355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70de7e-7a5f-4bda-9bef-bb2618e4382f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.698509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:01.709996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1383/2725] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:29:01.714493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ace39-83a3-4e29-af93-1f0714076b13 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.725720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ace39-83a3-4e29-af93-1f0714076b13 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.731690 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8259870-ce80-43c1-a2c6-fb829769088a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.732369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8259870-ce80-43c1-a2c6-fb829769088a admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.732643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8259870-ce80-43c1-a2c6-fb829769088a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.732911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8259870-ce80-43c1-a2c6-fb829769088a admin admin] PATH_INFO: `/v3/projects/2338f6aeec584b9c83e3b1d7ce4eab34/users/64163a7f77054188aae74b90cce48d89/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.750051 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8259870-ce80-43c1-a2c6-fb829769088a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2338f6aeec584b9c83e3b1d7ce4eab34, user_id=64163a7f77054188aae74b90cce48d89, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.752831 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8259870-ce80-43c1-a2c6-fb829769088a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.770447 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1343/2726] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:29:01 2022] PUT /identity/v3/projects/2338f6aeec584b9c83e3b1d7ce4eab34/users/64163a7f77054188aae74b90cce48d89/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:01.782483 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae077923-77d3-4133-ab12-065bd26306b3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.782693 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae077923-77d3-4133-ab12-065bd26306b3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.783029 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae077923-77d3-4133-ab12-065bd26306b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.812058 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ae077923-77d3-4133-ab12-065bd26306b3 None None] MFA Rules not processed for user `64163a7f77054188aae74b90cce48d89`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:01.813309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ae077923-77d3-4133-ab12-065bd26306b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:01.883581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1384/2727] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:29:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:01.897641 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8259870-ce80-43c1-a2c6-fb829769088a admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:01.899571 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-b8259870-ce80-43c1-a2c6-fb829769088a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:01.965050 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8259870-ce80-43c1-a2c6-fb829769088a admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:01.969295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539e370-595a-409f-aeb5-e46f3114dc62 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5356835ef79c458bbfa7d6adafd0cb36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:01.969954 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539e370-595a-409f-aeb5-e46f3114dc62 service glance] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:01.970221 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539e370-595a-409f-aeb5-e46f3114dc62 service glance] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:01.970483 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539e370-595a-409f-aeb5-e46f3114dc62 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:01.979791 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539e370-595a-409f-aeb5-e46f3114dc62 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:01.981228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539e370-595a-409f-aeb5-e46f3114dc62 service glance] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:01.991148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1344/2728] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:29:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:29:11.880330 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=33 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:11.986601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=53,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:28.000793 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae077923-77d3-4133-ab12-065bd26306b3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:28.073465 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae077923-77d3-4133-ab12-065bd26306b3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:28.079416 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c576cc-4f16-4b46-aae6-4d659e986e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:28.080153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c576cc-4f16-4b46-aae6-4d659e986e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:28.080508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c576cc-4f16-4b46-aae6-4d659e986e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:28.080831 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c576cc-4f16-4b46-aae6-4d659e986e0a admin admin] PATH_INFO: `/v3/users/64163a7f77054188aae74b90cce48d89` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:28.082285 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c576cc-4f16-4b46-aae6-4d659e986e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=64163a7f77054188aae74b90cce48d89)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:28.084443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c576cc-4f16-4b46-aae6-4d659e986e0a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:28.139530 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-90c576cc-4f16-4b46-aae6-4d659e986e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64163a7f77054188aae74b90cce48d89'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:28.147008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-90c576cc-4f16-4b46-aae6-4d659e986e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64163a7f77054188aae74b90cce48d89'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:28.160787 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-90c576cc-4f16-4b46-aae6-4d659e986e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64163a7f77054188aae74b90cce48d89'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:28.161826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-90c576cc-4f16-4b46-aae6-4d659e986e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64163a7f77054188aae74b90cce48d89'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:28.171372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-90c576cc-4f16-4b46-aae6-4d659e986e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64163a7f77054188aae74b90cce48d89'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:28.178297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1385/2729] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:29:27 2022] DELETE /identity/v3/users/64163a7f77054188aae74b90cce48d89 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:28.184115 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb123ea-c016-4884-967f-f5371e0b06f5 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:28.184723 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb123ea-c016-4884-967f-f5371e0b06f5 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:28.184991 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb123ea-c016-4884-967f-f5371e0b06f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:28.210706 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-3cb123ea-c016-4884-967f-f5371e0b06f5 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:28.212069 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3cb123ea-c016-4884-967f-f5371e0b06f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:28.287666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1345/2730] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:28.299275 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c576cc-4f16-4b46-aae6-4d659e986e0a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:28.301181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-90c576cc-4f16-4b46-aae6-4d659e986e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:28.365104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c576cc-4f16-4b46-aae6-4d659e986e0a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:28.368952 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2dfef-df05-4b2e-a54f-c44b73b6f1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:28.369563 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2dfef-df05-4b2e-a54f-c44b73b6f1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:28.369861 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2dfef-df05-4b2e-a54f-c44b73b6f1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:28.370126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2dfef-df05-4b2e-a54f-c44b73b6f1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:28.381049 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2dfef-df05-4b2e-a54f-c44b73b6f1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:28.382537 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2dfef-df05-4b2e-a54f-c44b73b6f1e6 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:28.393390 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1386/2731] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:29:28.711240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb123ea-c016-4884-967f-f5371e0b06f5 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:28.712750 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3cb123ea-c016-4884-967f-f5371e0b06f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:28.725982 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb123ea-c016-4884-967f-f5371e0b06f5 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:28.732136 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18aa8b1-5f6b-443c-9a00-261ed523e63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:28.732786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18aa8b1-5f6b-443c-9a00-261ed523e63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:28.733046 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18aa8b1-5f6b-443c-9a00-261ed523e63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:28.733309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18aa8b1-5f6b-443c-9a00-261ed523e63f admin admin] PATH_INFO: `/v3/projects/2338f6aeec584b9c83e3b1d7ce4eab34` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:28.734529 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18aa8b1-5f6b-443c-9a00-261ed523e63f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2338f6aeec584b9c83e3b1d7ce4eab34)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:28.736573 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18aa8b1-5f6b-443c-9a00-261ed523e63f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:28.795595 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f18aa8b1-5f6b-443c-9a00-261ed523e63f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2338f6aeec584b9c83e3b1d7ce4eab34', 'request_id': 'req-f18aa8b1-5f6b-443c-9a00-261ed523e63f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:28.804762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f18aa8b1-5f6b-443c-9a00-261ed523e63f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2338f6aeec584b9c83e3b1d7ce4eab34', 'request_id': 'req-f18aa8b1-5f6b-443c-9a00-261ed523e63f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:28.811645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f18aa8b1-5f6b-443c-9a00-261ed523e63f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2338f6aeec584b9c83e3b1d7ce4eab34', 'request_id': 'req-f18aa8b1-5f6b-443c-9a00-261ed523e63f'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:28.823615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f18aa8b1-5f6b-443c-9a00-261ed523e63f admin admin] The token cache is being invalidate because project 2338f6aeec584b9c83e3b1d7ce4eab34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:29:28.823935 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f18aa8b1-5f6b-443c-9a00-261ed523e63f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:28.824716 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f18aa8b1-5f6b-443c-9a00-261ed523e63f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:28.826291 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1346/2732] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:29:28 2022] DELETE /identity/v3/projects/2338f6aeec584b9c83e3b1d7ce4eab34 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:28.831996 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e9658-2c87-408e-8c35-c556927b755f None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:28.832362 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e9658-2c87-408e-8c35-c556927b755f None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:28.832664 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e9658-2c87-408e-8c35-c556927b755f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:28.859413 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-e96e9658-2c87-408e-8c35-c556927b755f None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:28.860663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-e96e9658-2c87-408e-8c35-c556927b755f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:28.879974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:28.929839 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1387/2733] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:29.000579 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96eb725-b21d-4f49-83bb-8ea9937c1308 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:29.000882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96eb725-b21d-4f49-83bb-8ea9937c1308 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:29.001113 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96eb725-b21d-4f49-83bb-8ea9937c1308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:29.023850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-a96eb725-b21d-4f49-83bb-8ea9937c1308 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:29.026045 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-a96eb725-b21d-4f49-83bb-8ea9937c1308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:29.035711 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1347/2734] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:29.040225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e9658-2c87-408e-8c35-c556927b755f None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:29.051085 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e9658-2c87-408e-8c35-c556927b755f None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:29.058105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b0ad6-cc63-4022-a018-9914c9a5eeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:29.058827 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b0ad6-cc63-4022-a018-9914c9a5eeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:29.059093 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b0ad6-cc63-4022-a018-9914c9a5eeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:29.059353 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b0ad6-cc63-4022-a018-9914c9a5eeb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:29.060013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b0ad6-cc63-4022-a018-9914c9a5eeb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:29:29.060301 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b0ad6-cc63-4022-a018-9914c9a5eeb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:29.061921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b0ad6-cc63-4022-a018-9914c9a5eeb1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:29.074730 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1388/2735] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:29:29.080098 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96eb725-b21d-4f49-83bb-8ea9937c1308 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:29.091306 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96eb725-b21d-4f49-83bb-8ea9937c1308 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:29.097228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a78904-8a8c-48b1-9d72-8036ca40d9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:29.097868 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a78904-8a8c-48b1-9d72-8036ca40d9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:29.098138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a78904-8a8c-48b1-9d72-8036ca40d9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:29.098402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a78904-8a8c-48b1-9d72-8036ca40d9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:29.099019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a78904-8a8c-48b1-9d72-8036ca40d9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:29.100930 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a78904-8a8c-48b1-9d72-8036ca40d9b6 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:29.132410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1348/2736] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:29:29 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:29:29.136591 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b0ad6-cc63-4022-a018-9914c9a5eeb1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:29.148366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b0ad6-cc63-4022-a018-9914c9a5eeb1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:29.208034 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cb51c-f37e-4140-9068-62c97382a0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:29.208719 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cb51c-f37e-4140-9068-62c97382a0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:29.208988 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cb51c-f37e-4140-9068-62c97382a0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:29.209309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cb51c-f37e-4140-9068-62c97382a0a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:29.210199 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cb51c-f37e-4140-9068-62c97382a0a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:29.212641 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cb51c-f37e-4140-9068-62c97382a0a6 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:29.236863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1389/2737] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:29:29 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:29:29.242212 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a78904-8a8c-48b1-9d72-8036ca40d9b6 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:29.260372 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a78904-8a8c-48b1-9d72-8036ca40d9b6 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:29.268533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc8652-1965-4d1c-b641-42b0f36f4f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:29.269566 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc8652-1965-4d1c-b641-42b0f36f4f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:29.270074 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc8652-1965-4d1c-b641-42b0f36f4f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:29.270512 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc8652-1965-4d1c-b641-42b0f36f4f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:29.271573 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc8652-1965-4d1c-b641-42b0f36f4f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:29.274521 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc8652-1965-4d1c-b641-42b0f36f4f94 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:29.293663 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1349/2738] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:29:29.298130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cb51c-f37e-4140-9068-62c97382a0a6 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:29.313101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cb51c-f37e-4140-9068-62c97382a0a6 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:29.321653 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26611846-1688-46ac-8bd3-97af971a0549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:29.322645 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26611846-1688-46ac-8bd3-97af971a0549 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:29.323124 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26611846-1688-46ac-8bd3-97af971a0549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:29.323593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26611846-1688-46ac-8bd3-97af971a0549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:29.324689 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26611846-1688-46ac-8bd3-97af971a0549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:29.327772 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26611846-1688-46ac-8bd3-97af971a0549 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:29.345457 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1390/2739] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:29:29.350105 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc8652-1965-4d1c-b641-42b0f36f4f94 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:29.361174 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc8652-1965-4d1c-b641-42b0f36f4f94 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:29.366175 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207b7a1-60e6-40ac-95af-ac4eff40d161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:29.366879 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207b7a1-60e6-40ac-95af-ac4eff40d161 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:29.367186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207b7a1-60e6-40ac-95af-ac4eff40d161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:29.367500 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207b7a1-60e6-40ac-95af-ac4eff40d161 admin admin] PATH_INFO: `/v3/projects/70eeeda1d3c14830b0ddc0446dbcc04c/users/9cc427420b2148e08e9eb7fd4ee1703e/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:29.383209 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207b7a1-60e6-40ac-95af-ac4eff40d161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70eeeda1d3c14830b0ddc0446dbcc04c, user_id=9cc427420b2148e08e9eb7fd4ee1703e, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:29.385805 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207b7a1-60e6-40ac-95af-ac4eff40d161 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:29.402916 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1350/2740] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:29:29 2022] PUT /identity/v3/projects/70eeeda1d3c14830b0ddc0446dbcc04c/users/9cc427420b2148e08e9eb7fd4ee1703e/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:29.413391 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560137c7-212b-47de-8c8d-e7e9b04fb6e6 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:29.413673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560137c7-212b-47de-8c8d-e7e9b04fb6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:29.413939 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560137c7-212b-47de-8c8d-e7e9b04fb6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:29.449186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-560137c7-212b-47de-8c8d-e7e9b04fb6e6 None None] MFA Rules not processed for user `9cc427420b2148e08e9eb7fd4ee1703e`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:29.450470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-560137c7-212b-47de-8c8d-e7e9b04fb6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:29.529484 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1391/2741] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:29:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:29.540386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207b7a1-60e6-40ac-95af-ac4eff40d161 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:29.542161 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6207b7a1-60e6-40ac-95af-ac4eff40d161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:29.565813 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:29.603664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207b7a1-60e6-40ac-95af-ac4eff40d161 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:29.609415 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd60bae-f491-4465-a65b-78b9a36372a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:29.610163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd60bae-f491-4465-a65b-78b9a36372a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:29.610488 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd60bae-f491-4465-a65b-78b9a36372a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:29.610821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd60bae-f491-4465-a65b-78b9a36372a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:29.620511 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd60bae-f491-4465-a65b-78b9a36372a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:29.622188 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd60bae-f491-4465-a65b-78b9a36372a1 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:29.632620 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1351/2742] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:29:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:29:39.526115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:39.627818 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=17 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:39.913254 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560137c7-212b-47de-8c8d-e7e9b04fb6e6 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:39.984975 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560137c7-212b-47de-8c8d-e7e9b04fb6e6 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:39.989955 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c18a66-8619-4904-bc8b-4715f42353b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:39.990595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c18a66-8619-4904-bc8b-4715f42353b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:39.990869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c18a66-8619-4904-bc8b-4715f42353b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:39.991134 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c18a66-8619-4904-bc8b-4715f42353b2 admin admin] PATH_INFO: `/v3/users/9cc427420b2148e08e9eb7fd4ee1703e` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:39.992298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c18a66-8619-4904-bc8b-4715f42353b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc427420b2148e08e9eb7fd4ee1703e)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:39.994243 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c18a66-8619-4904-bc8b-4715f42353b2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:40.048709 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-36c18a66-8619-4904-bc8b-4715f42353b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc427420b2148e08e9eb7fd4ee1703e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:40.055389 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-36c18a66-8619-4904-bc8b-4715f42353b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc427420b2148e08e9eb7fd4ee1703e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:40.066947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-36c18a66-8619-4904-bc8b-4715f42353b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc427420b2148e08e9eb7fd4ee1703e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:40.067662 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-36c18a66-8619-4904-bc8b-4715f42353b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc427420b2148e08e9eb7fd4ee1703e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:40.076373 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-36c18a66-8619-4904-bc8b-4715f42353b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc427420b2148e08e9eb7fd4ee1703e'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:40.086873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1392/2743] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:29:39 2022] DELETE /identity/v3/users/9cc427420b2148e08e9eb7fd4ee1703e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:40.091559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3664f1-27b5-4aa0-b9e2-e064d4a2f680 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:40.091864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3664f1-27b5-4aa0-b9e2-e064d4a2f680 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:40.092113 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3664f1-27b5-4aa0-b9e2-e064d4a2f680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:40.113190 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-5c3664f1-27b5-4aa0-b9e2-e064d4a2f680 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:40.114449 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5c3664f1-27b5-4aa0-b9e2-e064d4a2f680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:40.180666 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1352/2744] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:40.191748 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c18a66-8619-4904-bc8b-4715f42353b2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:40.193365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-36c18a66-8619-4904-bc8b-4715f42353b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:40.263930 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c18a66-8619-4904-bc8b-4715f42353b2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:40.268259 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61ca8e-e2f5-4828-8fa3-d1e7f6d138cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:40.268868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61ca8e-e2f5-4828-8fa3-d1e7f6d138cc service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:40.269139 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61ca8e-e2f5-4828-8fa3-d1e7f6d138cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:40.269403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61ca8e-e2f5-4828-8fa3-d1e7f6d138cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:40.279845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61ca8e-e2f5-4828-8fa3-d1e7f6d138cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:40.281411 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61ca8e-e2f5-4828-8fa3-d1e7f6d138cc service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:40.292085 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1393/2745] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:29:40.592455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3664f1-27b5-4aa0-b9e2-e064d4a2f680 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:40.595167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-5c3664f1-27b5-4aa0-b9e2-e064d4a2f680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:40.608026 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3664f1-27b5-4aa0-b9e2-e064d4a2f680 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:40.618625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d04d9-d3c6-4958-a3ef-5139a8db789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:40.619341 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d04d9-d3c6-4958-a3ef-5139a8db789b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:40.619614 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d04d9-d3c6-4958-a3ef-5139a8db789b admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:40.619880 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d04d9-d3c6-4958-a3ef-5139a8db789b admin admin] PATH_INFO: `/v3/projects/70eeeda1d3c14830b0ddc0446dbcc04c` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:40.621138 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d04d9-d3c6-4958-a3ef-5139a8db789b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70eeeda1d3c14830b0ddc0446dbcc04c)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:40.632217 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d04d9-d3c6-4958-a3ef-5139a8db789b admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:40.684512 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-813d04d9-d3c6-4958-a3ef-5139a8db789b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70eeeda1d3c14830b0ddc0446dbcc04c', 'request_id': 'req-813d04d9-d3c6-4958-a3ef-5139a8db789b'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:40.694688 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-813d04d9-d3c6-4958-a3ef-5139a8db789b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70eeeda1d3c14830b0ddc0446dbcc04c', 'request_id': 'req-813d04d9-d3c6-4958-a3ef-5139a8db789b'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:40.701796 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-813d04d9-d3c6-4958-a3ef-5139a8db789b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70eeeda1d3c14830b0ddc0446dbcc04c', 'request_id': 'req-813d04d9-d3c6-4958-a3ef-5139a8db789b'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:40.712630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-813d04d9-d3c6-4958-a3ef-5139a8db789b admin admin] The token cache is being invalidate because project 70eeeda1d3c14830b0ddc0446dbcc04c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:29:40.712918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-813d04d9-d3c6-4958-a3ef-5139a8db789b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:40.713602 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-813d04d9-d3c6-4958-a3ef-5139a8db789b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:29:40.715153 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1353/2746] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:29:40 2022] DELETE /identity/v3/projects/70eeeda1d3c14830b0ddc0446dbcc04c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:29:43.730072 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61ca8e-e2f5-4828-8fa3-d1e7f6d138cc service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:43.732056 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9a61ca8e-e2f5-4828-8fa3-d1e7f6d138cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:43.743929 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61ca8e-e2f5-4828-8fa3-d1e7f6d138cc service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:43.763522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:43.800765 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5d0da-9648-4af8-bb31-5c604c1dc2d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:43.801585 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5d0da-9648-4af8-bb31-5c604c1dc2d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:43.802099 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5d0da-9648-4af8-bb31-5c604c1dc2d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:43.802441 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5d0da-9648-4af8-bb31-5c604c1dc2d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:43.805040 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-b3c5d0da-9648-4af8-bb31-5c604c1dc2d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:43.898806 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5d0da-9648-4af8-bb31-5c604c1dc2d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:43.900286 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5d0da-9648-4af8-bb31-5c604c1dc2d7 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:43.923737 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1394/2747] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:29:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:29:45.123836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d04d9-d3c6-4958-a3ef-5139a8db789b admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:45.125529 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-813d04d9-d3c6-4958-a3ef-5139a8db789b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:45.140681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d04d9-d3c6-4958-a3ef-5139a8db789b admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:45.144933 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5d489-9535-4d69-9ac4-3a242bfd8608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:45.145530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5d489-9535-4d69-9ac4-3a242bfd8608 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:45.145915 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5d489-9535-4d69-9ac4-3a242bfd8608 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:45.146186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5d489-9535-4d69-9ac4-3a242bfd8608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:45.148057 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d4c5d489-9535-4d69-9ac4-3a242bfd8608 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:45.162106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5d489-9535-4d69-9ac4-3a242bfd8608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:45.163601 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5d489-9535-4d69-9ac4-3a242bfd8608 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:45.175155 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1354/2748] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:29:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:29:49.883272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaabe90-310b-4d74-9e1f-4ea6f1c3b947 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:49.883982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaabe90-310b-4d74-9e1f-4ea6f1c3b947 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:49.883982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaabe90-310b-4d74-9e1f-4ea6f1c3b947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:49.906123 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-6aaabe90-310b-4d74-9e1f-4ea6f1c3b947 None None] MFA Rules not processed for user `78a5e436dd4d420cb897d2c4f3620bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:29:49.907347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6aaabe90-310b-4d74-9e1f-4ea6f1c3b947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:49.990037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1395/2749] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:29:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:29:50.332234 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5d489-9535-4d69-9ac4-3a242bfd8608 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:50.342504 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5d489-9535-4d69-9ac4-3a242bfd8608 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:50.347154 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee943b4-6bb0-4eef-b3b1-c1ad7e8e4797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:50.347764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee943b4-6bb0-4eef-b3b1-c1ad7e8e4797 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:50.348030 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee943b4-6bb0-4eef-b3b1-c1ad7e8e4797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:50.348296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee943b4-6bb0-4eef-b3b1-c1ad7e8e4797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:50.350116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8ee943b4-6bb0-4eef-b3b1-c1ad7e8e4797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:50.361811 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee943b4-6bb0-4eef-b3b1-c1ad7e8e4797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:50.363256 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee943b4-6bb0-4eef-b3b1-c1ad7e8e4797 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:50.371676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1355/2750] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:29:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:29:50.747692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaabe90-310b-4d74-9e1f-4ea6f1c3b947 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:50.749279 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-6aaabe90-310b-4d74-9e1f-4ea6f1c3b947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:50.822942 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:29:50.852163 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaabe90-310b-4d74-9e1f-4ea6f1c3b947 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:50.857790 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dee603-2458-4f4b-acbd-2f72a6f6284a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:50.858407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dee603-2458-4f4b-acbd-2f72a6f6284a service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:50.858681 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dee603-2458-4f4b-acbd-2f72a6f6284a service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:50.858937 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dee603-2458-4f4b-acbd-2f72a6f6284a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:50.860707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-83dee603-2458-4f4b-acbd-2f72a6f6284a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:50.873085 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dee603-2458-4f4b-acbd-2f72a6f6284a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:50.874802 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dee603-2458-4f4b-acbd-2f72a6f6284a service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:50.885810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1396/2751] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:29:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:29:52.678712 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee943b4-6bb0-4eef-b3b1-c1ad7e8e4797 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:52.680319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8ee943b4-6bb0-4eef-b3b1-c1ad7e8e4797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:52.691291 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee943b4-6bb0-4eef-b3b1-c1ad7e8e4797 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:52.695299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46d277-9936-401b-8302-f7569477911f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:52.695939 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46d277-9936-401b-8302-f7569477911f service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:52.696214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46d277-9936-401b-8302-f7569477911f service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:52.696480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46d277-9936-401b-8302-f7569477911f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:52.698320 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0c46d277-9936-401b-8302-f7569477911f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:52.709214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46d277-9936-401b-8302-f7569477911f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:52.710720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46d277-9936-401b-8302-f7569477911f service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:52.721018 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1356/2752] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:29:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:29:53.402659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dee603-2458-4f4b-acbd-2f72a6f6284a service placement] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:29:53.404327 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-83dee603-2458-4f4b-acbd-2f72a6f6284a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:53.424873 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dee603-2458-4f4b-acbd-2f72a6f6284a service placement] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:29:53.432424 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dcefd-0c29-4adc-880c-af05a4316edb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:29:53.433043 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dcefd-0c29-4adc-880c-af05a4316edb service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:29:53.433312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dcefd-0c29-4adc-880c-af05a4316edb service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:29:53.433573 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dcefd-0c29-4adc-880c-af05a4316edb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:29:53.435636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c83dcefd-0c29-4adc-880c-af05a4316edb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:29:53.449475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dcefd-0c29-4adc-880c-af05a4316edb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:29:53.451279 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dcefd-0c29-4adc-880c-af05a4316edb service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:29:53.462754 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1397/2753] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:29:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:30:02.716803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:03.458949 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=16 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:30:04.079186 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46d277-9936-401b-8302-f7569477911f service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:30:04.080719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0c46d277-9936-401b-8302-f7569477911f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:30:04.097052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46d277-9936-401b-8302-f7569477911f service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:30:04.103458 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dec786-7766-4b8b-af43-3a2df5986d6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:30:04.104572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dec786-7766-4b8b-af43-3a2df5986d6f service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:30:04.104829 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dec786-7766-4b8b-af43-3a2df5986d6f service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:30:04.105105 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dec786-7766-4b8b-af43-3a2df5986d6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:30:04.107589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-07dec786-7766-4b8b-af43-3a2df5986d6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:30:04.120172 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dec786-7766-4b8b-af43-3a2df5986d6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:30:04.121781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dec786-7766-4b8b-af43-3a2df5986d6f service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:30:04.134081 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1357/2754] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:30:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:30:14.128286 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=6 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:19.422291 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dcefd-0c29-4adc-880c-af05a4316edb service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:19.434597 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dcefd-0c29-4adc-880c-af05a4316edb service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:19.440803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9f9e4-c2a1-47e8-9ac5-b2590a96d442 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:19.441407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9f9e4-c2a1-47e8-9ac5-b2590a96d442 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:19.441710 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9f9e4-c2a1-47e8-9ac5-b2590a96d442 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:19.441975 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9f9e4-c2a1-47e8-9ac5-b2590a96d442 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:19.443817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1bf9f9e4-c2a1-47e8-9ac5-b2590a96d442 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:19.454982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9f9e4-c2a1-47e8-9ac5-b2590a96d442 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:19.456564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9f9e4-c2a1-47e8-9ac5-b2590a96d442 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:19.465315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1398/2755] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:31:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:31:29.461496 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:39.855265 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dec786-7766-4b8b-af43-3a2df5986d6f service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:39.866274 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dec786-7766-4b8b-af43-3a2df5986d6f service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:39.871006 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8ec1a-0f68-41a5-81e8-d58d4a393823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:39.871645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ec1a-0f68-41a5-81e8-d58d4a393823 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:39.871906 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ec1a-0f68-41a5-81e8-d58d4a393823 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:39.872188 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ec1a-0f68-41a5-81e8-d58d4a393823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:39.874248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2fe8ec1a-0f68-41a5-81e8-d58d4a393823 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:39.945413 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8ec1a-0f68-41a5-81e8-d58d4a393823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:39.946897 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8ec1a-0f68-41a5-81e8-d58d4a393823 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:39.956820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1358/2756] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:31:43.073899 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9f9e4-c2a1-47e8-9ac5-b2590a96d442 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:43.075862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1bf9f9e4-c2a1-47e8-9ac5-b2590a96d442 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:43.095808 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9f9e4-c2a1-47e8-9ac5-b2590a96d442 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:43.101604 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d628dc-cc3e-421a-937d-f69d4293b507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:43.102296 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d628dc-cc3e-421a-937d-f69d4293b507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.102568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d628dc-cc3e-421a-937d-f69d4293b507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.102805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d628dc-cc3e-421a-937d-f69d4293b507 admin admin] PATH_INFO: `/v3/users/78a5e436dd4d420cb897d2c4f3620bdb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.104447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d628dc-cc3e-421a-937d-f69d4293b507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a5e436dd4d420cb897d2c4f3620bdb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:43.106455 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d628dc-cc3e-421a-937d-f69d4293b507 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:43.164606 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f3d628dc-cc3e-421a-937d-f69d4293b507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a5e436dd4d420cb897d2c4f3620bdb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:43.171973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f3d628dc-cc3e-421a-937d-f69d4293b507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a5e436dd4d420cb897d2c4f3620bdb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:43.184982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f3d628dc-cc3e-421a-937d-f69d4293b507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a5e436dd4d420cb897d2c4f3620bdb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:43.185853 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f3d628dc-cc3e-421a-937d-f69d4293b507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a5e436dd4d420cb897d2c4f3620bdb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:43.195172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-f3d628dc-cc3e-421a-937d-f69d4293b507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a5e436dd4d420cb897d2c4f3620bdb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:43.202353 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1399/2757] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:31:43 2022] DELETE /identity/v3/users/78a5e436dd4d420cb897d2c4f3620bdb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:43.400009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8ec1a-0f68-41a5-81e8-d58d4a393823 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:43.411821 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8ec1a-0f68-41a5-81e8-d58d4a393823 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:43.481717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d66f9-54da-4cb1-95f6-92ba58922507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:43.482294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d66f9-54da-4cb1-95f6-92ba58922507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.482567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d66f9-54da-4cb1-95f6-92ba58922507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.482840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d66f9-54da-4cb1-95f6-92ba58922507 admin admin] PATH_INFO: `/v3/projects/41efb12e9d9947de959fd270a36b57bc` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.484027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d66f9-54da-4cb1-95f6-92ba58922507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41efb12e9d9947de959fd270a36b57bc)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:43.486076 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d66f9-54da-4cb1-95f6-92ba58922507 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:43.540316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3f3d66f9-54da-4cb1-95f6-92ba58922507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41efb12e9d9947de959fd270a36b57bc', 'request_id': 'req-3f3d66f9-54da-4cb1-95f6-92ba58922507'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:43.550625 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3f3d66f9-54da-4cb1-95f6-92ba58922507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41efb12e9d9947de959fd270a36b57bc', 'request_id': 'req-3f3d66f9-54da-4cb1-95f6-92ba58922507'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:43.557297 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3f3d66f9-54da-4cb1-95f6-92ba58922507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41efb12e9d9947de959fd270a36b57bc', 'request_id': 'req-3f3d66f9-54da-4cb1-95f6-92ba58922507'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:43.568837 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3f3d66f9-54da-4cb1-95f6-92ba58922507 admin admin] The token cache is being invalidate because project 41efb12e9d9947de959fd270a36b57bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:31:43.569114 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3f3d66f9-54da-4cb1-95f6-92ba58922507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:43.569842 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-3f3d66f9-54da-4cb1-95f6-92ba58922507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:43.571426 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1359/2758] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:31:43 2022] DELETE /identity/v3/projects/41efb12e9d9947de959fd270a36b57bc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:43.576632 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657393e3-731b-4892-8819-9090c87427fa None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.576946 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657393e3-731b-4892-8819-9090c87427fa None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.577241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657393e3-731b-4892-8819-9090c87427fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.598344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-657393e3-731b-4892-8819-9090c87427fa None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:43.599568 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-657393e3-731b-4892-8819-9090c87427fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:43.670434 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1400/2759] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:43.679311 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c00b8b-df0a-4673-8bd1-6d396c5c5d8b None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.679518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c00b8b-df0a-4673-8bd1-6d396c5c5d8b None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.679764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c00b8b-df0a-4673-8bd1-6d396c5c5d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.702605 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-81c00b8b-df0a-4673-8bd1-6d396c5c5d8b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:43.704135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-81c00b8b-df0a-4673-8bd1-6d396c5c5d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:43.712318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1360/2760] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:43.716990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657393e3-731b-4892-8819-9090c87427fa None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:43.728805 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657393e3-731b-4892-8819-9090c87427fa None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:43.734777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1d558-ac28-4111-bff3-b98c775242d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:43.735384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d558-ac28-4111-bff3-b98c775242d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.735655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d558-ac28-4111-bff3-b98c775242d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.735918 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d558-ac28-4111-bff3-b98c775242d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.736557 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1d558-ac28-4111-bff3-b98c775242d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:31:43.736946 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1d558-ac28-4111-bff3-b98c775242d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:43.738562 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a1d558-ac28-4111-bff3-b98c775242d1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:43.751710 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1401/2761] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:31:43.756498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c00b8b-df0a-4673-8bd1-6d396c5c5d8b None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:43.767344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c00b8b-df0a-4673-8bd1-6d396c5c5d8b None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:43.773564 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e117d29-e0e5-4af9-a506-516d57572909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:43.774257 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e117d29-e0e5-4af9-a506-516d57572909 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.774566 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e117d29-e0e5-4af9-a506-516d57572909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.774862 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e117d29-e0e5-4af9-a506-516d57572909 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.775616 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e117d29-e0e5-4af9-a506-516d57572909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:43.777894 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e117d29-e0e5-4af9-a506-516d57572909 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:43.796417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:43.819798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1361/2762] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:31:43 2022] POST /identity/v3/projects => generated 403 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:31:43.824889 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1d558-ac28-4111-bff3-b98c775242d1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:43.842986 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1d558-ac28-4111-bff3-b98c775242d1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:43.917050 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299561e8-2fa0-493c-99bf-764c2f71e420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:43.917863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299561e8-2fa0-493c-99bf-764c2f71e420 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.918168 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299561e8-2fa0-493c-99bf-764c2f71e420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.918766 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299561e8-2fa0-493c-99bf-764c2f71e420 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.919516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299561e8-2fa0-493c-99bf-764c2f71e420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:43.921713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299561e8-2fa0-493c-99bf-764c2f71e420 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:43.930636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:43.951909 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1402/2763] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:31:43 2022] POST /identity/v3/users => generated 302 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:31:43.956432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e117d29-e0e5-4af9-a506-516d57572909 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:43.967053 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e117d29-e0e5-4af9-a506-516d57572909 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:43.973431 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaeb8fb-1534-4e20-baa6-298225665c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:43.974269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaeb8fb-1534-4e20-baa6-298225665c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:43.974632 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaeb8fb-1534-4e20-baa6-298225665c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:43.975043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaeb8fb-1534-4e20-baa6-298225665c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:43.975813 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaeb8fb-1534-4e20-baa6-298225665c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:43.977767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaeb8fb-1534-4e20-baa6-298225665c52 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:43.991667 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1362/2764] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:31:43.994773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299561e8-2fa0-493c-99bf-764c2f71e420 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:44.006120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299561e8-2fa0-493c-99bf-764c2f71e420 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:44.011819 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c9ce8-0c28-4921-a47a-1b883c6de6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:44.012683 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c9ce8-0c28-4921-a47a-1b883c6de6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:44.012976 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c9ce8-0c28-4921-a47a-1b883c6de6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:44.013316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c9ce8-0c28-4921-a47a-1b883c6de6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:44.014287 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c9ce8-0c28-4921-a47a-1b883c6de6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:44.016081 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c9ce8-0c28-4921-a47a-1b883c6de6a0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:44.029298 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1403/2765] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:31:44.033926 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaeb8fb-1534-4e20-baa6-298225665c52 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:44.044742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaeb8fb-1534-4e20-baa6-298225665c52 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:44.051139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aad6b-4b54-4a3d-9052-878609847eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:44.051809 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aad6b-4b54-4a3d-9052-878609847eff admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:44.052082 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aad6b-4b54-4a3d-9052-878609847eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:44.052350 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aad6b-4b54-4a3d-9052-878609847eff admin admin] PATH_INFO: `/v3/projects/ba646c014e76459383e51607e3236965/users/be0a5da7e9d94850aa40885e68cdc6a1/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:44.070273 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aad6b-4b54-4a3d-9052-878609847eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba646c014e76459383e51607e3236965, user_id=be0a5da7e9d94850aa40885e68cdc6a1, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:44.072947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aad6b-4b54-4a3d-9052-878609847eff admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:44.094272 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1363/2766] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:31:44 2022] PUT /identity/v3/projects/ba646c014e76459383e51607e3236965/users/be0a5da7e9d94850aa40885e68cdc6a1/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:44.108162 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4730d6-a92b-48ad-95fc-c83b2fa04460 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:44.108854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4730d6-a92b-48ad-95fc-c83b2fa04460 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:44.108854 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4730d6-a92b-48ad-95fc-c83b2fa04460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:44.138475 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-8e4730d6-a92b-48ad-95fc-c83b2fa04460 None None] MFA Rules not processed for user `be0a5da7e9d94850aa40885e68cdc6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:44.139688 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-8e4730d6-a92b-48ad-95fc-c83b2fa04460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:44.206384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1404/2767] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:31:44 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:44.211317 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aad6b-4b54-4a3d-9052-878609847eff admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:44.278312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aad6b-4b54-4a3d-9052-878609847eff admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:44.283501 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb0881-7002-4d5d-8f99-56ae49623464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:44.284113 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb0881-7002-4d5d-8f99-56ae49623464 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:44.284417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb0881-7002-4d5d-8f99-56ae49623464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:44.284768 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb0881-7002-4d5d-8f99-56ae49623464 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:44.285497 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb0881-7002-4d5d-8f99-56ae49623464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:44.287466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb0881-7002-4d5d-8f99-56ae49623464 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:44.318287 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1364/2768] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:31:44 2022] POST /identity/v3/projects => generated 403 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:31:44.324070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4730d6-a92b-48ad-95fc-c83b2fa04460 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:44.336249 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4730d6-a92b-48ad-95fc-c83b2fa04460 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:44.403280 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257457e-9bc5-4be0-9163-badbc9e84001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:44.403897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257457e-9bc5-4be0-9163-badbc9e84001 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:44.404171 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257457e-9bc5-4be0-9163-badbc9e84001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:44.404441 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257457e-9bc5-4be0-9163-badbc9e84001 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:44.405094 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257457e-9bc5-4be0-9163-badbc9e84001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:44.407086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257457e-9bc5-4be0-9163-badbc9e84001 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:44.432863 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1405/2769] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:31:44 2022] POST /identity/v3/users => generated 308 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:31:44.437442 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb0881-7002-4d5d-8f99-56ae49623464 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:44.448462 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb0881-7002-4d5d-8f99-56ae49623464 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:44.453518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84031579-8a16-42c1-ad31-639809074645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:44.454183 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84031579-8a16-42c1-ad31-639809074645 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:44.454458 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84031579-8a16-42c1-ad31-639809074645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:44.454720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84031579-8a16-42c1-ad31-639809074645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:44.455424 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84031579-8a16-42c1-ad31-639809074645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:44.457139 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84031579-8a16-42c1-ad31-639809074645 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:44.602873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1365/2770] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:31:44.604710 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257457e-9bc5-4be0-9163-badbc9e84001 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:44.615113 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257457e-9bc5-4be0-9163-badbc9e84001 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:44.619953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caa713-a1bd-42bd-a8bf-9ecc2dfe1b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:44.620612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caa713-a1bd-42bd-a8bf-9ecc2dfe1b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:44.620883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caa713-a1bd-42bd-a8bf-9ecc2dfe1b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:44.621143 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caa713-a1bd-42bd-a8bf-9ecc2dfe1b76 admin admin] PATH_INFO: `/v3/projects/79a858bef2564189ad18276c6d321ab5/users/7171c27a3853413ca7c8487190924ef3/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:44.637776 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5caa713-a1bd-42bd-a8bf-9ecc2dfe1b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a858bef2564189ad18276c6d321ab5, user_id=7171c27a3853413ca7c8487190924ef3, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:44.640380 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5caa713-a1bd-42bd-a8bf-9ecc2dfe1b76 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:44.656315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1406/2771] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:31:44 2022] PUT /identity/v3/projects/79a858bef2564189ad18276c6d321ab5/users/7171c27a3853413ca7c8487190924ef3/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:44.660671 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84031579-8a16-42c1-ad31-639809074645 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:44.671819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84031579-8a16-42c1-ad31-639809074645 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:44.737715 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3142d07-46dc-4041-b32c-b6392df5a5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:44.738239 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3142d07-46dc-4041-b32c-b6392df5a5dd admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:44.738510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3142d07-46dc-4041-b32c-b6392df5a5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:44.738834 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3142d07-46dc-4041-b32c-b6392df5a5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:44.739606 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3142d07-46dc-4041-b32c-b6392df5a5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:44.741903 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3142d07-46dc-4041-b32c-b6392df5a5dd admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:44.754948 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1366/2772] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:31:44.761645 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caa713-a1bd-42bd-a8bf-9ecc2dfe1b76 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:44.774970 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caa713-a1bd-42bd-a8bf-9ecc2dfe1b76 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:44.780596 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a612b-7251-4846-8b42-5ecd8d57835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:44.781556 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a612b-7251-4846-8b42-5ecd8d57835d admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:44.781880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a612b-7251-4846-8b42-5ecd8d57835d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:44.782171 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a612b-7251-4846-8b42-5ecd8d57835d admin admin] PATH_INFO: `/v3/projects/79a858bef2564189ad18276c6d321ab5/users/7171c27a3853413ca7c8487190924ef3/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:44.784415 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a612b-7251-4846-8b42-5ecd8d57835d admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a858bef2564189ad18276c6d321ab5, user_id=7171c27a3853413ca7c8487190924ef3, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:44.787174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a612b-7251-4846-8b42-5ecd8d57835d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:44.799215 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1407/2773] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:31:44 2022] PUT /identity/v3/projects/79a858bef2564189ad18276c6d321ab5/users/7171c27a3853413ca7c8487190924ef3/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:44.809902 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a996aee-b35e-4ddf-ba0f-bd83ec226171 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:44.810158 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a996aee-b35e-4ddf-ba0f-bd83ec226171 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:44.810480 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a996aee-b35e-4ddf-ba0f-bd83ec226171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:44.842209 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-6a996aee-b35e-4ddf-ba0f-bd83ec226171 None None] MFA Rules not processed for user `7171c27a3853413ca7c8487190924ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:44.843446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6a996aee-b35e-4ddf-ba0f-bd83ec226171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:44.864639 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:44.932267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1367/2774] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:31:44 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:44.944605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a612b-7251-4846-8b42-5ecd8d57835d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:44.946576 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-363a612b-7251-4846-8b42-5ecd8d57835d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:44.972226 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:45.032569 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a612b-7251-4846-8b42-5ecd8d57835d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:45.036488 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb440b-37d0-4587-b844-ee76043f1c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:45.037134 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb440b-37d0-4587-b844-ee76043f1c46 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:45.037409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb440b-37d0-4587-b844-ee76043f1c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:45.037716 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb440b-37d0-4587-b844-ee76043f1c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:45.048735 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb440b-37d0-4587-b844-ee76043f1c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:45.050523 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb440b-37d0-4587-b844-ee76043f1c46 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:45.062037 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1408/2775] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:31:44 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:31:45.223171 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a996aee-b35e-4ddf-ba0f-bd83ec226171 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:45.306230 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a996aee-b35e-4ddf-ba0f-bd83ec226171 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:45.311983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e62e37-d13a-4f06-b707-28822ae2dff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:45.312692 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e62e37-d13a-4f06-b707-28822ae2dff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:45.313002 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e62e37-d13a-4f06-b707-28822ae2dff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:45.313329 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e62e37-d13a-4f06-b707-28822ae2dff4 admin admin] PATH_INFO: `/v3/users/be0a5da7e9d94850aa40885e68cdc6a1` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:45.314676 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e62e37-d13a-4f06-b707-28822ae2dff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0a5da7e9d94850aa40885e68cdc6a1)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:45.316716 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e62e37-d13a-4f06-b707-28822ae2dff4 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:45.373169 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-00e62e37-d13a-4f06-b707-28822ae2dff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0a5da7e9d94850aa40885e68cdc6a1'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:45.382908 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-00e62e37-d13a-4f06-b707-28822ae2dff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0a5da7e9d94850aa40885e68cdc6a1'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:45.383698 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-00e62e37-d13a-4f06-b707-28822ae2dff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0a5da7e9d94850aa40885e68cdc6a1'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:45.392727 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-00e62e37-d13a-4f06-b707-28822ae2dff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0a5da7e9d94850aa40885e68cdc6a1'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:45.406323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-00e62e37-d13a-4f06-b707-28822ae2dff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0a5da7e9d94850aa40885e68cdc6a1'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:45.412637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1368/2776] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:31:45 2022] DELETE /identity/v3/users/be0a5da7e9d94850aa40885e68cdc6a1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:45.419416 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0814331-9cfc-47c3-9b74-e09dab081ad1 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:45.420150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0814331-9cfc-47c3-9b74-e09dab081ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:45.420150 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0814331-9cfc-47c3-9b74-e09dab081ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:45.440182 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-a0814331-9cfc-47c3-9b74-e09dab081ad1 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:45.441394 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a0814331-9cfc-47c3-9b74-e09dab081ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:45.514038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1409/2777] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:45.525672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e62e37-d13a-4f06-b707-28822ae2dff4 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:45.527433 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-00e62e37-d13a-4f06-b707-28822ae2dff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:45.574167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:45.596361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e62e37-d13a-4f06-b707-28822ae2dff4 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:45.600998 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8a6e7-e3ee-4e08-8eba-de8b2458243c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:45.601598 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8a6e7-e3ee-4e08-8eba-de8b2458243c service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:45.601900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8a6e7-e3ee-4e08-8eba-de8b2458243c service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:45.602160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8a6e7-e3ee-4e08-8eba-de8b2458243c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:45.613394 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8a6e7-e3ee-4e08-8eba-de8b2458243c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:45.614886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8a6e7-e3ee-4e08-8eba-de8b2458243c service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:45.625553 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1369/2778] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:31:45.955725 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0814331-9cfc-47c3-9b74-e09dab081ad1 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:45.957164 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-a0814331-9cfc-47c3-9b74-e09dab081ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:45.972809 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0814331-9cfc-47c3-9b74-e09dab081ad1 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:45.978971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f6ad3-d666-4e98-b7c0-371eb35647c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:45.980648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f6ad3-d666-4e98-b7c0-371eb35647c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:45.980998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f6ad3-d666-4e98-b7c0-371eb35647c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:45.981392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f6ad3-d666-4e98-b7c0-371eb35647c1 admin admin] PATH_INFO: `/v3/projects/ba646c014e76459383e51607e3236965` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:45.983347 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f6ad3-d666-4e98-b7c0-371eb35647c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba646c014e76459383e51607e3236965)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:45.986319 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f6ad3-d666-4e98-b7c0-371eb35647c1 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:46.044636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-387f6ad3-d666-4e98-b7c0-371eb35647c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba646c014e76459383e51607e3236965', 'request_id': 'req-387f6ad3-d666-4e98-b7c0-371eb35647c1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:46.050388 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-387f6ad3-d666-4e98-b7c0-371eb35647c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba646c014e76459383e51607e3236965', 'request_id': 'req-387f6ad3-d666-4e98-b7c0-371eb35647c1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:46.059305 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-387f6ad3-d666-4e98-b7c0-371eb35647c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba646c014e76459383e51607e3236965', 'request_id': 'req-387f6ad3-d666-4e98-b7c0-371eb35647c1'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:46.072707 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-387f6ad3-d666-4e98-b7c0-371eb35647c1 admin admin] The token cache is being invalidate because project ba646c014e76459383e51607e3236965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:31:46.073063 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-387f6ad3-d666-4e98-b7c0-371eb35647c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:46.073784 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-387f6ad3-d666-4e98-b7c0-371eb35647c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:46.075307 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1410/2779] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:31:45 2022] DELETE /identity/v3/projects/ba646c014e76459383e51607e3236965 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:46.079779 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8a6e7-e3ee-4e08-8eba-de8b2458243c service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:46.090336 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8a6e7-e3ee-4e08-8eba-de8b2458243c service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:46.161232 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01181656-9d7f-46ef-b88f-d366b9ba5f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:46.161805 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01181656-9d7f-46ef-b88f-d366b9ba5f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:46.162075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01181656-9d7f-46ef-b88f-d366b9ba5f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:46.162343 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01181656-9d7f-46ef-b88f-d366b9ba5f05 admin admin] PATH_INFO: `/v3/users/7171c27a3853413ca7c8487190924ef3` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:46.163487 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01181656-9d7f-46ef-b88f-d366b9ba5f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7171c27a3853413ca7c8487190924ef3)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:46.165655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01181656-9d7f-46ef-b88f-d366b9ba5f05 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:46.223325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-01181656-9d7f-46ef-b88f-d366b9ba5f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7171c27a3853413ca7c8487190924ef3'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:46.233476 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-01181656-9d7f-46ef-b88f-d366b9ba5f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7171c27a3853413ca7c8487190924ef3'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:46.234376 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-01181656-9d7f-46ef-b88f-d366b9ba5f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7171c27a3853413ca7c8487190924ef3'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:46.243693 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-01181656-9d7f-46ef-b88f-d366b9ba5f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7171c27a3853413ca7c8487190924ef3'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:46.260390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-01181656-9d7f-46ef-b88f-d366b9ba5f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7171c27a3853413ca7c8487190924ef3'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:46.267282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1370/2780] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:31:46 2022] DELETE /identity/v3/users/7171c27a3853413ca7c8487190924ef3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:46.873252 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f6ad3-d666-4e98-b7c0-371eb35647c1 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:46.876306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-387f6ad3-d666-4e98-b7c0-371eb35647c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:46.892842 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f6ad3-d666-4e98-b7c0-371eb35647c1 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:46.948234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:46.970656 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1411c-1a27-4940-9721-4f127d1eef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:46.971299 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1411c-1a27-4940-9721-4f127d1eef18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:46.971573 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1411c-1a27-4940-9721-4f127d1eef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:46.971843 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1411c-1a27-4940-9721-4f127d1eef18 admin admin] PATH_INFO: `/v3/projects/79a858bef2564189ad18276c6d321ab5` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:46.973057 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1411c-1a27-4940-9721-4f127d1eef18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a858bef2564189ad18276c6d321ab5)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:46.975090 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1411c-1a27-4940-9721-4f127d1eef18 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:47.033419 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-81e1411c-1a27-4940-9721-4f127d1eef18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a858bef2564189ad18276c6d321ab5', 'request_id': 'req-81e1411c-1a27-4940-9721-4f127d1eef18'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:47.042599 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-81e1411c-1a27-4940-9721-4f127d1eef18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a858bef2564189ad18276c6d321ab5', 'request_id': 'req-81e1411c-1a27-4940-9721-4f127d1eef18'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:47.052125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-81e1411c-1a27-4940-9721-4f127d1eef18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a858bef2564189ad18276c6d321ab5', 'request_id': 'req-81e1411c-1a27-4940-9721-4f127d1eef18'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:47.066034 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-81e1411c-1a27-4940-9721-4f127d1eef18 admin admin] The token cache is being invalidate because project 79a858bef2564189ad18276c6d321ab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:31:47.066379 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-81e1411c-1a27-4940-9721-4f127d1eef18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:47.067192 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-81e1411c-1a27-4940-9721-4f127d1eef18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:47.069031 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1411/2781] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:31:46 2022] DELETE /identity/v3/projects/79a858bef2564189ad18276c6d321ab5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:47.074913 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569fac8-2b7b-41e1-b5e0-3b937aa89200 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:47.075512 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569fac8-2b7b-41e1-b5e0-3b937aa89200 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:47.075738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569fac8-2b7b-41e1-b5e0-3b937aa89200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:47.103747 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-e569fac8-2b7b-41e1-b5e0-3b937aa89200 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:47.105007 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e569fac8-2b7b-41e1-b5e0-3b937aa89200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:47.163378 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:47.180596 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1371/2782] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:47.188862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5ddf7-8501-43b0-a87e-529515a4293b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:47.189104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5ddf7-8501-43b0-a87e-529515a4293b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:47.189387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5ddf7-8501-43b0-a87e-529515a4293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:47.211152 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-67e5ddf7-8501-43b0-a87e-529515a4293b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:47.212383 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-67e5ddf7-8501-43b0-a87e-529515a4293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:47.221110 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1412/2783] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:47.225809 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569fac8-2b7b-41e1-b5e0-3b937aa89200 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:47.236584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569fac8-2b7b-41e1-b5e0-3b937aa89200 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:47.242545 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f351c53-4af4-40cb-96af-4c43919f20e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:47.243175 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f351c53-4af4-40cb-96af-4c43919f20e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:47.243441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f351c53-4af4-40cb-96af-4c43919f20e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:47.243696 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f351c53-4af4-40cb-96af-4c43919f20e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:47.244352 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f351c53-4af4-40cb-96af-4c43919f20e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:31:47.244645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f351c53-4af4-40cb-96af-4c43919f20e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:47.246384 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f351c53-4af4-40cb-96af-4c43919f20e3 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:47.261531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1372/2784] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 11:31:47.267359 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5ddf7-8501-43b0-a87e-529515a4293b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:47.278561 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5ddf7-8501-43b0-a87e-529515a4293b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:47.283998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8efaa5-b65e-4cb4-be91-0e1142933176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:47.284906 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8efaa5-b65e-4cb4-be91-0e1142933176 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:47.285213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8efaa5-b65e-4cb4-be91-0e1142933176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:47.285489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8efaa5-b65e-4cb4-be91-0e1142933176 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:47.286162 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8efaa5-b65e-4cb4-be91-0e1142933176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:47.288092 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8efaa5-b65e-4cb4-be91-0e1142933176 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:47.321293 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1413/2785] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:31:47 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:31:47.326299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f351c53-4af4-40cb-96af-4c43919f20e3 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:47.337257 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f351c53-4af4-40cb-96af-4c43919f20e3 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:47.400220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be7b6-c2f8-4cde-a1a3-cc00bb8b0e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:47.400836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be7b6-c2f8-4cde-a1a3-cc00bb8b0e1d admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:47.401092 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be7b6-c2f8-4cde-a1a3-cc00bb8b0e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:47.401353 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be7b6-c2f8-4cde-a1a3-cc00bb8b0e1d admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:47.402003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15be7b6-c2f8-4cde-a1a3-cc00bb8b0e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:47.404037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15be7b6-c2f8-4cde-a1a3-cc00bb8b0e1d admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:47.428512 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1373/2786] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:31:47 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:31:47.433229 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8efaa5-b65e-4cb4-be91-0e1142933176 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:47.444122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8efaa5-b65e-4cb4-be91-0e1142933176 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:47.449008 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac9b23-0d0a-4633-bae3-90d75c11ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:47.449647 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac9b23-0d0a-4633-bae3-90d75c11ff5d admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:47.450062 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac9b23-0d0a-4633-bae3-90d75c11ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:47.450306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac9b23-0d0a-4633-bae3-90d75c11ff5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:47.450974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac9b23-0d0a-4633-bae3-90d75c11ff5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:47.452629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac9b23-0d0a-4633-bae3-90d75c11ff5d admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:47.464039 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1414/2787] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:31:47.468946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be7b6-c2f8-4cde-a1a3-cc00bb8b0e1d admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:47.480340 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be7b6-c2f8-4cde-a1a3-cc00bb8b0e1d admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:47.486976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d453e66-a646-42f5-9465-b9f154dfa64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:47.487849 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d453e66-a646-42f5-9465-b9f154dfa64b admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:47.488117 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d453e66-a646-42f5-9465-b9f154dfa64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:47.488379 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d453e66-a646-42f5-9465-b9f154dfa64b admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:47.489384 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d453e66-a646-42f5-9465-b9f154dfa64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:47.491062 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d453e66-a646-42f5-9465-b9f154dfa64b admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:47.503624 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1374/2788] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:31:47.508356 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac9b23-0d0a-4633-bae3-90d75c11ff5d admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:47.518820 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac9b23-0d0a-4633-bae3-90d75c11ff5d admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:47.523710 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab79cc-6a13-4d1b-83e3-4104b2f4b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:47.524379 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab79cc-6a13-4d1b-83e3-4104b2f4b6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:47.524655 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab79cc-6a13-4d1b-83e3-4104b2f4b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:47.524926 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab79cc-6a13-4d1b-83e3-4104b2f4b6fd admin admin] PATH_INFO: `/v3/projects/0a0f00aa58cf4b709aefa6f9aa3592b1/users/43949d6783ba4e12b69993cde27db1c6/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:47.540862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab79cc-6a13-4d1b-83e3-4104b2f4b6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0f00aa58cf4b709aefa6f9aa3592b1, user_id=43949d6783ba4e12b69993cde27db1c6, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:47.543512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab79cc-6a13-4d1b-83e3-4104b2f4b6fd admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:47.558450 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1415/2789] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:31:47 2022] PUT /identity/v3/projects/0a0f00aa58cf4b709aefa6f9aa3592b1/users/43949d6783ba4e12b69993cde27db1c6/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:31:47.570426 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ebc6d-a0f0-4d71-9d10-8a2e60ced610 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:47.570708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ebc6d-a0f0-4d71-9d10-8a2e60ced610 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:47.570949 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ebc6d-a0f0-4d71-9d10-8a2e60ced610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:47.600527 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-ea0ebc6d-a0f0-4d71-9d10-8a2e60ced610 None None] MFA Rules not processed for user `43949d6783ba4e12b69993cde27db1c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:47.601699 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-ea0ebc6d-a0f0-4d71-9d10-8a2e60ced610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:47.672359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1375/2790] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:31:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:47.677533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab79cc-6a13-4d1b-83e3-4104b2f4b6fd admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:47.757062 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab79cc-6a13-4d1b-83e3-4104b2f4b6fd admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:47.761212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77976a06-adfc-40db-9777-775d43c39551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:47.762241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77976a06-adfc-40db-9777-775d43c39551 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:47.762241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77976a06-adfc-40db-9777-775d43c39551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:47.762241 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77976a06-adfc-40db-9777-775d43c39551 admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:47.763062 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77976a06-adfc-40db-9777-775d43c39551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:47.764998 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77976a06-adfc-40db-9777-775d43c39551 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:47.788966 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:47.797900 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1416/2791] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:31:47 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:31:47.802116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ebc6d-a0f0-4d71-9d10-8a2e60ced610 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:47.813488 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ebc6d-a0f0-4d71-9d10-8a2e60ced610 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:47.875916 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:47.886858 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331b2fb-f383-4992-92c5-b47f1ce2145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:47.887606 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331b2fb-f383-4992-92c5-b47f1ce2145f admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:47.887885 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331b2fb-f383-4992-92c5-b47f1ce2145f admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:47.888148 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331b2fb-f383-4992-92c5-b47f1ce2145f admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:47.888814 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331b2fb-f383-4992-92c5-b47f1ce2145f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:47.890899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331b2fb-f383-4992-92c5-b47f1ce2145f admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:47.915331 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1376/2792] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:31:47 2022] POST /identity/v3/users => generated 296 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:31:47.920181 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77976a06-adfc-40db-9777-775d43c39551 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:47.931775 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77976a06-adfc-40db-9777-775d43c39551 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:47.936623 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02149793-96db-41bc-adc2-2665c1be577f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:47.937268 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02149793-96db-41bc-adc2-2665c1be577f admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:47.937547 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02149793-96db-41bc-adc2-2665c1be577f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:47.937847 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02149793-96db-41bc-adc2-2665c1be577f admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:47.938491 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02149793-96db-41bc-adc2-2665c1be577f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:47.940226 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02149793-96db-41bc-adc2-2665c1be577f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:47.952608 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1417/2793] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:31:47.959195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331b2fb-f383-4992-92c5-b47f1ce2145f admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:47.973904 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331b2fb-f383-4992-92c5-b47f1ce2145f admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:47.979809 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744813db-c2a5-49f1-a4f3-9943f7dc56a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:47.980583 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744813db-c2a5-49f1-a4f3-9943f7dc56a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:47.980888 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744813db-c2a5-49f1-a4f3-9943f7dc56a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:47.981277 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744813db-c2a5-49f1-a4f3-9943f7dc56a3 admin admin] PATH_INFO: `/v3/projects/a92ab628b3974f6284a9fbb9a4204c0b/users/843c50fae6e94395898e0f31a02a6654/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:48.000490 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744813db-c2a5-49f1-a4f3-9943f7dc56a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92ab628b3974f6284a9fbb9a4204c0b, user_id=843c50fae6e94395898e0f31a02a6654, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:48.003356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744813db-c2a5-49f1-a4f3-9943f7dc56a3 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:48.020681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1377/2794] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:31:47 2022] PUT /identity/v3/projects/a92ab628b3974f6284a9fbb9a4204c0b/users/843c50fae6e94395898e0f31a02a6654/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:48.025543 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02149793-96db-41bc-adc2-2665c1be577f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:48.037084 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02149793-96db-41bc-adc2-2665c1be577f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:48.102916 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0cfdc-676b-46f2-b563-2d91c66b3b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:48.103946 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0cfdc-676b-46f2-b563-2d91c66b3b47 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:48.104273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0cfdc-676b-46f2-b563-2d91c66b3b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:48.104600 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0cfdc-676b-46f2-b563-2d91c66b3b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:48.105365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0cfdc-676b-46f2-b563-2d91c66b3b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:48.107516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0cfdc-676b-46f2-b563-2d91c66b3b47 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:48.120344 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1418/2795] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:31:48.124858 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744813db-c2a5-49f1-a4f3-9943f7dc56a3 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:48.135418 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744813db-c2a5-49f1-a4f3-9943f7dc56a3 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:48.140345 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e6505-a254-4021-b495-785fa0f31652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:48.141073 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e6505-a254-4021-b495-785fa0f31652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:48.141340 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e6505-a254-4021-b495-785fa0f31652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:48.141610 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e6505-a254-4021-b495-785fa0f31652 admin admin] PATH_INFO: `/v3/projects/a92ab628b3974f6284a9fbb9a4204c0b/users/843c50fae6e94395898e0f31a02a6654/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:48.143634 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e6505-a254-4021-b495-785fa0f31652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92ab628b3974f6284a9fbb9a4204c0b, user_id=843c50fae6e94395898e0f31a02a6654, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:48.146856 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e6505-a254-4021-b495-785fa0f31652 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:48.159974 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1378/2796] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:31:48 2022] PUT /identity/v3/projects/a92ab628b3974f6284a9fbb9a4204c0b/users/843c50fae6e94395898e0f31a02a6654/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:48.172070 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801caa6-aef2-423a-b6df-1890c0109745 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:48.172361 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801caa6-aef2-423a-b6df-1890c0109745 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:48.172601 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801caa6-aef2-423a-b6df-1890c0109745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:48.209631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0801caa6-aef2-423a-b6df-1890c0109745 None None] MFA Rules not processed for user `843c50fae6e94395898e0f31a02a6654`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:48.211296 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0801caa6-aef2-423a-b6df-1890c0109745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:48.291221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1419/2797] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:31:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:48.304053 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e6505-a254-4021-b495-785fa0f31652 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:48.305955 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fd8e6505-a254-4021-b495-785fa0f31652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:48.373421 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e6505-a254-4021-b495-785fa0f31652 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:48.377243 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6db98c-3fa6-4294-b363-21b599ba070a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:48.377893 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6db98c-3fa6-4294-b363-21b599ba070a service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:48.378168 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6db98c-3fa6-4294-b363-21b599ba070a service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:48.378435 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6db98c-3fa6-4294-b363-21b599ba070a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:48.388706 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6db98c-3fa6-4294-b363-21b599ba070a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:48.390228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6db98c-3fa6-4294-b363-21b599ba070a service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:48.401785 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1379/2798] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:31:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:31:48.997788 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801caa6-aef2-423a-b6df-1890c0109745 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:49.008238 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801caa6-aef2-423a-b6df-1890c0109745 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:49.013515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f1154-640a-4206-8696-146c83cbfad5 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843c50fae6e94395898e0f31a02a6654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92ab628b3974f6284a9fbb9a4204c0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:49.014204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f1154-640a-4206-8696-146c83cbfad5 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:49.014481 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f1154-640a-4206-8696-146c83cbfad5 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:49.014742 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f1154-640a-4206-8696-146c83cbfad5 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:49.015407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f1154-640a-4206-8696-146c83cbfad5 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:31:49.015701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f1154-640a-4206-8696-146c83cbfad5 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:49.017315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f1154-640a-4206-8696-146c83cbfad5 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:49.030636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1420/2799] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:31:49.035278 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6db98c-3fa6-4294-b363-21b599ba070a service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:49.045234 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6db98c-3fa6-4294-b363-21b599ba070a service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:49.050196 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d24d0-a6f1-4183-8d22-950db238aed2 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843c50fae6e94395898e0f31a02a6654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92ab628b3974f6284a9fbb9a4204c0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:49.050798 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d24d0-a6f1-4183-8d22-950db238aed2 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:49.051060 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d24d0-a6f1-4183-8d22-950db238aed2 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:49.051323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d24d0-a6f1-4183-8d22-950db238aed2 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:49.051943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d24d0-a6f1-4183-8d22-950db238aed2 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:49.053888 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d24d0-a6f1-4183-8d22-950db238aed2 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:49.084386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1380/2800] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:31:49 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:31:49.089644 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f1154-640a-4206-8696-146c83cbfad5 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:49.100448 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f1154-640a-4206-8696-146c83cbfad5 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:49.156432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:49.164976 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f14af-67dd-4fed-9639-df317c395647 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843c50fae6e94395898e0f31a02a6654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92ab628b3974f6284a9fbb9a4204c0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:49.165595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f14af-67dd-4fed-9639-df317c395647 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:49.165906 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f14af-67dd-4fed-9639-df317c395647 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:49.166204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f14af-67dd-4fed-9639-df317c395647 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:49.166858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f14af-67dd-4fed-9639-df317c395647 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:31:49.167160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f14af-67dd-4fed-9639-df317c395647 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:49.168987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f14af-67dd-4fed-9639-df317c395647 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:49.183625 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1421/2801] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:31:49.224210 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d24d0-a6f1-4183-8d22-950db238aed2 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:49.236123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d24d0-a6f1-4183-8d22-950db238aed2 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:49.241475 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c5667-5a8c-4393-a055-52eafa3016fc tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843c50fae6e94395898e0f31a02a6654', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a92ab628b3974f6284a9fbb9a4204c0b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:49.242160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c5667-5a8c-4393-a055-52eafa3016fc tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:49.242448 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c5667-5a8c-4393-a055-52eafa3016fc tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:49.242716 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c5667-5a8c-4393-a055-52eafa3016fc tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] PATH_INFO: `/v3/projects/3aa3152001fd4a0f81374c17f5f7e086` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:49.243982 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c5667-5a8c-4393-a055-52eafa3016fc tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3aa3152001fd4a0f81374c17f5f7e086)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:49.246019 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c5667-5a8c-4393-a055-52eafa3016fc tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:49.310083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-dd2c5667-5a8c-4393-a055-52eafa3016fc tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa3152001fd4a0f81374c17f5f7e086', 'request_id': 'req-dd2c5667-5a8c-4393-a055-52eafa3016fc'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:49.319104 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-dd2c5667-5a8c-4393-a055-52eafa3016fc tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa3152001fd4a0f81374c17f5f7e086', 'request_id': 'req-dd2c5667-5a8c-4393-a055-52eafa3016fc'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:49.326578 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-dd2c5667-5a8c-4393-a055-52eafa3016fc tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa3152001fd4a0f81374c17f5f7e086', 'request_id': 'req-dd2c5667-5a8c-4393-a055-52eafa3016fc'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:49.338819 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-dd2c5667-5a8c-4393-a055-52eafa3016fc tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] The token cache is being invalidate because project 3aa3152001fd4a0f81374c17f5f7e086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:31:49.339118 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-dd2c5667-5a8c-4393-a055-52eafa3016fc tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:49.339870 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-dd2c5667-5a8c-4393-a055-52eafa3016fc tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:49.341554 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1381/2802] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:31:49 2022] DELETE /identity/v3/projects/3aa3152001fd4a0f81374c17f5f7e086 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:49.576101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f14af-67dd-4fed-9639-df317c395647 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:49.577973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-014f14af-67dd-4fed-9639-df317c395647 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:49.647224 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f14af-67dd-4fed-9639-df317c395647 tempest-VolumeQuotaClassesTest-444528223 tempest-VolumeQuotaClassesTest-444528223-project-admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:49.716664 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70575531-cb21-4afd-a600-c50f0aa751b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:49.717357 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70575531-cb21-4afd-a600-c50f0aa751b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:49.717662 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70575531-cb21-4afd-a600-c50f0aa751b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:49.717932 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70575531-cb21-4afd-a600-c50f0aa751b2 admin admin] PATH_INFO: `/v3/users/43949d6783ba4e12b69993cde27db1c6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:49.719109 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70575531-cb21-4afd-a600-c50f0aa751b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43949d6783ba4e12b69993cde27db1c6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:49.721073 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70575531-cb21-4afd-a600-c50f0aa751b2 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:49.772233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-70575531-cb21-4afd-a600-c50f0aa751b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43949d6783ba4e12b69993cde27db1c6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:49.780918 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-70575531-cb21-4afd-a600-c50f0aa751b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43949d6783ba4e12b69993cde27db1c6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:49.796136 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-70575531-cb21-4afd-a600-c50f0aa751b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43949d6783ba4e12b69993cde27db1c6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:49.796894 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-70575531-cb21-4afd-a600-c50f0aa751b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43949d6783ba4e12b69993cde27db1c6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:49.807866 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-70575531-cb21-4afd-a600-c50f0aa751b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43949d6783ba4e12b69993cde27db1c6'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:49.815225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1422/2803] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:31:49 2022] DELETE /identity/v3/users/43949d6783ba4e12b69993cde27db1c6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:49.819906 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14208dff-d142-40c7-87ae-e3ef5299ea8c None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:49.820193 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14208dff-d142-40c7-87ae-e3ef5299ea8c None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:49.820472 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14208dff-d142-40c7-87ae-e3ef5299ea8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:49.840843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-14208dff-d142-40c7-87ae-e3ef5299ea8c None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:49.842132 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-14208dff-d142-40c7-87ae-e3ef5299ea8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:49.846551 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:49.910833 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1382/2804] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:49.923314 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70575531-cb21-4afd-a600-c50f0aa751b2 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:49.925309 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-70575531-cb21-4afd-a600-c50f0aa751b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:49.949311 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:50.002140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70575531-cb21-4afd-a600-c50f0aa751b2 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:50.006233 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6efd9-d13e-401c-baf6-a3c94dfbb738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:50.006882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6efd9-d13e-401c-baf6-a3c94dfbb738 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:50.007161 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6efd9-d13e-401c-baf6-a3c94dfbb738 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:50.007449 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6efd9-d13e-401c-baf6-a3c94dfbb738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:50.018692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6efd9-d13e-401c-baf6-a3c94dfbb738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:50.020155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6efd9-d13e-401c-baf6-a3c94dfbb738 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:50.031920 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1423/2805] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:31:50.349508 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14208dff-d142-40c7-87ae-e3ef5299ea8c None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:50.351422 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-14208dff-d142-40c7-87ae-e3ef5299ea8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:50.372533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14208dff-d142-40c7-87ae-e3ef5299ea8c None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:50.378962 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d909cd0-c6eb-457e-a31b-c9a39b15f539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:50.379815 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d909cd0-c6eb-457e-a31b-c9a39b15f539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:50.380334 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d909cd0-c6eb-457e-a31b-c9a39b15f539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:50.380767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d909cd0-c6eb-457e-a31b-c9a39b15f539 admin admin] PATH_INFO: `/v3/projects/0a0f00aa58cf4b709aefa6f9aa3592b1` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:50.382584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d909cd0-c6eb-457e-a31b-c9a39b15f539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0f00aa58cf4b709aefa6f9aa3592b1)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:50.385803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d909cd0-c6eb-457e-a31b-c9a39b15f539 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:50.446722 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0d909cd0-c6eb-457e-a31b-c9a39b15f539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0f00aa58cf4b709aefa6f9aa3592b1', 'request_id': 'req-0d909cd0-c6eb-457e-a31b-c9a39b15f539'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:50.455312 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0d909cd0-c6eb-457e-a31b-c9a39b15f539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0f00aa58cf4b709aefa6f9aa3592b1', 'request_id': 'req-0d909cd0-c6eb-457e-a31b-c9a39b15f539'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:50.463760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0d909cd0-c6eb-457e-a31b-c9a39b15f539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0f00aa58cf4b709aefa6f9aa3592b1', 'request_id': 'req-0d909cd0-c6eb-457e-a31b-c9a39b15f539'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:50.477299 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0d909cd0-c6eb-457e-a31b-c9a39b15f539 admin admin] The token cache is being invalidate because project 0a0f00aa58cf4b709aefa6f9aa3592b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:31:50.477855 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0d909cd0-c6eb-457e-a31b-c9a39b15f539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:50.479025 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-0d909cd0-c6eb-457e-a31b-c9a39b15f539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:50.481318 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1383/2806] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:31:50 2022] DELETE /identity/v3/projects/0a0f00aa58cf4b709aefa6f9aa3592b1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:50.487014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6efd9-d13e-401c-baf6-a3c94dfbb738 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:50.500296 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6efd9-d13e-401c-baf6-a3c94dfbb738 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:50.571442 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a26bf8-83bf-4ea7-a900-a3299a0e69ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:50.572076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a26bf8-83bf-4ea7-a900-a3299a0e69ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:50.572352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a26bf8-83bf-4ea7-a900-a3299a0e69ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:50.572616 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a26bf8-83bf-4ea7-a900-a3299a0e69ff admin admin] PATH_INFO: `/v3/users/843c50fae6e94395898e0f31a02a6654` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:50.573849 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a26bf8-83bf-4ea7-a900-a3299a0e69ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=843c50fae6e94395898e0f31a02a6654)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:50.575797 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a26bf8-83bf-4ea7-a900-a3299a0e69ff admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:50.631043 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a8a26bf8-83bf-4ea7-a900-a3299a0e69ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843c50fae6e94395898e0f31a02a6654'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:50.638258 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a8a26bf8-83bf-4ea7-a900-a3299a0e69ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843c50fae6e94395898e0f31a02a6654'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:50.651141 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a8a26bf8-83bf-4ea7-a900-a3299a0e69ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843c50fae6e94395898e0f31a02a6654'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:50.651812 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a8a26bf8-83bf-4ea7-a900-a3299a0e69ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843c50fae6e94395898e0f31a02a6654'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:50.661135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-a8a26bf8-83bf-4ea7-a900-a3299a0e69ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843c50fae6e94395898e0f31a02a6654'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:50.667541 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1424/2807] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:31:50 2022] DELETE /identity/v3/users/843c50fae6e94395898e0f31a02a6654 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:50.996717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d909cd0-c6eb-457e-a31b-c9a39b15f539 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:50.998451 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0d909cd0-c6eb-457e-a31b-c9a39b15f539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:51.015850 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d909cd0-c6eb-457e-a31b-c9a39b15f539 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:51.087983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedea92c-672d-4e36-a480-a4ee223b8fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:51.088629 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedea92c-672d-4e36-a480-a4ee223b8fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:51.088900 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedea92c-672d-4e36-a480-a4ee223b8fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:51.089163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedea92c-672d-4e36-a480-a4ee223b8fb5 admin admin] PATH_INFO: `/v3/projects/a92ab628b3974f6284a9fbb9a4204c0b` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:51.090368 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedea92c-672d-4e36-a480-a4ee223b8fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92ab628b3974f6284a9fbb9a4204c0b)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:51.092327 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedea92c-672d-4e36-a480-a4ee223b8fb5 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:51.137909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:51.154028 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-aedea92c-672d-4e36-a480-a4ee223b8fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92ab628b3974f6284a9fbb9a4204c0b', 'request_id': 'req-aedea92c-672d-4e36-a480-a4ee223b8fb5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:51.166570 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-aedea92c-672d-4e36-a480-a4ee223b8fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92ab628b3974f6284a9fbb9a4204c0b', 'request_id': 'req-aedea92c-672d-4e36-a480-a4ee223b8fb5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:51.180285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-aedea92c-672d-4e36-a480-a4ee223b8fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92ab628b3974f6284a9fbb9a4204c0b', 'request_id': 'req-aedea92c-672d-4e36-a480-a4ee223b8fb5'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:51.199971 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-aedea92c-672d-4e36-a480-a4ee223b8fb5 admin admin] The token cache is being invalidate because project a92ab628b3974f6284a9fbb9a4204c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:31:51.200440 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-aedea92c-672d-4e36-a480-a4ee223b8fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:51.201520 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-aedea92c-672d-4e36-a480-a4ee223b8fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:31:51.204072 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1384/2808] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:31:50 2022] DELETE /identity/v3/projects/a92ab628b3974f6284a9fbb9a4204c0b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:51.210927 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602f74e-a3ce-471e-aae8-f88c734e7439 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:51.211648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602f74e-a3ce-471e-aae8-f88c734e7439 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:51.211648 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602f74e-a3ce-471e-aae8-f88c734e7439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:51.233599 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-c602f74e-a3ce-471e-aae8-f88c734e7439 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:51.235113 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-c602f74e-a3ce-471e-aae8-f88c734e7439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:51.274038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:51.305801 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1425/2809] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:51.315309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fab051-2593-4038-9d2d-9dcefe96ff6b None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:51.315606 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fab051-2593-4038-9d2d-9dcefe96ff6b None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:51.315989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fab051-2593-4038-9d2d-9dcefe96ff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:51.346466 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-47fab051-2593-4038-9d2d-9dcefe96ff6b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:51.347967 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-47fab051-2593-4038-9d2d-9dcefe96ff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:51.359106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1385/2810] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:31:51.363842 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602f74e-a3ce-471e-aae8-f88c734e7439 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:51.375230 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602f74e-a3ce-471e-aae8-f88c734e7439 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:51.381376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4ccd3-e258-46a7-8f73-1c12976ca0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:51.382089 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4ccd3-e258-46a7-8f73-1c12976ca0fc admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:51.382382 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4ccd3-e258-46a7-8f73-1c12976ca0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:51.382697 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4ccd3-e258-46a7-8f73-1c12976ca0fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:51.383447 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4ccd3-e258-46a7-8f73-1c12976ca0fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:31:51.383753 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4ccd3-e258-46a7-8f73-1c12976ca0fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:51.385534 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4ccd3-e258-46a7-8f73-1c12976ca0fc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:51.400104 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1426/2811] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:31:51.405773 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fab051-2593-4038-9d2d-9dcefe96ff6b None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:51.415920 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fab051-2593-4038-9d2d-9dcefe96ff6b None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:51.421205 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa8e37-4bc7-422e-88d8-dd3304edf646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:51.421889 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa8e37-4bc7-422e-88d8-dd3304edf646 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:51.422162 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa8e37-4bc7-422e-88d8-dd3304edf646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:51.422421 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa8e37-4bc7-422e-88d8-dd3304edf646 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:51.423071 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa8e37-4bc7-422e-88d8-dd3304edf646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:51.425030 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa8e37-4bc7-422e-88d8-dd3304edf646 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:51.459049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1386/2812] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:31:51 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:31:51.465145 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4ccd3-e258-46a7-8f73-1c12976ca0fc admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:51.478817 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4ccd3-e258-46a7-8f73-1c12976ca0fc admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:51.553069 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716e9aa-2fb6-4d54-9e96-f62e8f81eb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:51.553845 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716e9aa-2fb6-4d54-9e96-f62e8f81eb20 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:51.554217 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716e9aa-2fb6-4d54-9e96-f62e8f81eb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:51.554602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716e9aa-2fb6-4d54-9e96-f62e8f81eb20 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:51.555351 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716e9aa-2fb6-4d54-9e96-f62e8f81eb20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:51.557414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716e9aa-2fb6-4d54-9e96-f62e8f81eb20 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:51.585518 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1427/2813] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:31:51 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:31:51.591035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa8e37-4bc7-422e-88d8-dd3304edf646 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:51.603706 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa8e37-4bc7-422e-88d8-dd3304edf646 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:51.609735 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985433d-1742-425c-871b-ff64d8b71ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:51.610567 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985433d-1742-425c-871b-ff64d8b71ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:51.610992 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985433d-1742-425c-871b-ff64d8b71ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:51.611478 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985433d-1742-425c-871b-ff64d8b71ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:51.612288 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985433d-1742-425c-871b-ff64d8b71ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:51.614259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985433d-1742-425c-871b-ff64d8b71ca3 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:51.626295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1387/2814] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:31:51.630569 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716e9aa-2fb6-4d54-9e96-f62e8f81eb20 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:51.641797 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716e9aa-2fb6-4d54-9e96-f62e8f81eb20 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:51.646698 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f7022-1ffa-4fb4-811b-078c25d60a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:51.647315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f7022-1ffa-4fb4-811b-078c25d60a57 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:51.647594 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f7022-1ffa-4fb4-811b-078c25d60a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:51.647834 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f7022-1ffa-4fb4-811b-078c25d60a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:51.648503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f7022-1ffa-4fb4-811b-078c25d60a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:51.650154 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f7022-1ffa-4fb4-811b-078c25d60a57 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:51.661139 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1428/2815] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:31:51.665780 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985433d-1742-425c-871b-ff64d8b71ca3 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:51.677390 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985433d-1742-425c-871b-ff64d8b71ca3 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:51.683116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde165f-216b-49a8-a65e-7f4fca770086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:51.683779 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde165f-216b-49a8-a65e-7f4fca770086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:51.684053 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde165f-216b-49a8-a65e-7f4fca770086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:51.684322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde165f-216b-49a8-a65e-7f4fca770086 admin admin] PATH_INFO: `/v3/projects/c237d7c4f08d41fcb31763fcd180ca47/users/9fcf0f6d1ba84541b0029b5c633a2104/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:51.701281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde165f-216b-49a8-a65e-7f4fca770086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c237d7c4f08d41fcb31763fcd180ca47, user_id=9fcf0f6d1ba84541b0029b5c633a2104, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:51.704049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde165f-216b-49a8-a65e-7f4fca770086 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:51.720774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1388/2816] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:31:51 2022] PUT /identity/v3/projects/c237d7c4f08d41fcb31763fcd180ca47/users/9fcf0f6d1ba84541b0029b5c633a2104/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:51.736119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5210a7-8d28-45ac-bc8e-e913dd0d260b None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:51.736395 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5210a7-8d28-45ac-bc8e-e913dd0d260b None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:51.736637 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5210a7-8d28-45ac-bc8e-e913dd0d260b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:51.771473 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-9b5210a7-8d28-45ac-bc8e-e913dd0d260b None None] MFA Rules not processed for user `9fcf0f6d1ba84541b0029b5c633a2104`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:51.772785 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-9b5210a7-8d28-45ac-bc8e-e913dd0d260b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:51.869196 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1429/2817] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:31:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:51.876238 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde165f-216b-49a8-a65e-7f4fca770086 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:51.983760 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde165f-216b-49a8-a65e-7f4fca770086 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:51.989194 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cad2b-0f11-4366-b984-78a3f8b8e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:51.989909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cad2b-0f11-4366-b984-78a3f8b8e28b admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:51.990191 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cad2b-0f11-4366-b984-78a3f8b8e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:51.990462 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cad2b-0f11-4366-b984-78a3f8b8e28b admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:51.991124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cad2b-0f11-4366-b984-78a3f8b8e28b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:51.993121 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cad2b-0f11-4366-b984-78a3f8b8e28b admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:52.024495 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1389/2818] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:31:51 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:31:52.029040 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5210a7-8d28-45ac-bc8e-e913dd0d260b None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:52.042445 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5210a7-8d28-45ac-bc8e-e913dd0d260b None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:52.084369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:52.119439 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051667b-b0a2-43ad-9263-b3545019f0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:52.120126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051667b-b0a2-43ad-9263-b3545019f0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:52.120403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051667b-b0a2-43ad-9263-b3545019f0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:52.120673 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051667b-b0a2-43ad-9263-b3545019f0f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:52.121352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051667b-b0a2-43ad-9263-b3545019f0f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:52.123797 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051667b-b0a2-43ad-9263-b3545019f0f7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:52.148386 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1430/2819] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:31:52 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:31:52.153160 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cad2b-0f11-4366-b984-78a3f8b8e28b admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:52.165030 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cad2b-0f11-4366-b984-78a3f8b8e28b admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:52.170983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a56933-d5ae-43b4-ae44-62b740ef9836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:52.171630 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a56933-d5ae-43b4-ae44-62b740ef9836 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:52.171899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a56933-d5ae-43b4-ae44-62b740ef9836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:52.172158 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a56933-d5ae-43b4-ae44-62b740ef9836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:52.172812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a56933-d5ae-43b4-ae44-62b740ef9836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:52.174507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a56933-d5ae-43b4-ae44-62b740ef9836 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:52.186892 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1390/2820] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:31:52.192625 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051667b-b0a2-43ad-9263-b3545019f0f7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:52.205962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051667b-b0a2-43ad-9263-b3545019f0f7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:52.212043 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b82fd3-ca26-4c02-8126-160998ee6894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:52.212974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b82fd3-ca26-4c02-8126-160998ee6894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:52.213200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b82fd3-ca26-4c02-8126-160998ee6894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:52.213548 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b82fd3-ca26-4c02-8126-160998ee6894 admin admin] PATH_INFO: `/v3/projects/e390cdc8740541378021e42ac4e97459/users/a6077ad93bb44908b263a7eca3629647/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:52.234503 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b82fd3-ca26-4c02-8126-160998ee6894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e390cdc8740541378021e42ac4e97459, user_id=a6077ad93bb44908b263a7eca3629647, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:52.237728 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b82fd3-ca26-4c02-8126-160998ee6894 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:52.255414 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1431/2821] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:31:52 2022] PUT /identity/v3/projects/e390cdc8740541378021e42ac4e97459/users/a6077ad93bb44908b263a7eca3629647/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:52.259417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a56933-d5ae-43b4-ae44-62b740ef9836 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:52.270655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a56933-d5ae-43b4-ae44-62b740ef9836 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:52.305810 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:31:52.337694 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcc8ae-bc2f-41a2-b822-2cec7112ab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:52.338319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcc8ae-bc2f-41a2-b822-2cec7112ab77 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:52.338590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcc8ae-bc2f-41a2-b822-2cec7112ab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:52.338854 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcc8ae-bc2f-41a2-b822-2cec7112ab77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:52.339507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcc8ae-bc2f-41a2-b822-2cec7112ab77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:52.341195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcc8ae-bc2f-41a2-b822-2cec7112ab77 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:52.352250 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1391/2822] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:31:52.357859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b82fd3-ca26-4c02-8126-160998ee6894 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:52.368778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b82fd3-ca26-4c02-8126-160998ee6894 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:52.373980 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabd691-6fda-49a6-b504-75fb7b5950a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:52.374661 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabd691-6fda-49a6-b504-75fb7b5950a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:52.374934 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabd691-6fda-49a6-b504-75fb7b5950a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:52.375204 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabd691-6fda-49a6-b504-75fb7b5950a0 admin admin] PATH_INFO: `/v3/projects/e390cdc8740541378021e42ac4e97459/users/a6077ad93bb44908b263a7eca3629647/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:52.377213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabd691-6fda-49a6-b504-75fb7b5950a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e390cdc8740541378021e42ac4e97459, user_id=a6077ad93bb44908b263a7eca3629647, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:52.379927 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabd691-6fda-49a6-b504-75fb7b5950a0 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:52.391810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1432/2823] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:31:52 2022] PUT /identity/v3/projects/e390cdc8740541378021e42ac4e97459/users/a6077ad93bb44908b263a7eca3629647/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:31:52.403656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64562318-2178-4daa-8f06-d2a8e1988d51 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:52.404289 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64562318-2178-4daa-8f06-d2a8e1988d51 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:52.404387 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64562318-2178-4daa-8f06-d2a8e1988d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:52.437009 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-64562318-2178-4daa-8f06-d2a8e1988d51 None None] MFA Rules not processed for user `a6077ad93bb44908b263a7eca3629647`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:31:52.438344 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-64562318-2178-4daa-8f06-d2a8e1988d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:52.526544 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1392/2824] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:31:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:31:52.539892 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabd691-6fda-49a6-b504-75fb7b5950a0 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:52.542906 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-2cabd691-6fda-49a6-b504-75fb7b5950a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:52.619135 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabd691-6fda-49a6-b504-75fb7b5950a0 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:52.623846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9739f-ddff-4fbb-bb1f-faf024875d77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:52.624531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9739f-ddff-4fbb-bb1f-faf024875d77 service cinder] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:52.624833 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9739f-ddff-4fbb-bb1f-faf024875d77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:52.625105 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9739f-ddff-4fbb-bb1f-faf024875d77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:52.700038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9739f-ddff-4fbb-bb1f-faf024875d77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:52.701609 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa9739f-ddff-4fbb-bb1f-faf024875d77 service cinder] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:52.712720 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1433/2825] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:31:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:31:57.212103 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64562318-2178-4daa-8f06-d2a8e1988d51 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:31:57.213952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-64562318-2178-4daa-8f06-d2a8e1988d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:31:57.227855 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64562318-2178-4daa-8f06-d2a8e1988d51 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:31:57.232319 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e48b6-d50a-4429-8d0b-e6cd89291132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:31:57.232956 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e48b6-d50a-4429-8d0b-e6cd89291132 service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:31:57.233235 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e48b6-d50a-4429-8d0b-e6cd89291132 service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:31:57.233494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e48b6-d50a-4429-8d0b-e6cd89291132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:31:57.243745 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e48b6-d50a-4429-8d0b-e6cd89291132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:31:57.245417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e48b6-d50a-4429-8d0b-e6cd89291132 service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:31:57.256902 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1393/2826] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:31:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:02.375234 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9739f-ddff-4fbb-bb1f-faf024875d77 service cinder] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:02.426434 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:02.450533 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9739f-ddff-4fbb-bb1f-faf024875d77 service cinder] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:02.455258 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab800fa7-03ca-42e5-b2f4-2d9d15f803c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:02.455973 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab800fa7-03ca-42e5-b2f4-2d9d15f803c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:02.456288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab800fa7-03ca-42e5-b2f4-2d9d15f803c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:02.456679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab800fa7-03ca-42e5-b2f4-2d9d15f803c8 admin admin] PATH_INFO: `/v3/users/9fcf0f6d1ba84541b0029b5c633a2104` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:02.458035 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab800fa7-03ca-42e5-b2f4-2d9d15f803c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fcf0f6d1ba84541b0029b5c633a2104)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:02.460086 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab800fa7-03ca-42e5-b2f4-2d9d15f803c8 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:02.528082 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ab800fa7-03ca-42e5-b2f4-2d9d15f803c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fcf0f6d1ba84541b0029b5c633a2104'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:02.537384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ab800fa7-03ca-42e5-b2f4-2d9d15f803c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fcf0f6d1ba84541b0029b5c633a2104'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:02.554130 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ab800fa7-03ca-42e5-b2f4-2d9d15f803c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fcf0f6d1ba84541b0029b5c633a2104'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:02.554912 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ab800fa7-03ca-42e5-b2f4-2d9d15f803c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fcf0f6d1ba84541b0029b5c633a2104'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:02.564477 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ab800fa7-03ca-42e5-b2f4-2d9d15f803c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fcf0f6d1ba84541b0029b5c633a2104'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:02.570861 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1434/2827] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:32:02 2022] DELETE /identity/v3/users/9fcf0f6d1ba84541b0029b5c633a2104 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:32:02.575744 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022f579-cf0f-41c8-aa1e-cb601cec1fc1 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:02.576594 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022f579-cf0f-41c8-aa1e-cb601cec1fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:02.576788 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022f579-cf0f-41c8-aa1e-cb601cec1fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:02.598725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-d022f579-cf0f-41c8-aa1e-cb601cec1fc1 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:02.599983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d022f579-cf0f-41c8-aa1e-cb601cec1fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:02.675512 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1394/2828] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:02.689290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab800fa7-03ca-42e5-b2f4-2d9d15f803c8 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:02.691729 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ab800fa7-03ca-42e5-b2f4-2d9d15f803c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:02.761256 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab800fa7-03ca-42e5-b2f4-2d9d15f803c8 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:02.766031 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb351fc7-12f4-4f59-9eeb-d54911531af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:02.766695 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb351fc7-12f4-4f59-9eeb-d54911531af4 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:02.767004 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb351fc7-12f4-4f59-9eeb-d54911531af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:02.767268 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb351fc7-12f4-4f59-9eeb-d54911531af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:02.778826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb351fc7-12f4-4f59-9eeb-d54911531af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:02.780306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb351fc7-12f4-4f59-9eeb-d54911531af4 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:02.791489 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1435/2829] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:03.113101 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022f579-cf0f-41c8-aa1e-cb601cec1fc1 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:03.114723 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d022f579-cf0f-41c8-aa1e-cb601cec1fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:03.132590 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022f579-cf0f-41c8-aa1e-cb601cec1fc1 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:03.140996 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:03.142044 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:03.142509 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:03.143310 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e admin admin] PATH_INFO: `/v3/projects/c237d7c4f08d41fcb31763fcd180ca47` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:03.144892 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c237d7c4f08d41fcb31763fcd180ca47)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:03.148272 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:03.210104 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:03.222890 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c237d7c4f08d41fcb31763fcd180ca47', 'request_id': 'req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:03.232377 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c237d7c4f08d41fcb31763fcd180ca47', 'request_id': 'req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:03.240321 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c237d7c4f08d41fcb31763fcd180ca47', 'request_id': 'req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:03.252003 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e admin admin] The token cache is being invalidate because project c237d7c4f08d41fcb31763fcd180ca47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:32:03.252303 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:03.252983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:03.254531 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1395/2830] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:32:03 2022] DELETE /identity/v3/projects/c237d7c4f08d41fcb31763fcd180ca47 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:32:03.258771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb351fc7-12f4-4f59-9eeb-d54911531af4 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:03.270191 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb351fc7-12f4-4f59-9eeb-d54911531af4 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:03.334237 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58b968-d01a-4fec-9432-5b2ea1100625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:03.334878 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b968-d01a-4fec-9432-5b2ea1100625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:03.335146 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b968-d01a-4fec-9432-5b2ea1100625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:03.335409 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b968-d01a-4fec-9432-5b2ea1100625 admin admin] PATH_INFO: `/v3/users/a6077ad93bb44908b263a7eca3629647` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:03.336612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58b968-d01a-4fec-9432-5b2ea1100625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6077ad93bb44908b263a7eca3629647)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:03.338593 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58b968-d01a-4fec-9432-5b2ea1100625 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:03.341553 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:03.397859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ca58b968-d01a-4fec-9432-5b2ea1100625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6077ad93bb44908b263a7eca3629647'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:03.406003 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ca58b968-d01a-4fec-9432-5b2ea1100625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6077ad93bb44908b263a7eca3629647'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:03.420107 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ca58b968-d01a-4fec-9432-5b2ea1100625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6077ad93bb44908b263a7eca3629647'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:03.420864 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ca58b968-d01a-4fec-9432-5b2ea1100625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6077ad93bb44908b263a7eca3629647'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:03.431575 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-ca58b968-d01a-4fec-9432-5b2ea1100625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6077ad93bb44908b263a7eca3629647'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:03.439089 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1436/2831] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:32:03 2022] DELETE /identity/v3/users/a6077ad93bb44908b263a7eca3629647 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:32:03.789473 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:03.791134 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:03.805988 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd7304-75f3-43d4-adbf-4c0d02a78b4e admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:03.887402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8aec21-eea7-43a1-bad1-2107fdcc48fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:03.888474 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aec21-eea7-43a1-bad1-2107fdcc48fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:03.888946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aec21-eea7-43a1-bad1-2107fdcc48fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:03.889414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8aec21-eea7-43a1-bad1-2107fdcc48fd admin admin] PATH_INFO: `/v3/projects/e390cdc8740541378021e42ac4e97459` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:03.891438 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8aec21-eea7-43a1-bad1-2107fdcc48fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e390cdc8740541378021e42ac4e97459)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:03.894958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8aec21-eea7-43a1-bad1-2107fdcc48fd admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:03.960585 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5e8aec21-eea7-43a1-bad1-2107fdcc48fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e390cdc8740541378021e42ac4e97459', 'request_id': 'req-5e8aec21-eea7-43a1-bad1-2107fdcc48fd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:03.972837 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5e8aec21-eea7-43a1-bad1-2107fdcc48fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e390cdc8740541378021e42ac4e97459', 'request_id': 'req-5e8aec21-eea7-43a1-bad1-2107fdcc48fd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:03.980782 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5e8aec21-eea7-43a1-bad1-2107fdcc48fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e390cdc8740541378021e42ac4e97459', 'request_id': 'req-5e8aec21-eea7-43a1-bad1-2107fdcc48fd'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:03.994078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5e8aec21-eea7-43a1-bad1-2107fdcc48fd admin admin] The token cache is being invalidate because project e390cdc8740541378021e42ac4e97459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:32:03.994501 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5e8aec21-eea7-43a1-bad1-2107fdcc48fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:03.995306 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-5e8aec21-eea7-43a1-bad1-2107fdcc48fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:03.997296 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1396/2832] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:32:03 2022] DELETE /identity/v3/projects/e390cdc8740541378021e42ac4e97459 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:32:04.004316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6e20b-f910-423e-a24e-a2e278c43442 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:04.004621 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6e20b-f910-423e-a24e-a2e278c43442 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:04.005005 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6e20b-f910-423e-a24e-a2e278c43442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:04.028510 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-ffb6e20b-f910-423e-a24e-a2e278c43442 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:04.030036 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ffb6e20b-f910-423e-a24e-a2e278c43442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:04.115993 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1437/2833] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:04.124979 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b78349-8ed1-4cbd-836b-1757cd0d6d59 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:04.125264 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b78349-8ed1-4cbd-836b-1757cd0d6d59 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:04.125533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b78349-8ed1-4cbd-836b-1757cd0d6d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:04.146915 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-25b78349-8ed1-4cbd-836b-1757cd0d6d59 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:04.148224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-25b78349-8ed1-4cbd-836b-1757cd0d6d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:04.157347 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1397/2834] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:04.163696 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6e20b-f910-423e-a24e-a2e278c43442 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:04.174674 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6e20b-f910-423e-a24e-a2e278c43442 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:04.181272 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22411764-fd32-4dce-abfe-7c4fa0aecdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:04.182081 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22411764-fd32-4dce-abfe-7c4fa0aecdcc admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:04.182526 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22411764-fd32-4dce-abfe-7c4fa0aecdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:04.182807 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22411764-fd32-4dce-abfe-7c4fa0aecdcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:04.183514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22411764-fd32-4dce-abfe-7c4fa0aecdcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:32:04.183876 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22411764-fd32-4dce-abfe-7c4fa0aecdcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:04.185666 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22411764-fd32-4dce-abfe-7c4fa0aecdcc admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:04.205246 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1438/2835] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:32:04.210121 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b78349-8ed1-4cbd-836b-1757cd0d6d59 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:04.221116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b78349-8ed1-4cbd-836b-1757cd0d6d59 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:04.226968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc215f-400b-4a41-b37d-53ef0a56dbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:04.227507 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc215f-400b-4a41-b37d-53ef0a56dbdf admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:04.227789 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc215f-400b-4a41-b37d-53ef0a56dbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:04.228060 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc215f-400b-4a41-b37d-53ef0a56dbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:04.229033 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc215f-400b-4a41-b37d-53ef0a56dbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:04.231184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc215f-400b-4a41-b37d-53ef0a56dbdf admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:04.264948 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1398/2836] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:32:04 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:32:04.269545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22411764-fd32-4dce-abfe-7c4fa0aecdcc admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:04.280512 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22411764-fd32-4dce-abfe-7c4fa0aecdcc admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:04.345030 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029ba0a-263a-44c7-b5a9-98893de99b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:04.345814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029ba0a-263a-44c7-b5a9-98893de99b4a admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:04.346099 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029ba0a-263a-44c7-b5a9-98893de99b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:04.346365 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029ba0a-263a-44c7-b5a9-98893de99b4a admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:04.347017 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029ba0a-263a-44c7-b5a9-98893de99b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:04.348982 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029ba0a-263a-44c7-b5a9-98893de99b4a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:04.371188 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:04.393969 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1439/2837] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:32:04 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:32:04.398953 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc215f-400b-4a41-b37d-53ef0a56dbdf admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:04.411396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc215f-400b-4a41-b37d-53ef0a56dbdf admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:04.416211 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea546de-da4c-470b-ace2-af3d81326b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:04.416828 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea546de-da4c-470b-ace2-af3d81326b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:04.417093 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea546de-da4c-470b-ace2-af3d81326b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:04.417361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea546de-da4c-470b-ace2-af3d81326b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:04.418051 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea546de-da4c-470b-ace2-af3d81326b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:04.419717 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea546de-da4c-470b-ace2-af3d81326b42 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:04.430496 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1399/2838] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:32:04.436088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029ba0a-263a-44c7-b5a9-98893de99b4a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:04.447014 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029ba0a-263a-44c7-b5a9-98893de99b4a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:04.451914 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c870c2a-1af4-405e-8367-f6634c0caa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:04.452537 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870c2a-1af4-405e-8367-f6634c0caa8b admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:04.452814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870c2a-1af4-405e-8367-f6634c0caa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:04.453084 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870c2a-1af4-405e-8367-f6634c0caa8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:04.453761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c870c2a-1af4-405e-8367-f6634c0caa8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:04.455369 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c870c2a-1af4-405e-8367-f6634c0caa8b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:04.467139 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1440/2839] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:32:04.471649 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea546de-da4c-470b-ace2-af3d81326b42 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:04.482968 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea546de-da4c-470b-ace2-af3d81326b42 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:04.487914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd64f9b-759c-4833-9ba1-e8e7de29bb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:04.488568 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd64f9b-759c-4833-9ba1-e8e7de29bb9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:04.488857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd64f9b-759c-4833-9ba1-e8e7de29bb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:04.489108 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd64f9b-759c-4833-9ba1-e8e7de29bb9d admin admin] PATH_INFO: `/v3/projects/c38f8b94ea804ca7a524d325bdedd0d0/users/ec15735491ce4e0ebf212b9723c5ad8c/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:04.502088 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:04.505857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd64f9b-759c-4833-9ba1-e8e7de29bb9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38f8b94ea804ca7a524d325bdedd0d0, user_id=ec15735491ce4e0ebf212b9723c5ad8c, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:04.508847 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd64f9b-759c-4833-9ba1-e8e7de29bb9d admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:04.524471 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1400/2840] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:32:04 2022] PUT /identity/v3/projects/c38f8b94ea804ca7a524d325bdedd0d0/users/ec15735491ce4e0ebf212b9723c5ad8c/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:32:04.595076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c996d-f2fe-4165-a06b-605ef076daa0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:04.595396 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c996d-f2fe-4165-a06b-605ef076daa0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:04.595629 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c996d-f2fe-4165-a06b-605ef076daa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:04.624713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-1f8c996d-f2fe-4165-a06b-605ef076daa0 None None] MFA Rules not processed for user `ec15735491ce4e0ebf212b9723c5ad8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:04.625975 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-1f8c996d-f2fe-4165-a06b-605ef076daa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:04.701328 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1441/2841] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:04.713992 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd64f9b-759c-4833-9ba1-e8e7de29bb9d admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:04.715895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8dd64f9b-759c-4833-9ba1-e8e7de29bb9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:04.798719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd64f9b-759c-4833-9ba1-e8e7de29bb9d admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:04.802797 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530207ea-0d9c-4309-89dd-2f497f8fe0f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5356835ef79c458bbfa7d6adafd0cb36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:04.803412 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530207ea-0d9c-4309-89dd-2f497f8fe0f6 service glance] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:04.803675 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530207ea-0d9c-4309-89dd-2f497f8fe0f6 service glance] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:04.803937 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530207ea-0d9c-4309-89dd-2f497f8fe0f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:04.813227 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530207ea-0d9c-4309-89dd-2f497f8fe0f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:04.814705 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530207ea-0d9c-4309-89dd-2f497f8fe0f6 service glance] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:04.824518 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1401/2842] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:14.698096 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=38 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:14.819927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:22.613470 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c996d-f2fe-4165-a06b-605ef076daa0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:22.680538 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c996d-f2fe-4165-a06b-605ef076daa0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:22.685247 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68596f0d-a062-456a-b95e-f94d44acd953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:22.685860 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68596f0d-a062-456a-b95e-f94d44acd953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:22.686136 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68596f0d-a062-456a-b95e-f94d44acd953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:22.686387 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68596f0d-a062-456a-b95e-f94d44acd953 admin admin] PATH_INFO: `/v3/users/ec15735491ce4e0ebf212b9723c5ad8c` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:22.687501 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68596f0d-a062-456a-b95e-f94d44acd953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec15735491ce4e0ebf212b9723c5ad8c)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:22.689432 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68596f0d-a062-456a-b95e-f94d44acd953 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:22.740160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-68596f0d-a062-456a-b95e-f94d44acd953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec15735491ce4e0ebf212b9723c5ad8c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:22.748132 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-68596f0d-a062-456a-b95e-f94d44acd953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec15735491ce4e0ebf212b9723c5ad8c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:22.764872 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-68596f0d-a062-456a-b95e-f94d44acd953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec15735491ce4e0ebf212b9723c5ad8c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:22.765654 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-68596f0d-a062-456a-b95e-f94d44acd953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec15735491ce4e0ebf212b9723c5ad8c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:22.774265 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-68596f0d-a062-456a-b95e-f94d44acd953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec15735491ce4e0ebf212b9723c5ad8c'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:22.781174 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1442/2843] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:32:22 2022] DELETE /identity/v3/users/ec15735491ce4e0ebf212b9723c5ad8c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:32:22.785506 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981add8b-a500-4c97-a468-4e4fc39f9336 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:22.786043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981add8b-a500-4c97-a468-4e4fc39f9336 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:22.786167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981add8b-a500-4c97-a468-4e4fc39f9336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:22.805477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-981add8b-a500-4c97-a468-4e4fc39f9336 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:22.806743 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-981add8b-a500-4c97-a468-4e4fc39f9336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:22.869476 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1402/2844] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:22.880437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68596f0d-a062-456a-b95e-f94d44acd953 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:22.882187 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-68596f0d-a062-456a-b95e-f94d44acd953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:22.952420 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68596f0d-a062-456a-b95e-f94d44acd953 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:22.956848 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc813dd-2fce-4a9e-ade2-996504e6c964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:22.957463 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc813dd-2fce-4a9e-ade2-996504e6c964 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:22.957772 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc813dd-2fce-4a9e-ade2-996504e6c964 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:22.958043 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc813dd-2fce-4a9e-ade2-996504e6c964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:22.968515 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc813dd-2fce-4a9e-ade2-996504e6c964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:22.969987 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc813dd-2fce-4a9e-ade2-996504e6c964 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:22.980828 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1443/2845] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:23.278950 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981add8b-a500-4c97-a468-4e4fc39f9336 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:23.280449 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-981add8b-a500-4c97-a468-4e4fc39f9336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:23.299234 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981add8b-a500-4c97-a468-4e4fc39f9336 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:23.304089 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dc954-4dfa-47f9-8934-c8d8eff3fea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:23.304783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dc954-4dfa-47f9-8934-c8d8eff3fea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:23.305060 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dc954-4dfa-47f9-8934-c8d8eff3fea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:23.305291 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dc954-4dfa-47f9-8934-c8d8eff3fea7 admin admin] PATH_INFO: `/v3/projects/c38f8b94ea804ca7a524d325bdedd0d0` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:23.306525 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390dc954-4dfa-47f9-8934-c8d8eff3fea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38f8b94ea804ca7a524d325bdedd0d0)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:23.308454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390dc954-4dfa-47f9-8934-c8d8eff3fea7 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:23.357091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-390dc954-4dfa-47f9-8934-c8d8eff3fea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38f8b94ea804ca7a524d325bdedd0d0', 'request_id': 'req-390dc954-4dfa-47f9-8934-c8d8eff3fea7'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:23.365323 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-390dc954-4dfa-47f9-8934-c8d8eff3fea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38f8b94ea804ca7a524d325bdedd0d0', 'request_id': 'req-390dc954-4dfa-47f9-8934-c8d8eff3fea7'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:23.372085 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-390dc954-4dfa-47f9-8934-c8d8eff3fea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38f8b94ea804ca7a524d325bdedd0d0', 'request_id': 'req-390dc954-4dfa-47f9-8934-c8d8eff3fea7'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:23.382359 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-390dc954-4dfa-47f9-8934-c8d8eff3fea7 admin admin] The token cache is being invalidate because project c38f8b94ea804ca7a524d325bdedd0d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:32:23.382644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-390dc954-4dfa-47f9-8934-c8d8eff3fea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:23.383255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-390dc954-4dfa-47f9-8934-c8d8eff3fea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:23.384754 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1403/2846] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:32:23 2022] DELETE /identity/v3/projects/c38f8b94ea804ca7a524d325bdedd0d0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:32:23.390253 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76354af-5de1-4551-82ff-7af0ecfc10d3 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:23.390508 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76354af-5de1-4551-82ff-7af0ecfc10d3 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:23.390808 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76354af-5de1-4551-82ff-7af0ecfc10d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:23.411740 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-d76354af-5de1-4551-82ff-7af0ecfc10d3 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:23.412954 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-d76354af-5de1-4551-82ff-7af0ecfc10d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:23.436047 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:23.481995 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1444/2847] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:23.489724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce3698-9cb5-4c64-8c24-a3bd18e9b100 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:23.490011 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce3698-9cb5-4c64-8c24-a3bd18e9b100 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:23.490269 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce3698-9cb5-4c64-8c24-a3bd18e9b100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:23.512753 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-54ce3698-9cb5-4c64-8c24-a3bd18e9b100 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:23.514027 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-54ce3698-9cb5-4c64-8c24-a3bd18e9b100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:23.523430 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1404/2848] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:23.529573 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76354af-5de1-4551-82ff-7af0ecfc10d3 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:23.540209 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76354af-5de1-4551-82ff-7af0ecfc10d3 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:23.545019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5f95b-3c90-4b90-87a5-d3248ed95402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:23.545598 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5f95b-3c90-4b90-87a5-d3248ed95402 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:23.545961 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5f95b-3c90-4b90-87a5-d3248ed95402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:23.546225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5f95b-3c90-4b90-87a5-d3248ed95402 admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:23.546869 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5f95b-3c90-4b90-87a5-d3248ed95402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:32:23.547163 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5f95b-3c90-4b90-87a5-d3248ed95402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:23.548764 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5f95b-3c90-4b90-87a5-d3248ed95402 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:23.560769 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1445/2849] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:32:23.565512 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce3698-9cb5-4c64-8c24-a3bd18e9b100 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:23.574584 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce3698-9cb5-4c64-8c24-a3bd18e9b100 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:23.579828 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff63cd-bd23-4ccf-8f08-a7f8bd70a18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:23.580400 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff63cd-bd23-4ccf-8f08-a7f8bd70a18e admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:23.580724 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff63cd-bd23-4ccf-8f08-a7f8bd70a18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:23.580899 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff63cd-bd23-4ccf-8f08-a7f8bd70a18e admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:23.581652 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff63cd-bd23-4ccf-8f08-a7f8bd70a18e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:23.583535 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff63cd-bd23-4ccf-8f08-a7f8bd70a18e admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:23.613878 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1405/2850] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:32:23 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:32:23.619638 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5f95b-3c90-4b90-87a5-d3248ed95402 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:23.631774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5f95b-3c90-4b90-87a5-d3248ed95402 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:23.697283 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b915dd3-c75e-4a56-8c88-615a3a6de88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:23.697924 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b915dd3-c75e-4a56-8c88-615a3a6de88f admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:23.698200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b915dd3-c75e-4a56-8c88-615a3a6de88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:23.698467 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b915dd3-c75e-4a56-8c88-615a3a6de88f admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:23.699103 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b915dd3-c75e-4a56-8c88-615a3a6de88f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:23.701052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b915dd3-c75e-4a56-8c88-615a3a6de88f admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:23.724682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1446/2851] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:32:23 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:32:23.729346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff63cd-bd23-4ccf-8f08-a7f8bd70a18e admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:23.740560 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff63cd-bd23-4ccf-8f08-a7f8bd70a18e admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:23.746374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556545b-8853-4019-94a0-a9d6ab1a64be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:23.746993 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556545b-8853-4019-94a0-a9d6ab1a64be admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:23.747247 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556545b-8853-4019-94a0-a9d6ab1a64be admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:23.747577 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556545b-8853-4019-94a0-a9d6ab1a64be admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:23.748223 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556545b-8853-4019-94a0-a9d6ab1a64be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:23.749871 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556545b-8853-4019-94a0-a9d6ab1a64be admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:23.765187 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1406/2852] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:32:23.769789 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b915dd3-c75e-4a56-8c88-615a3a6de88f admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:23.780315 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b915dd3-c75e-4a56-8c88-615a3a6de88f admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:23.785340 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31948763-a348-46ea-b352-072962e5fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:23.785981 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31948763-a348-46ea-b352-072962e5fc55 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:23.786252 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31948763-a348-46ea-b352-072962e5fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:23.786501 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31948763-a348-46ea-b352-072962e5fc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:23.787148 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31948763-a348-46ea-b352-072962e5fc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:23.788725 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31948763-a348-46ea-b352-072962e5fc55 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:23.800115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1447/2853] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:32:23.804754 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556545b-8853-4019-94a0-a9d6ab1a64be admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:23.816167 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556545b-8853-4019-94a0-a9d6ab1a64be admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:23.821643 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65d902-6e05-4990-8213-9f39613a4e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:23.822356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65d902-6e05-4990-8213-9f39613a4e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:23.822644 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65d902-6e05-4990-8213-9f39613a4e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:23.822901 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65d902-6e05-4990-8213-9f39613a4e2e admin admin] PATH_INFO: `/v3/projects/c468a7e36c384eae854b157c7e478c1f/users/c97a71127c124a6481cb5e72ab2ea8cb/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:23.839907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65d902-6e05-4990-8213-9f39613a4e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c468a7e36c384eae854b157c7e478c1f, user_id=c97a71127c124a6481cb5e72ab2ea8cb, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:23.842606 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65d902-6e05-4990-8213-9f39613a4e2e admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:23.862867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1407/2854] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:32:23 2022] PUT /identity/v3/projects/c468a7e36c384eae854b157c7e478c1f/users/c97a71127c124a6481cb5e72ab2ea8cb/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:32:23.874960 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fbfe5-ec9d-4d99-bf1e-781eb80f1083 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:23.875211 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fbfe5-ec9d-4d99-bf1e-781eb80f1083 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:23.875499 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fbfe5-ec9d-4d99-bf1e-781eb80f1083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:23.914340 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f57fbfe5-ec9d-4d99-bf1e-781eb80f1083 None None] MFA Rules not processed for user `c97a71127c124a6481cb5e72ab2ea8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:23.916038 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f57fbfe5-ec9d-4d99-bf1e-781eb80f1083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:23.990101 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1448/2855] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:24.003493 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65d902-6e05-4990-8213-9f39613a4e2e admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:24.005352 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2c65d902-6e05-4990-8213-9f39613a4e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:24.028803 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:24.070104 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65d902-6e05-4990-8213-9f39613a4e2e admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:24.074080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ede57-a2da-401e-918e-b49b2ec0bd3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:24.074679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ede57-a2da-401e-918e-b49b2ec0bd3d service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:24.074941 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ede57-a2da-401e-918e-b49b2ec0bd3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:24.075197 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ede57-a2da-401e-918e-b49b2ec0bd3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:24.085308 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ede57-a2da-401e-918e-b49b2ec0bd3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:24.087637 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ede57-a2da-401e-918e-b49b2ec0bd3d service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:24.099270 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1408/2856] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:29.570092 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fbfe5-ec9d-4d99-bf1e-781eb80f1083 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:29.591213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:29.637679 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fbfe5-ec9d-4d99-bf1e-781eb80f1083 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:29.643862 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3816d-fda0-46d4-83f4-cc35e7eb9837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:29.644498 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3816d-fda0-46d4-83f4-cc35e7eb9837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:29.644770 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3816d-fda0-46d4-83f4-cc35e7eb9837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:29.645041 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3816d-fda0-46d4-83f4-cc35e7eb9837 admin admin] PATH_INFO: `/v3/users/c97a71127c124a6481cb5e72ab2ea8cb` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:29.646288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3816d-fda0-46d4-83f4-cc35e7eb9837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c97a71127c124a6481cb5e72ab2ea8cb)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:29.648269 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3816d-fda0-46d4-83f4-cc35e7eb9837 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:29.717504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32f3816d-fda0-46d4-83f4-cc35e7eb9837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c97a71127c124a6481cb5e72ab2ea8cb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:29.725553 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32f3816d-fda0-46d4-83f4-cc35e7eb9837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c97a71127c124a6481cb5e72ab2ea8cb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:29.741192 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32f3816d-fda0-46d4-83f4-cc35e7eb9837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c97a71127c124a6481cb5e72ab2ea8cb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:29.741900 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32f3816d-fda0-46d4-83f4-cc35e7eb9837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c97a71127c124a6481cb5e72ab2ea8cb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:29.751292 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-32f3816d-fda0-46d4-83f4-cc35e7eb9837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c97a71127c124a6481cb5e72ab2ea8cb'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:29.760513 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1449/2857] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:32:29 2022] DELETE /identity/v3/users/c97a71127c124a6481cb5e72ab2ea8cb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:32:29.766021 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16892e27-882e-4097-af7a-6c0833fdd93b None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:29.766626 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16892e27-882e-4097-af7a-6c0833fdd93b None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:29.766626 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16892e27-882e-4097-af7a-6c0833fdd93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:29.795726 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-16892e27-882e-4097-af7a-6c0833fdd93b None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:29.797516 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-16892e27-882e-4097-af7a-6c0833fdd93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:29.876189 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1409/2858] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:29.886978 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3816d-fda0-46d4-83f4-cc35e7eb9837 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:29.888671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-32f3816d-fda0-46d4-83f4-cc35e7eb9837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:29.949401 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3816d-fda0-46d4-83f4-cc35e7eb9837 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:29.953300 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f3d9b-b79b-4d65-af16-3a00cc499e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:29.953949 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f3d9b-b79b-4d65-af16-3a00cc499e70 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:29.954221 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f3d9b-b79b-4d65-af16-3a00cc499e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:29.954486 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f3d9b-b79b-4d65-af16-3a00cc499e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:29.964858 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f3d9b-b79b-4d65-af16-3a00cc499e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:29.966379 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f3d9b-b79b-4d65-af16-3a00cc499e70 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:29.977180 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1450/2859] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:30.277937 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16892e27-882e-4097-af7a-6c0833fdd93b None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:30.279621 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-16892e27-882e-4097-af7a-6c0833fdd93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:30.292417 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16892e27-882e-4097-af7a-6c0833fdd93b None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:30.298145 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc51bf-1d06-477e-a1dc-28d9ebe92724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:30.303927 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc51bf-1d06-477e-a1dc-28d9ebe92724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:30.304295 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc51bf-1d06-477e-a1dc-28d9ebe92724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:30.304648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc51bf-1d06-477e-a1dc-28d9ebe92724 admin admin] PATH_INFO: `/v3/projects/c468a7e36c384eae854b157c7e478c1f` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:30.306083 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc51bf-1d06-477e-a1dc-28d9ebe92724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c468a7e36c384eae854b157c7e478c1f)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:30.308091 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc51bf-1d06-477e-a1dc-28d9ebe92724 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:30.363455 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-36bc51bf-1d06-477e-a1dc-28d9ebe92724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c468a7e36c384eae854b157c7e478c1f', 'request_id': 'req-36bc51bf-1d06-477e-a1dc-28d9ebe92724'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:30.371358 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-36bc51bf-1d06-477e-a1dc-28d9ebe92724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c468a7e36c384eae854b157c7e478c1f', 'request_id': 'req-36bc51bf-1d06-477e-a1dc-28d9ebe92724'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:30.378031 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-36bc51bf-1d06-477e-a1dc-28d9ebe92724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c468a7e36c384eae854b157c7e478c1f', 'request_id': 'req-36bc51bf-1d06-477e-a1dc-28d9ebe92724'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:30.389001 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-36bc51bf-1d06-477e-a1dc-28d9ebe92724 admin admin] The token cache is being invalidate because project c468a7e36c384eae854b157c7e478c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80169) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:32:30.389291 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-36bc51bf-1d06-477e-a1dc-28d9ebe92724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:30.390075 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-36bc51bf-1d06-477e-a1dc-28d9ebe92724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:30.391827 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1410/2860] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:32:30 2022] DELETE /identity/v3/projects/c468a7e36c384eae854b157c7e478c1f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:32:30.396636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab9900-837f-4263-93e5-bee228ff62c0 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:30.396945 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab9900-837f-4263-93e5-bee228ff62c0 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:30.397214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab9900-837f-4263-93e5-bee228ff62c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:30.423788 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-95ab9900-837f-4263-93e5-bee228ff62c0 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:30.425877 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-95ab9900-837f-4263-93e5-bee228ff62c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:30.471099 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:30.502965 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1451/2861] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:32:30.513704 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e420e1e-1bf8-4091-b3f3-b04031c2bd34 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:30.513990 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e420e1e-1bf8-4091-b3f3-b04031c2bd34 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:30.514255 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e420e1e-1bf8-4091-b3f3-b04031c2bd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:30.542812 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-4e420e1e-1bf8-4091-b3f3-b04031c2bd34 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:30.544268 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-4e420e1e-1bf8-4091-b3f3-b04031c2bd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:30.553316 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1411/2862] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:30.560054 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab9900-837f-4263-93e5-bee228ff62c0 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:30.575299 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab9900-837f-4263-93e5-bee228ff62c0 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:30.581099 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b42884-f356-4310-95f0-f2f0f2f2cc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:30.581737 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b42884-f356-4310-95f0-f2f0f2f2cc1c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:30.582021 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b42884-f356-4310-95f0-f2f0f2f2cc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:30.582277 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b42884-f356-4310-95f0-f2f0f2f2cc1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:30.582897 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b42884-f356-4310-95f0-f2f0f2f2cc1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:32:30.583206 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b42884-f356-4310-95f0-f2f0f2f2cc1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:30.584838 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b42884-f356-4310-95f0-f2f0f2f2cc1c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:30.597745 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1452/2863] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:32:30.602444 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e420e1e-1bf8-4091-b3f3-b04031c2bd34 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:30.612141 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e420e1e-1bf8-4091-b3f3-b04031c2bd34 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:30.618315 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12369ce0-92dc-48a9-ab38-89a9a2951f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:30.618913 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12369ce0-92dc-48a9-ab38-89a9a2951f92 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:30.619178 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12369ce0-92dc-48a9-ab38-89a9a2951f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:30.619436 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12369ce0-92dc-48a9-ab38-89a9a2951f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:30.620052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12369ce0-92dc-48a9-ab38-89a9a2951f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:30.622002 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12369ce0-92dc-48a9-ab38-89a9a2951f92 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:30.652097 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1412/2864] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:32:30 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:32:30.657329 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b42884-f356-4310-95f0-f2f0f2f2cc1c admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:30.667659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b42884-f356-4310-95f0-f2f0f2f2cc1c admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:30.723822 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefb0da-f6ce-435c-b029-54f94996432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:30.724428 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefb0da-f6ce-435c-b029-54f94996432b admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:30.724701 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefb0da-f6ce-435c-b029-54f94996432b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:30.724969 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefb0da-f6ce-435c-b029-54f94996432b admin admin] PATH_INFO: `/v3/users` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:30.725598 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefb0da-f6ce-435c-b029-54f94996432b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:30.727539 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefb0da-f6ce-435c-b029-54f94996432b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:30.751443 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1453/2865] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:32:30 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:32:30.756422 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12369ce0-92dc-48a9-ab38-89a9a2951f92 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:30.769825 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12369ce0-92dc-48a9-ab38-89a9a2951f92 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:30.775591 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d9698-0147-4400-b9d2-9312ddd15355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:30.776178 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d9698-0147-4400-b9d2-9312ddd15355 admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:30.776447 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d9698-0147-4400-b9d2-9312ddd15355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:30.776709 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d9698-0147-4400-b9d2-9312ddd15355 admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:30.777325 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d9698-0147-4400-b9d2-9312ddd15355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:30.779017 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d9698-0147-4400-b9d2-9312ddd15355 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:30.788917 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1413/2866] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:32:30.793112 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefb0da-f6ce-435c-b029-54f94996432b admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:30.803778 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefb0da-f6ce-435c-b029-54f94996432b admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:30.809403 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a5ede-bdd8-4b9e-bb69-0856aad2370b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:30.810069 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a5ede-bdd8-4b9e-bb69-0856aad2370b admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:30.810346 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a5ede-bdd8-4b9e-bb69-0856aad2370b admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:30.810611 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a5ede-bdd8-4b9e-bb69-0856aad2370b admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:30.811249 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a5ede-bdd8-4b9e-bb69-0856aad2370b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:30.813005 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a5ede-bdd8-4b9e-bb69-0856aad2370b admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:30.823857 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1454/2867] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:32:30.828248 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d9698-0147-4400-b9d2-9312ddd15355 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:30.839143 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d9698-0147-4400-b9d2-9312ddd15355 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:30.844360 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1941e-4189-47ac-8d37-d55a376affa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:30.844989 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1941e-4189-47ac-8d37-d55a376affa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:30.845267 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1941e-4189-47ac-8d37-d55a376affa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:30.845526 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1941e-4189-47ac-8d37-d55a376affa1 admin admin] PATH_INFO: `/v3/projects/eab42b530a5f49bfaad9225ebf5750e4/users/0f8b90a5471f401287fe0f0eca7dbb91/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:30.847857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:30.863342 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1941e-4189-47ac-8d37-d55a376affa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab42b530a5f49bfaad9225ebf5750e4, user_id=0f8b90a5471f401287fe0f0eca7dbb91, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:30.866004 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1941e-4189-47ac-8d37-d55a376affa1 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:30.883046 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1414/2868] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:32:30 2022] PUT /identity/v3/projects/eab42b530a5f49bfaad9225ebf5750e4/users/0f8b90a5471f401287fe0f0eca7dbb91/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:32:30.894316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d40a5-790a-4a63-bafe-086c1dabbacb None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:30.894574 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d40a5-790a-4a63-bafe-086c1dabbacb None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:30.894826 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d40a5-790a-4a63-bafe-086c1dabbacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:30.925384 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-707d40a5-790a-4a63-bafe-086c1dabbacb None None] MFA Rules not processed for user `0f8b90a5471f401287fe0f0eca7dbb91`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:30.926650 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-707d40a5-790a-4a63-bafe-086c1dabbacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:31.000658 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1455/2869] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:31.012720 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1941e-4189-47ac-8d37-d55a376affa1 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:31.014656 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-3db1941e-4189-47ac-8d37-d55a376affa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:31.078820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1941e-4189-47ac-8d37-d55a376affa1 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:31.082943 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40691f18-6cd4-4130-962a-666c50e10eec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '097822b9d7954dd0b27e9f650b6e36f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:31.083568 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40691f18-6cd4-4130-962a-666c50e10eec service cinder] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:31.083840 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40691f18-6cd4-4130-962a-666c50e10eec service cinder] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:31.084135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40691f18-6cd4-4130-962a-666c50e10eec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:31.094494 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40691f18-6cd4-4130-962a-666c50e10eec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:31.096035 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40691f18-6cd4-4130-962a-666c50e10eec service cinder] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:31.106536 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1415/2870] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:32.503722 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9d5bc-d0d8-41ad-b6ab-3b74ffd52dbf None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:32.504297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9d5bc-d0d8-41ad-b6ab-3b74ffd52dbf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:32.504297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9d5bc-d0d8-41ad-b6ab-3b74ffd52dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:32.523990 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-f2a9d5bc-d0d8-41ad-b6ab-3b74ffd52dbf None None] MFA Rules not processed for user `0f8b90a5471f401287fe0f0eca7dbb91`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:32.525177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f2a9d5bc-d0d8-41ad-b6ab-3b74ffd52dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:32.532392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1456/2871] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:38.644533 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40691f18-6cd4-4130-962a-666c50e10eec service cinder] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:38.646051 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-40691f18-6cd4-4130-962a-666c50e10eec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:38.720240 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40691f18-6cd4-4130-962a-666c50e10eec service cinder] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:38.726143 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f982f-f7c3-475f-98b8-4285d6e6dff2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:38.726757 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f982f-f7c3-475f-98b8-4285d6e6dff2 service placement] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:38.727260 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f982f-f7c3-475f-98b8-4285d6e6dff2 service placement] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:38.727887 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f982f-f7c3-475f-98b8-4285d6e6dff2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:38.730106 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f62f982f-f7c3-475f-98b8-4285d6e6dff2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:38.742551 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f982f-f7c3-475f-98b8-4285d6e6dff2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:38.744135 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f982f-f7c3-475f-98b8-4285d6e6dff2 service placement] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:38.754978 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1416/2872] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:42.518353 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:47.157126 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9d5bc-d0d8-41ad-b6ab-3b74ffd52dbf None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:47.158592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f2a9d5bc-d0d8-41ad-b6ab-3b74ffd52dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:47.238485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9d5bc-d0d8-41ad-b6ab-3b74ffd52dbf None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:47.244572 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241181f9-37d5-4f81-bc49-7c28afe77cf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:47.245198 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241181f9-37d5-4f81-bc49-7c28afe77cf8 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:47.245466 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241181f9-37d5-4f81-bc49-7c28afe77cf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:47.245763 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241181f9-37d5-4f81-bc49-7c28afe77cf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:47.247599 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-241181f9-37d5-4f81-bc49-7c28afe77cf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:47.259759 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241181f9-37d5-4f81-bc49-7c28afe77cf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:47.261322 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241181f9-37d5-4f81-bc49-7c28afe77cf8 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:47.271598 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1457/2873] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:48.750184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=65,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:52.030801 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d7002-cc03-45c8-8c77-c6a36cc55c23 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:52.031434 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d7002-cc03-45c8-8c77-c6a36cc55c23 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:52.031434 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d7002-cc03-45c8-8c77-c6a36cc55c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:52.093049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-9d3d7002-cc03-45c8-8c77-c6a36cc55c23 None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:52.094337 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-9d3d7002-cc03-45c8-8c77-c6a36cc55c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:52.165126 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1417/2874] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Aug 9 11:32:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:52.224714 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241181f9-37d5-4f81-bc49-7c28afe77cf8 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:52.227140 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-241181f9-37d5-4f81-bc49-7c28afe77cf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:52.337261 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241181f9-37d5-4f81-bc49-7c28afe77cf8 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:52.342692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335de14-ffb6-4cbe-b698-0dd9a63220bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:52.343297 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335de14-ffb6-4cbe-b698-0dd9a63220bc service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:52.343570 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335de14-ffb6-4cbe-b698-0dd9a63220bc service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:52.343844 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335de14-ffb6-4cbe-b698-0dd9a63220bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:52.354290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335de14-ffb6-4cbe-b698-0dd9a63220bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:52.355895 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335de14-ffb6-4cbe-b698-0dd9a63220bc service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:52.364386 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1458/2875] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:32:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:32:52.930078 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c486a-bb9d-4037-8105-53e6d7e5fe13 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:52.930351 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c486a-bb9d-4037-8105-53e6d7e5fe13 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:52.930624 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c486a-bb9d-4037-8105-53e6d7e5fe13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:52.949781 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-766c486a-bb9d-4037-8105-53e6d7e5fe13 None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:52.950983 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-766c486a-bb9d-4037-8105-53e6d7e5fe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:52.958432 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1418/2876] 10.222.0.15 () {58 vars in 967 bytes} [Tue Aug 9 11:32:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:52.971628 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335de14-ffb6-4cbe-b698-0dd9a63220bc service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:52.983053 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335de14-ffb6-4cbe-b698-0dd9a63220bc service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:52.987971 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef9789-7d31-4335-8186-74371175ce87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:52.988579 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef9789-7d31-4335-8186-74371175ce87 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:52.988898 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef9789-7d31-4335-8186-74371175ce87 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:52.989177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef9789-7d31-4335-8186-74371175ce87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:52.998871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef9789-7d31-4335-8186-74371175ce87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:53.000581 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef9789-7d31-4335-8186-74371175ce87 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:53.010509 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1459/2877] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:32:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:32:53.240402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37cb31-66e1-4232-bebd-ce8a832e0844 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:53.240912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37cb31-66e1-4232-bebd-ce8a832e0844 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:53.240912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37cb31-66e1-4232-bebd-ce8a832e0844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:53.261191 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-8d37cb31-66e1-4232-bebd-ce8a832e0844 None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:53.262530 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8d37cb31-66e1-4232-bebd-ce8a832e0844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:53.270986 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1419/2878] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Aug 9 11:32:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 11:32:53.283572 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef9789-7d31-4335-8186-74371175ce87 service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:53.295203 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef9789-7d31-4335-8186-74371175ce87 service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:53.300928 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcde37c-a278-4df0-8676-ab8896e09298 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:53.301564 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcde37c-a278-4df0-8676-ab8896e09298 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:53.301880 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcde37c-a278-4df0-8676-ab8896e09298 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:53.302149 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcde37c-a278-4df0-8676-ab8896e09298 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:53.311212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcde37c-a278-4df0-8676-ab8896e09298 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:53.312810 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcde37c-a278-4df0-8676-ab8896e09298 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:53.321881 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1460/2879] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:32:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:32:53.668407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca7ad9-f61d-44fa-b24d-c4c3ae87b78a None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:53.668678 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca7ad9-f61d-44fa-b24d-c4c3ae87b78a None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:53.668962 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca7ad9-f61d-44fa-b24d-c4c3ae87b78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:53.689693 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-0eca7ad9-f61d-44fa-b24d-c4c3ae87b78a None None] MFA Rules not processed for user `345ec6b0da4c4f07a6047190f8b2182d`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:53.691082 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0eca7ad9-f61d-44fa-b24d-c4c3ae87b78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:53.699328 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1420/2880] 10.222.0.15 () {58 vars in 967 bytes} [Tue Aug 9 11:32:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:53.711962 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcde37c-a278-4df0-8676-ab8896e09298 service swift] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:53.723111 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcde37c-a278-4df0-8676-ab8896e09298 service swift] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:53.730033 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29211968-3b1b-420b-901e-a712aeb81d20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '557b8757098e4777965d782d1ce5f97b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:53.730650 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29211968-3b1b-420b-901e-a712aeb81d20 service swift] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:53.730916 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29211968-3b1b-420b-901e-a712aeb81d20 service swift] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:53.731177 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29211968-3b1b-420b-901e-a712aeb81d20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:53.740273 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29211968-3b1b-420b-901e-a712aeb81d20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:53.741814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29211968-3b1b-420b-901e-a712aeb81d20 service swift] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:53.750444 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1461/2881] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Aug 9 11:32:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 11:32:56.121832 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca7ad9-f61d-44fa-b24d-c4c3ae87b78a None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:56.191911 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca7ad9-f61d-44fa-b24d-c4c3ae87b78a None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:56.196774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55be73d-8c2c-4a5c-8305-712d01a0ff52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:56.197453 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55be73d-8c2c-4a5c-8305-712d01a0ff52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:56.197923 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55be73d-8c2c-4a5c-8305-712d01a0ff52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:56.198194 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55be73d-8c2c-4a5c-8305-712d01a0ff52 admin admin] PATH_INFO: `/v3/users/0f8b90a5471f401287fe0f0eca7dbb91` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:56.199385 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55be73d-8c2c-4a5c-8305-712d01a0ff52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8b90a5471f401287fe0f0eca7dbb91)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:56.201345 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55be73d-8c2c-4a5c-8305-712d01a0ff52 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:56.255437 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f55be73d-8c2c-4a5c-8305-712d01a0ff52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8b90a5471f401287fe0f0eca7dbb91'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:56.264719 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f55be73d-8c2c-4a5c-8305-712d01a0ff52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8b90a5471f401287fe0f0eca7dbb91'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:56.265383 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f55be73d-8c2c-4a5c-8305-712d01a0ff52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8b90a5471f401287fe0f0eca7dbb91'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:56.266875 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:56.275904 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f55be73d-8c2c-4a5c-8305-712d01a0ff52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8b90a5471f401287fe0f0eca7dbb91'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:56.289375 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-f55be73d-8c2c-4a5c-8305-712d01a0ff52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8b90a5471f401287fe0f0eca7dbb91'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:56.295836 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1421/2882] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:32:56 2022] DELETE /identity/v3/users/0f8b90a5471f401287fe0f0eca7dbb91 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:32:56.300922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce4399-8b1f-48ba-996c-61d26b1a4c80 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:56.301494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce4399-8b1f-48ba-996c-61d26b1a4c80 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:56.301494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce4399-8b1f-48ba-996c-61d26b1a4c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:56.320875 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-73ce4399-8b1f-48ba-996c-61d26b1a4c80 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:56.322153 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-73ce4399-8b1f-48ba-996c-61d26b1a4c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:56.332405 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=100 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:56.404186 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1462/2883] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:56.414633 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55be73d-8c2c-4a5c-8305-712d01a0ff52 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:56.416333 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-f55be73d-8c2c-4a5c-8305-712d01a0ff52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:56.481721 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55be73d-8c2c-4a5c-8305-712d01a0ff52 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:56.486611 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7640f29-44af-4542-9560-5697ce189cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:56.487478 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7640f29-44af-4542-9560-5697ce189cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:56.487478 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7640f29-44af-4542-9560-5697ce189cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:56.487770 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7640f29-44af-4542-9560-5697ce189cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:56.498707 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7640f29-44af-4542-9560-5697ce189cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:56.500664 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7640f29-44af-4542-9560-5697ce189cb0 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:56.512384 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1422/2884] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:32:56.704913 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce4399-8b1f-48ba-996c-61d26b1a4c80 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:56.706450 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-73ce4399-8b1f-48ba-996c-61d26b1a4c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:56.723290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce4399-8b1f-48ba-996c-61d26b1a4c80 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:56.731016 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2bfb0-568c-45a3-99a8-5790e77ade32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:56.731620 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2bfb0-568c-45a3-99a8-5790e77ade32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:56.732013 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2bfb0-568c-45a3-99a8-5790e77ade32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:56.732155 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2bfb0-568c-45a3-99a8-5790e77ade32 admin admin] PATH_INFO: `/v3/projects/eab42b530a5f49bfaad9225ebf5750e4` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:56.733418 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2bfb0-568c-45a3-99a8-5790e77ade32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab42b530a5f49bfaad9225ebf5750e4)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:56.735400 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2bfb0-568c-45a3-99a8-5790e77ade32 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:56.788001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-52b2bfb0-568c-45a3-99a8-5790e77ade32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab42b530a5f49bfaad9225ebf5750e4', 'request_id': 'req-52b2bfb0-568c-45a3-99a8-5790e77ade32'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:56.794741 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-52b2bfb0-568c-45a3-99a8-5790e77ade32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab42b530a5f49bfaad9225ebf5750e4', 'request_id': 'req-52b2bfb0-568c-45a3-99a8-5790e77ade32'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:56.803682 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-52b2bfb0-568c-45a3-99a8-5790e77ade32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab42b530a5f49bfaad9225ebf5750e4', 'request_id': 'req-52b2bfb0-568c-45a3-99a8-5790e77ade32'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:56.815830 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-52b2bfb0-568c-45a3-99a8-5790e77ade32 admin admin] The token cache is being invalidate because project eab42b530a5f49bfaad9225ebf5750e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:32:56.816159 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-52b2bfb0-568c-45a3-99a8-5790e77ade32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:56.816780 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-52b2bfb0-568c-45a3-99a8-5790e77ade32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:32:56.818418 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1463/2885] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:32:56 2022] DELETE /identity/v3/projects/eab42b530a5f49bfaad9225ebf5750e4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:32:56.824008 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d7dd2-8a17-4ced-beab-e37830702e36 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:56.824313 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d7dd2-8a17-4ced-beab-e37830702e36 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:56.824577 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d7dd2-8a17-4ced-beab-e37830702e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:56.844222 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-128d7dd2-8a17-4ced-beab-e37830702e36 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:56.845441 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-128d7dd2-8a17-4ced-beab-e37830702e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:56.907051 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1423/2886] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:56.916283 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33f4f3-f221-483a-892f-e2e1236656bf None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:56.916575 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33f4f3-f221-483a-892f-e2e1236656bf None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:56.916877 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33f4f3-f221-483a-892f-e2e1236656bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:56.938514 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-0a33f4f3-f221-483a-892f-e2e1236656bf None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:56.939745 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-0a33f4f3-f221-483a-892f-e2e1236656bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:56.948200 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1464/2887] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:56.952857 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d7dd2-8a17-4ced-beab-e37830702e36 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:56.963067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d7dd2-8a17-4ced-beab-e37830702e36 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:56.967864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f865-b0f6-4e99-9c74-e6c2fdb4b17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:56.968468 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f865-b0f6-4e99-9c74-e6c2fdb4b17a admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:56.968734 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f865-b0f6-4e99-9c74-e6c2fdb4b17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:56.968996 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f865-b0f6-4e99-9c74-e6c2fdb4b17a admin admin] PATH_INFO: `/v3/domains` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:56.969642 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21f865-b0f6-4e99-9c74-e6c2fdb4b17a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80169) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 11:32:56.969960 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21f865-b0f6-4e99-9c74-e6c2fdb4b17a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:56.971559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21f865-b0f6-4e99-9c74-e6c2fdb4b17a admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:56.984448 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1424/2888] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Aug 9 11:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 11:32:56.989162 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33f4f3-f221-483a-892f-e2e1236656bf None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:57.001969 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33f4f3-f221-483a-892f-e2e1236656bf None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:57.009661 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001982af-70fb-416a-9dc5-dd988909aa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:57.010645 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001982af-70fb-416a-9dc5-dd988909aa9e admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:57.011089 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001982af-70fb-416a-9dc5-dd988909aa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:57.011531 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001982af-70fb-416a-9dc5-dd988909aa9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:57.012522 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001982af-70fb-416a-9dc5-dd988909aa9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:57.015672 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001982af-70fb-416a-9dc5-dd988909aa9e admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:57.057147 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1465/2889] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:32:56 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:32:57.058477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f865-b0f6-4e99-9c74-e6c2fdb4b17a admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:57.069742 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f865-b0f6-4e99-9c74-e6c2fdb4b17a admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:57.129536 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e14b9c-e926-4d3a-81e2-86f3ec17da15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:57.130302 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e14b9c-e926-4d3a-81e2-86f3ec17da15 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:57.130444 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e14b9c-e926-4d3a-81e2-86f3ec17da15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:57.130672 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e14b9c-e926-4d3a-81e2-86f3ec17da15 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:57.131293 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e14b9c-e926-4d3a-81e2-86f3ec17da15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:57.133200 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e14b9c-e926-4d3a-81e2-86f3ec17da15 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:57.142407 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:57.161886 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1425/2890] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:32:57 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:32:57.163128 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001982af-70fb-416a-9dc5-dd988909aa9e admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:57.174118 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001982af-70fb-416a-9dc5-dd988909aa9e admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:57.179349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42fba8-0131-47ba-83e0-c6519e73c7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:57.179948 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42fba8-0131-47ba-83e0-c6519e73c7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:57.180281 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42fba8-0131-47ba-83e0-c6519e73c7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:57.180545 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42fba8-0131-47ba-83e0-c6519e73c7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:57.181182 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42fba8-0131-47ba-83e0-c6519e73c7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:57.182781 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42fba8-0131-47ba-83e0-c6519e73c7d9 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:57.193947 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1466/2891] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:32:57.198294 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e14b9c-e926-4d3a-81e2-86f3ec17da15 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:57.208846 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e14b9c-e926-4d3a-81e2-86f3ec17da15 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:57.213592 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb0f8b-3580-4dda-b60c-3cbaad2176ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:57.214234 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb0f8b-3580-4dda-b60c-3cbaad2176ac admin admin] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:57.214503 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb0f8b-3580-4dda-b60c-3cbaad2176ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:57.214767 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb0f8b-3580-4dda-b60c-3cbaad2176ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:57.215446 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb0f8b-3580-4dda-b60c-3cbaad2176ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:57.217043 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb0f8b-3580-4dda-b60c-3cbaad2176ac admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:57.228882 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1426/2892] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:32:57.233288 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42fba8-0131-47ba-83e0-c6519e73c7d9 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:57.244088 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42fba8-0131-47ba-83e0-c6519e73c7d9 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:57.249160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e52fa-ae7b-45bd-9eda-a955b8d7ffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:57.249824 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e52fa-ae7b-45bd-9eda-a955b8d7ffe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:57.250099 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e52fa-ae7b-45bd-9eda-a955b8d7ffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:57.250366 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e52fa-ae7b-45bd-9eda-a955b8d7ffe7 admin admin] PATH_INFO: `/v3/projects/db43cc07a3714592be1aa2b5ea604b87/users/27dd336e8fe340aa95b1685ed60098fe/roles/186990d6368647b5b0712c4fedf4afd9` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:57.266792 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e52fa-ae7b-45bd-9eda-a955b8d7ffe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db43cc07a3714592be1aa2b5ea604b87, user_id=27dd336e8fe340aa95b1685ed60098fe, role_id=186990d6368647b5b0712c4fedf4afd9)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:57.269437 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e52fa-ae7b-45bd-9eda-a955b8d7ffe7 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:57.284011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1467/2893] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:32:57 2022] PUT /identity/v3/projects/db43cc07a3714592be1aa2b5ea604b87/users/27dd336e8fe340aa95b1685ed60098fe/roles/186990d6368647b5b0712c4fedf4afd9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:32:57.289150 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9ac48-eb90-4986-ad43-5ac9a4fd0d86 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:57.289460 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9ac48-eb90-4986-ad43-5ac9a4fd0d86 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:57.289849 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9ac48-eb90-4986-ad43-5ac9a4fd0d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:57.309862 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-0db9ac48-eb90-4986-ad43-5ac9a4fd0d86 None None] MFA Rules not processed for user `f51a1b11f75b400fabaa9dacc41da029`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:32:57.311067 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0db9ac48-eb90-4986-ad43-5ac9a4fd0d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:57.382051 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1427/2894] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:32:57.396560 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e52fa-ae7b-45bd-9eda-a955b8d7ffe7 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:32:57.398671 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-270e52fa-ae7b-45bd-9eda-a955b8d7ffe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:32:57.443868 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:32:57.465783 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e52fa-ae7b-45bd-9eda-a955b8d7ffe7 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:32:57.470175 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6958fe3-a225-4a2a-a828-21e4735c8ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:32:57.470804 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6958fe3-a225-4a2a-a828-21e4735c8ccc service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:32:57.471076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6958fe3-a225-4a2a-a828-21e4735c8ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:32:57.471372 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6958fe3-a225-4a2a-a828-21e4735c8ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:32:57.481900 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6958fe3-a225-4a2a-a828-21e4735c8ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:32:57.483339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6958fe3-a225-4a2a-a828-21e4735c8ccc service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:32:57.493213 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1468/2895] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:33:01.621647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fc46d-9ba8-4cc8-9e1f-61bf62ea5ba3 None None] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:01.622290 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fc46d-9ba8-4cc8-9e1f-61bf62ea5ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:01.622290 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fc46d-9ba8-4cc8-9e1f-61bf62ea5ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:01.661215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.auth.core [None req-597fc46d-9ba8-4cc8-9e1f-61bf62ea5ba3 None None] MFA Rules not processed for user `27dd336e8fe340aa95b1685ed60098fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80169) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:33:01.662510 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-597fc46d-9ba8-4cc8-9e1f-61bf62ea5ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:33:01.738086 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1428/2896] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:33:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:33:01.742846 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6958fe3-a225-4a2a-a828-21e4735c8ccc service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:33:01.753225 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6958fe3-a225-4a2a-a828-21e4735c8ccc service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:33:01.758953 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cf95b-8b36-4e93-b787-8667b8d55a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:33:01.759681 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cf95b-8b36-4e93-b787-8667b8d55a1a admin admin] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:01.759957 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cf95b-8b36-4e93-b787-8667b8d55a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:01.760222 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cf95b-8b36-4e93-b787-8667b8d55a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:01.760864 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cf95b-8b36-4e93-b787-8667b8d55a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:33:01.762814 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cf95b-8b36-4e93-b787-8667b8d55a1a admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:33:01.792323 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1469/2897] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Aug 9 11:33:01 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 11:33:01.796708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fc46d-9ba8-4cc8-9e1f-61bf62ea5ba3 None None] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:33:01.808758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fc46d-9ba8-4cc8-9e1f-61bf62ea5ba3 None None] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:33:01.900313 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16400d2-4995-4db8-b8c2-149681cf76b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:33:01.901047 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16400d2-4995-4db8-b8c2-149681cf76b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:01.901414 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16400d2-4995-4db8-b8c2-149681cf76b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:01.901822 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16400d2-4995-4db8-b8c2-149681cf76b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:01.902568 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16400d2-4995-4db8-b8c2-149681cf76b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:33:01.904887 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16400d2-4995-4db8-b8c2-149681cf76b9 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:33:01.925195 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:01.931615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1429/2898] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Aug 9 11:33:01 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 11:33:01.935918 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cf95b-8b36-4e93-b787-8667b8d55a1a admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:33:01.948374 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cf95b-8b36-4e93-b787-8667b8d55a1a admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:33:01.956214 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed06f31-9c22-4a56-ac9a-6615b4156136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:33:01.956850 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06f31-9c22-4a56-ac9a-6615b4156136 admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:01.957185 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06f31-9c22-4a56-ac9a-6615b4156136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:01.957494 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed06f31-9c22-4a56-ac9a-6615b4156136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:01.958376 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed06f31-9c22-4a56-ac9a-6615b4156136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:33:01.960202 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed06f31-9c22-4a56-ac9a-6615b4156136 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:33:01.977536 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1470/2899] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 11:33:01.981952 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16400d2-4995-4db8-b8c2-149681cf76b9 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:33:01.993396 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16400d2-4995-4db8-b8c2-149681cf76b9 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:33:01.998648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fcb0c-9e8b-4cb7-a4c3-f0b66c7baf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:33:01.999348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fcb0c-9e8b-4cb7-a4c3-f0b66c7baf88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:01.999681 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fcb0c-9e8b-4cb7-a4c3-f0b66c7baf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:01.999873 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1fcb0c-9e8b-4cb7-a4c3-f0b66c7baf88 admin admin] PATH_INFO: `/v3/projects/aaf1f1bec40d444ab7fe339bc6c37af3/users/f6ad38d5db304cb5a72beeb3903fefff/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:02.017912 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fcb0c-9e8b-4cb7-a4c3-f0b66c7baf88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf1f1bec40d444ab7fe339bc6c37af3, user_id=f6ad38d5db304cb5a72beeb3903fefff, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:33:02.020648 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1fcb0c-9e8b-4cb7-a4c3-f0b66c7baf88 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:33:02.035907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1430/2900] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:33:01 2022] PUT /identity/v3/projects/aaf1f1bec40d444ab7fe339bc6c37af3/users/f6ad38d5db304cb5a72beeb3903fefff/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:33:02.040098 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed06f31-9c22-4a56-ac9a-6615b4156136 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:33:02.051559 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed06f31-9c22-4a56-ac9a-6615b4156136 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:33:02.116516 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb030ba-82e3-43c6-80fa-1fdc14daa06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:33:02.117129 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb030ba-82e3-43c6-80fa-1fdc14daa06c admin admin] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:02.117402 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb030ba-82e3-43c6-80fa-1fdc14daa06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:02.117700 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb030ba-82e3-43c6-80fa-1fdc14daa06c admin admin] PATH_INFO: `/v3/roles` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:02.118367 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb030ba-82e3-43c6-80fa-1fdc14daa06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:33:02.120031 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb030ba-82e3-43c6-80fa-1fdc14daa06c admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:33:02.131645 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1471/2901] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Aug 9 11:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 11:33:02.137071 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fcb0c-9e8b-4cb7-a4c3-f0b66c7baf88 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:33:02.147708 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1fcb0c-9e8b-4cb7-a4c3-f0b66c7baf88 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:33:02.152374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574d957-ddd9-435c-b569-41a77f196687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:33:02.153080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574d957-ddd9-435c-b569-41a77f196687 admin admin] REQUEST_METHOD: `PUT` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:02.153410 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574d957-ddd9-435c-b569-41a77f196687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:02.153738 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574d957-ddd9-435c-b569-41a77f196687 admin admin] PATH_INFO: `/v3/projects/aaf1f1bec40d444ab7fe339bc6c37af3/users/f6ad38d5db304cb5a72beeb3903fefff/roles/b70a2607f0e949d4ae213cbc724713e6` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:02.155589 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574d957-ddd9-435c-b569-41a77f196687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf1f1bec40d444ab7fe339bc6c37af3, user_id=f6ad38d5db304cb5a72beeb3903fefff, role_id=b70a2607f0e949d4ae213cbc724713e6)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:33:02.158236 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574d957-ddd9-435c-b569-41a77f196687 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:33:02.168914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1431/2902] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Aug 9 11:33:02 2022] PUT /identity/v3/projects/aaf1f1bec40d444ab7fe339bc6c37af3/users/f6ad38d5db304cb5a72beeb3903fefff/roles/b70a2607f0e949d4ae213cbc724713e6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 11:33:06.680330 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e37ba-7e1b-49d3-8811-ef146e542451 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:06.682393 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e37ba-7e1b-49d3-8811-ef146e542451 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:06.682716 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e37ba-7e1b-49d3-8811-ef146e542451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:06.714433 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-534e37ba-7e1b-49d3-8811-ef146e542451 None None] MFA Rules not processed for user `f6ad38d5db304cb5a72beeb3903fefff`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:33:06.715460 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-534e37ba-7e1b-49d3-8811-ef146e542451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:33:06.788425 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1472/2903] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:33:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:33:06.805610 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574d957-ddd9-435c-b569-41a77f196687 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:33:06.807669 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-0574d957-ddd9-435c-b569-41a77f196687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:33:06.883922 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574d957-ddd9-435c-b569-41a77f196687 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:33:06.889762 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb54cb3-93de-47f4-821a-3e216d056930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:33:06.890374 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb54cb3-93de-47f4-821a-3e216d056930 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:06.890645 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb54cb3-93de-47f4-821a-3e216d056930 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:06.890907 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb54cb3-93de-47f4-821a-3e216d056930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:06.948124 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb54cb3-93de-47f4-821a-3e216d056930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:33:06.950252 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb54cb3-93de-47f4-821a-3e216d056930 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:33:06.960361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1432/2904] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:33:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:33:08.039903 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fefed8-5807-48b6-ac08-c0c55ad6e0d4 None None] REQUEST_METHOD: `POST` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:08.040507 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fefed8-5807-48b6-ac08-c0c55ad6e0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:08.040612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fefed8-5807-48b6-ac08-c0c55ad6e0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:08.061208 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.auth.core [None req-46fefed8-5807-48b6-ac08-c0c55ad6e0d4 None None] MFA Rules not processed for user `27dd336e8fe340aa95b1685ed60098fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 11:33:08.062859 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-46fefed8-5807-48b6-ac08-c0c55ad6e0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:33:08.070964 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1473/2905] 10.222.0.15 () {58 vars in 958 bytes} [Tue Aug 9 11:33:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 11:33:16.955779 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=71,keystone:INSERT=2 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:18.054160 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=90,keystone:INSERT=1 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:23.715657 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb54cb3-93de-47f4-821a-3e216d056930 service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:33:23.717282 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-2cb54cb3-93de-47f4-821a-3e216d056930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:33:23.773386 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb54cb3-93de-47f4-821a-3e216d056930 service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:33:23.777063 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19a8d1-46f1-4862-8b0f-873853153a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:33:23.777677 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19a8d1-46f1-4862-8b0f-873853153a9e service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:23.777947 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19a8d1-46f1-4862-8b0f-873853153a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:23.778242 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19a8d1-46f1-4862-8b0f-873853153a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:23.779940 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-fe19a8d1-46f1-4862-8b0f-873853153a9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:33:23.789454 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19a8d1-46f1-4862-8b0f-873853153a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:33:23.790909 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19a8d1-46f1-4862-8b0f-873853153a9e service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:33:23.800022 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1433/2906] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:33:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:33:33.795476 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=26 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:33:36.411504 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fefed8-5807-48b6-ac08-c0c55ad6e0d4 None None] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:33:36.423631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fefed8-5807-48b6-ac08-c0c55ad6e0d4 None None] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:33:36.428212 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba251a-68b7-48a6-a9e3-36c470d7dfaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:33:36.428855 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba251a-68b7-48a6-a9e3-36c470d7dfaa service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:33:36.429119 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba251a-68b7-48a6-a9e3-36c470d7dfaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:33:36.429408 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba251a-68b7-48a6-a9e3-36c470d7dfaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:33:36.439193 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba251a-68b7-48a6-a9e3-36c470d7dfaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:33:36.440614 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba251a-68b7-48a6-a9e3-36c470d7dfaa service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:33:36.450598 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1474/2907] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:33:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:33:46.446339 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:35:06.044127 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19a8d1-46f1-4862-8b0f-873853153a9e service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:35:06.053498 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19a8d1-46f1-4862-8b0f-873853153a9e service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:35:06.058054 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017b957-60a5-42d1-bd3d-350e8017758b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:35:06.058659 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017b957-60a5-42d1-bd3d-350e8017758b service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:35:06.058926 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017b957-60a5-42d1-bd3d-350e8017758b service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:35:06.059228 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017b957-60a5-42d1-bd3d-350e8017758b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:35:06.061057 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6017b957-60a5-42d1-bd3d-350e8017758b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:35:06.071679 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017b957-60a5-42d1-bd3d-350e8017758b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:35:06.073120 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017b957-60a5-42d1-bd3d-350e8017758b service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:35:06.082143 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1434/2908] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:35:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:35:16.078016 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=6 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:02.324264 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba251a-68b7-48a6-a9e3-36c470d7dfaa service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:02.335245 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba251a-68b7-48a6-a9e3-36c470d7dfaa service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:02.341336 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b777e-bb57-4f14-8876-bc5fff060d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:02.342099 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b777e-bb57-4f14-8876-bc5fff060d24 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:02.342452 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b777e-bb57-4f14-8876-bc5fff060d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:02.342735 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b777e-bb57-4f14-8876-bc5fff060d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:02.345410 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ad5b777e-bb57-4f14-8876-bc5fff060d24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:02.366131 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b777e-bb57-4f14-8876-bc5fff060d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:02.367663 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b777e-bb57-4f14-8876-bc5fff060d24 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:02.378771 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1475/2909] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:36:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:36:03.570995 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017b957-60a5-42d1-bd3d-350e8017758b service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:03.581073 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017b957-60a5-42d1-bd3d-350e8017758b service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:03.585309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750266b-4c33-41da-b739-7b0f7275f694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:03.585946 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750266b-4c33-41da-b739-7b0f7275f694 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:03.586214 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750266b-4c33-41da-b739-7b0f7275f694 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:03.586477 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750266b-4c33-41da-b739-7b0f7275f694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:03.588376 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-d750266b-4c33-41da-b739-7b0f7275f694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:03.604303 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750266b-4c33-41da-b739-7b0f7275f694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:03.605758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750266b-4c33-41da-b739-7b0f7275f694 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:03.618024 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1435/2910] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:36:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:36:12.373725 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=6 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:13.612649 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=6 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:15.813478 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b777e-bb57-4f14-8876-bc5fff060d24 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:15.826691 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b777e-bb57-4f14-8876-bc5fff060d24 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:15.833761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccf807-fb49-40bf-bc5d-8a45b05f6263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:15.834340 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccf807-fb49-40bf-bc5d-8a45b05f6263 service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:15.834639 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccf807-fb49-40bf-bc5d-8a45b05f6263 service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:15.834883 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccf807-fb49-40bf-bc5d-8a45b05f6263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:15.837115 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f3ccf807-fb49-40bf-bc5d-8a45b05f6263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:15.847601 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccf807-fb49-40bf-bc5d-8a45b05f6263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:15.849352 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccf807-fb49-40bf-bc5d-8a45b05f6263 service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:15.858622 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1476/2911] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:36:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:36:16.008220 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750266b-4c33-41da-b739-7b0f7275f694 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:16.017895 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750266b-4c33-41da-b739-7b0f7275f694 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:16.022914 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87254c48-e2f9-44cd-9db9-495f55d13499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:16.023513 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87254c48-e2f9-44cd-9db9-495f55d13499 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:16.023783 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87254c48-e2f9-44cd-9db9-495f55d13499 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:16.024052 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87254c48-e2f9-44cd-9db9-495f55d13499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:16.026262 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-87254c48-e2f9-44cd-9db9-495f55d13499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:16.043376 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87254c48-e2f9-44cd-9db9-495f55d13499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:16.044820 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87254c48-e2f9-44cd-9db9-495f55d13499 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:16.053271 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1436/2912] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:36:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 11:36:16.171636 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccf807-fb49-40bf-bc5d-8a45b05f6263 service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:16.181075 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccf807-fb49-40bf-bc5d-8a45b05f6263 service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:16.185165 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e16a8-f9fb-4c75-b29b-a69cdb8a987e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:16.185809 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e16a8-f9fb-4c75-b29b-a69cdb8a987e service neutron] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:16.186076 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e16a8-f9fb-4c75-b29b-a69cdb8a987e service neutron] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:16.186316 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e16a8-f9fb-4c75-b29b-a69cdb8a987e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:16.188485 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-904e16a8-f9fb-4c75-b29b-a69cdb8a987e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:16.203349 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e16a8-f9fb-4c75-b29b-a69cdb8a987e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:16.204800 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e16a8-f9fb-4c75-b29b-a69cdb8a987e service neutron] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:16.216919 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1477/2913] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:36:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:36:16.278572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87254c48-e2f9-44cd-9db9-495f55d13499 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:36:16.280361 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-87254c48-e2f9-44cd-9db9-495f55d13499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:16.353758 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87254c48-e2f9-44cd-9db9-495f55d13499 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:36:16.359197 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37e9c1-9cb0-4418-b30a-77ee0d861ea5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:36:16.359866 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37e9c1-9cb0-4418-b30a-77ee0d861ea5 service placement] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:36:16.360080 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37e9c1-9cb0-4418-b30a-77ee0d861ea5 service placement] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:36:16.360348 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37e9c1-9cb0-4418-b30a-77ee0d861ea5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:36:16.362375 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-4c37e9c1-9cb0-4418-b30a-77ee0d861ea5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:36:16.375986 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37e9c1-9cb0-4418-b30a-77ee0d861ea5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:36:16.377572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37e9c1-9cb0-4418-b30a-77ee0d861ea5 service placement] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:36:16.389420 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1437/2914] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:36:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:36:26.211631 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=12 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:36:26.384787 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=38 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:37:58.385915 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e16a8-f9fb-4c75-b29b-a69cdb8a987e service neutron] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:37:58.452312 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e16a8-f9fb-4c75-b29b-a69cdb8a987e service neutron] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:37:58.458035 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeffe5d-7553-4ffa-a377-86d75d48d234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:37:58.458856 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeffe5d-7553-4ffa-a377-86d75d48d234 service nova] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:37:58.459172 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeffe5d-7553-4ffa-a377-86d75d48d234 service nova] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:37:58.459592 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeffe5d-7553-4ffa-a377-86d75d48d234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:37:58.462081 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-efeffe5d-7553-4ffa-a377-86d75d48d234 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:37:58.510958 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeffe5d-7553-4ffa-a377-86d75d48d234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:37:58.512773 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeffe5d-7553-4ffa-a377-86d75d48d234 service nova] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:37:58.528290 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1478/2915] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:37:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:38:00.700257 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37e9c1-9cb0-4418-b30a-77ee0d861ea5 service placement] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:00.701887 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-4c37e9c1-9cb0-4418-b30a-77ee0d861ea5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:00.774204 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37e9c1-9cb0-4418-b30a-77ee0d861ea5 service placement] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:00.779994 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f7b89-5682-4a1c-b504-82d98f059645 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881030d7605b40879762d1c199362ee1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:00.780559 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f7b89-5682-4a1c-b504-82d98f059645 service nova] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:00.780830 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f7b89-5682-4a1c-b504-82d98f059645 service nova] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:00.781095 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f7b89-5682-4a1c-b504-82d98f059645 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:00.782872 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-8b8f7b89-5682-4a1c-b504-82d98f059645 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:00.799098 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f7b89-5682-4a1c-b504-82d98f059645 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:00.800938 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f7b89-5682-4a1c-b504-82d98f059645 service nova] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:00.816322 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1438/2916] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:38:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:38:01.019613 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeffe5d-7553-4ffa-a377-86d75d48d234 service nova] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:01.022001 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-efeffe5d-7553-4ffa-a377-86d75d48d234 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:01.074019 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeffe5d-7553-4ffa-a377-86d75d48d234 service nova] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:01.079893 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec528233-792e-44d4-9aa9-172e2a749123 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:01.080595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec528233-792e-44d4-9aa9-172e2a749123 service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:01.080871 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec528233-792e-44d4-9aa9-172e2a749123 service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:01.081142 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec528233-792e-44d4-9aa9-172e2a749123 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:01.083122 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-ec528233-792e-44d4-9aa9-172e2a749123 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:01.096257 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec528233-792e-44d4-9aa9-172e2a749123 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:01.098407 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec528233-792e-44d4-9aa9-172e2a749123 service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:01.110006 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1479/2917] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:38:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:38:02.289258 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f7b89-5682-4a1c-b504-82d98f059645 service nova] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:02.300225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f7b89-5682-4a1c-b504-82d98f059645 service nova] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:02.304184 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f300d-2057-46c8-94e0-c9ed552eb701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ee3889add1541418ccda24268831979', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:02.304774 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f300d-2057-46c8-94e0-c9ed552eb701 service neutron] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:02.305045 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f300d-2057-46c8-94e0-c9ed552eb701 service neutron] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:02.305309 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f300d-2057-46c8-94e0-c9ed552eb701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:02.377725 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f300d-2057-46c8-94e0-c9ed552eb701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:02.379176 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f300d-2057-46c8-94e0-c9ed552eb701 service neutron] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:02.399049 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1439/2918] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:38:05.385006 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec528233-792e-44d4-9aa9-172e2a749123 service placement] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:05.400476 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec528233-792e-44d4-9aa9-172e2a749123 service placement] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:05.406777 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6696594-c463-4535-bfca-01ac2021fc33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:05.407803 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6696594-c463-4535-bfca-01ac2021fc33 service placement] REQUEST_METHOD: `GET` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:05.408318 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6696594-c463-4535-bfca-01ac2021fc33 service placement] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:05.408852 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6696594-c463-4535-bfca-01ac2021fc33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:05.411692 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-f6696594-c463-4535-bfca-01ac2021fc33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:05.428404 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6696594-c463-4535-bfca-01ac2021fc33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:05.430120 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6696594-c463-4535-bfca-01ac2021fc33 service placement] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:05.442721 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1480/2919] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:38:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 11:38:08.816059 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f300d-2057-46c8-94e0-c9ed552eb701 service neutron] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:08.826281 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f300d-2057-46c8-94e0-c9ed552eb701 service neutron] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:08.831615 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c5a38-94fc-4ee2-a4c0-397269549a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:08.838123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c5a38-94fc-4ee2-a4c0-397269549a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:08.838123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c5a38-94fc-4ee2-a4c0-397269549a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:08.838123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c5a38-94fc-4ee2-a4c0-397269549a21 admin admin] PATH_INFO: `/v3/users/27dd336e8fe340aa95b1685ed60098fe` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:08.838123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c5a38-94fc-4ee2-a4c0-397269549a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27dd336e8fe340aa95b1685ed60098fe)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:08.838123 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c5a38-94fc-4ee2-a4c0-397269549a21 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:08.886707 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6a3c5a38-94fc-4ee2-a4c0-397269549a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27dd336e8fe340aa95b1685ed60098fe'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:08.895356 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6a3c5a38-94fc-4ee2-a4c0-397269549a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27dd336e8fe340aa95b1685ed60098fe'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:08.896285 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6a3c5a38-94fc-4ee2-a4c0-397269549a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27dd336e8fe340aa95b1685ed60098fe'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:08.903938 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6a3c5a38-94fc-4ee2-a4c0-397269549a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27dd336e8fe340aa95b1685ed60098fe'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:08.909572 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:08.919225 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-6a3c5a38-94fc-4ee2-a4c0-397269549a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27dd336e8fe340aa95b1685ed60098fe'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:08.926224 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1440/2920] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:38:08 2022] DELETE /identity/v3/users/27dd336e8fe340aa95b1685ed60098fe => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:09.118367 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6696594-c463-4535-bfca-01ac2021fc33 service placement] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:09.131774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6696594-c463-4535-bfca-01ac2021fc33 service placement] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:09.192306 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740176ce-ab42-4c8f-b342-29a861145114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:09.192974 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740176ce-ab42-4c8f-b342-29a861145114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:09.193251 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740176ce-ab42-4c8f-b342-29a861145114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:09.193542 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740176ce-ab42-4c8f-b342-29a861145114 admin admin] PATH_INFO: `/v3/projects/db43cc07a3714592be1aa2b5ea604b87` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:09.194713 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740176ce-ab42-4c8f-b342-29a861145114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db43cc07a3714592be1aa2b5ea604b87)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:09.196612 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740176ce-ab42-4c8f-b342-29a861145114 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:09.246396 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:09.248922 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-740176ce-ab42-4c8f-b342-29a861145114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db43cc07a3714592be1aa2b5ea604b87', 'request_id': 'req-740176ce-ab42-4c8f-b342-29a861145114'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:09.258605 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-740176ce-ab42-4c8f-b342-29a861145114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db43cc07a3714592be1aa2b5ea604b87', 'request_id': 'req-740176ce-ab42-4c8f-b342-29a861145114'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:09.269052 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-740176ce-ab42-4c8f-b342-29a861145114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db43cc07a3714592be1aa2b5ea604b87', 'request_id': 'req-740176ce-ab42-4c8f-b342-29a861145114'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:09.293125 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-740176ce-ab42-4c8f-b342-29a861145114 admin admin] The token cache is being invalidate because project db43cc07a3714592be1aa2b5ea604b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:38:09.293392 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-740176ce-ab42-4c8f-b342-29a861145114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:09.294069 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-740176ce-ab42-4c8f-b342-29a861145114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:09.295595 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1481/2921] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:38:09 2022] DELETE /identity/v3/projects/db43cc07a3714592be1aa2b5ea604b87 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:09.299732 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c5a38-94fc-4ee2-a4c0-397269549a21 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:09.301976 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-6a3c5a38-94fc-4ee2-a4c0-397269549a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:09.322520 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c5a38-94fc-4ee2-a4c0-397269549a21 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:09.382304 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59af700-61d7-4bec-be1c-e784f72c1573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:09.382843 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59af700-61d7-4bec-be1c-e784f72c1573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:09.383116 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59af700-61d7-4bec-be1c-e784f72c1573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:09.383376 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59af700-61d7-4bec-be1c-e784f72c1573 admin admin] PATH_INFO: `/v3/users/f6ad38d5db304cb5a72beeb3903fefff` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:09.384918 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59af700-61d7-4bec-be1c-e784f72c1573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ad38d5db304cb5a72beeb3903fefff)` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:09.387655 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59af700-61d7-4bec-be1c-e784f72c1573 admin admin] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:09.436864 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-e59af700-61d7-4bec-be1c-e784f72c1573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ad38d5db304cb5a72beeb3903fefff'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:09.445647 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-e59af700-61d7-4bec-be1c-e784f72c1573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ad38d5db304cb5a72beeb3903fefff'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:09.446360 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-e59af700-61d7-4bec-be1c-e784f72c1573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ad38d5db304cb5a72beeb3903fefff'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:09.454215 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-e59af700-61d7-4bec-be1c-e784f72c1573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ad38d5db304cb5a72beeb3903fefff'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:09.466867 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.notifications [None req-e59af700-61d7-4bec-be1c-e784f72c1573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ad38d5db304cb5a72beeb3903fefff'} {{(pid=80169) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:09.473580 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1441/2922] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Aug 9 11:38:09 2022] DELETE /identity/v3/users/f6ad38d5db304cb5a72beeb3903fefff => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:09.671958 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740176ce-ab42-4c8f-b342-29a861145114 admin admin] Authenticating user token {{(pid=80168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:38:09.673418 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.fernet_utils [None req-740176ce-ab42-4c8f-b342-29a861145114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:38:09.689761 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740176ce-ab42-4c8f-b342-29a861145114 admin admin] Validating token access rules against request {{(pid=80168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:38:09.751355 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbce7a5-be2d-4733-ba1e-69e9831653a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51a1b11f75b400fabaa9dacc41da029', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '152f15d50a21447fba37927c712cf876', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:38:09.752011 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbce7a5-be2d-4733-ba1e-69e9831653a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:38:09.752291 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbce7a5-be2d-4733-ba1e-69e9831653a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:38:09.752602 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbce7a5-be2d-4733-ba1e-69e9831653a5 admin admin] PATH_INFO: `/v3/projects/aaf1f1bec40d444ab7fe339bc6c37af3` {{(pid=80168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:38:09.753940 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbce7a5-be2d-4733-ba1e-69e9831653a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf1f1bec40d444ab7fe339bc6c37af3)` {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:38:09.755882 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbce7a5-be2d-4733-ba1e-69e9831653a5 admin admin] RBAC: Authorization granted {{(pid=80168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:38:09.809396 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7dbce7a5-be2d-4733-ba1e-69e9831653a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf1f1bec40d444ab7fe339bc6c37af3', 'request_id': 'req-7dbce7a5-be2d-4733-ba1e-69e9831653a5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:09.814921 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7dbce7a5-be2d-4733-ba1e-69e9831653a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf1f1bec40d444ab7fe339bc6c37af3', 'request_id': 'req-7dbce7a5-be2d-4733-ba1e-69e9831653a5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:09.823774 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7dbce7a5-be2d-4733-ba1e-69e9831653a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf1f1bec40d444ab7fe339bc6c37af3', 'request_id': 'req-7dbce7a5-be2d-4733-ba1e-69e9831653a5'} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:09.835370 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7dbce7a5-be2d-4733-ba1e-69e9831653a5 admin admin] The token cache is being invalidate because project aaf1f1bec40d444ab7fe339bc6c37af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 11:38:09.835659 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7dbce7a5-be2d-4733-ba1e-69e9831653a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:09.836334 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG keystone.notifications [None req-7dbce7a5-be2d-4733-ba1e-69e9831653a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 11:38:09.837918 dv-cinder-852514-2-smb devstack@keystone.service[80168]: [pid: 80168|app: 0|req: 1482/2923] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Aug 9 11:38:09 2022] DELETE /identity/v3/projects/aaf1f1bec40d444ab7fe339bc6c37af3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 11:38:19.469786 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG dbcounter [-] [80169] Writing DB stats keystone:SELECT=58,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80169) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:38:19.832426 dv-cinder-852514-2-smb devstack@keystone.service[80168]: DEBUG dbcounter [-] [80168] Writing DB stats keystone:SELECT=63,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80168) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 11:43:24.309346 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59af700-61d7-4bec-be1c-e784f72c1573 admin admin] Authenticating user token {{(pid=80169) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 11:43:24.311163 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e59af700-61d7-4bec-be1c-e784f72c1573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:24.386848 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59af700-61d7-4bec-be1c-e784f72c1573 admin admin] Validating token access rules against request {{(pid=80169) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 11:43:24.459259 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c5180-115c-4ddb-9a98-3ef7162408c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a587c410fd8741f3b3858d21b9e4884d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '166e5328bfae434ba19d12be2eaa7a1b', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80169) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 11:43:24.459764 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c5180-115c-4ddb-9a98-3ef7162408c4 service placement] REQUEST_METHOD: `GET` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 11:43:24.460037 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c5180-115c-4ddb-9a98-3ef7162408c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 11:43:24.460301 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c5180-115c-4ddb-9a98-3ef7162408c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80169) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 11:43:24.462369 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.fernet_utils [None req-e44c5180-115c-4ddb-9a98-3ef7162408c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80169) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 11:43:24.476752 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c5180-115c-4ddb-9a98-3ef7162408c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 11:43:24.478958 dv-cinder-852514-2-smb devstack@keystone.service[80169]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c5180-115c-4ddb-9a98-3ef7162408c4 service placement] RBAC: Authorization granted {{(pid=80169) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 11:43:24.490402 dv-cinder-852514-2-smb devstack@keystone.service[80169]: [pid: 80169|app: 0|req: 1442/2924] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Aug 9 11:43:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)